Job Description
ília is seeking a Data Engineer to join their team. The company specializes in technology, data, and design, driving digital transformation for major market players in the financial, insurance, and mobility sectors. With over 450 professionals, ília has a presence in Brazil and Europe, serving markets in Latin America, Europe, and North America.
The Data Engineer will be responsible for building a robust data lake, seamlessly integrated with the company's data sources. This includes advanced data visualizations and AI-driven applications to improve business outcomes and operational efficiency.
Responsibilities:
- Designing, building, and maintaining efficient data pipelines for batch and streaming data processing.
- Implementing pipeline orchestration workflows using modern tools to ensure reliability and scalability.
- Contributing to the development and optimization of a Lakehouse architecture, including Medallion architecture principles (bronze, silver, gold layers).
- Managing structured and semi-structured data formats such as Parquet, CSV, and JSON.
- Collaborating with cross-functional teams to align data solutions with business objectives.
- Ensuring adherence to data governance, security, and compliance best practices.
Requirements:
- Advanced English and/or Spanish proficiency.
- Solid understanding of key data engineering concepts: Medallion architecture, dimensional modeling, batch vs. streaming data processing, and pipeline orchestration.
- Proficiency in Python and SQL for data processing and development.
- Experience designing and maintaining data pipelines in cloud environments (AWS, GCP, or Azure).
- Familiarity with data workflow orchestration tools (e.g., Apache Airflow, Prefect, Step Functions).
- Strong analytical and problem-solving skills.
The role offers:
- CLT contract - 40 hours per week with a flexible schedule, working remotely.
- Health and dental plan.
- Flexible food/meal voucher.
- Life insurance.
- Home office assistance.
- Access to Wellhub (Gympass) and TotalPass.
- Corporate university with over 20,000 courses.
- Language academy.