Engenheiro de Dados Pleno

Job Description

OLIVER, a company specializing in creating in-house marketing agencies, is seeking a Data Engineer to join their team. The Data Engineer will be responsible for data modeling, developing, and orchestrating ELT/ETL pipelines. The ideal candidate will ensure data accessibility, consistency, and readiness for analysis, utilizing tools such as Azure Data Factory, Databricks, dbt, and Airflow. This role involves collaborating with engineering, data science, and analytics teams to build data-driven solutions.

Responsibilities:

• Data modeling (star schema, snowflake schema, one big table)
• Develop and maintain ELT/ETL pipelines using Azure Data Factory, Databricks (PySpark), and dbt
• Orchestrate workflows with Airflow, ensuring efficiency, traceability, and reliability
• Work with SQL (Azure SQL Database, SQL Server) and NoSQL (Cosmos DB) databases
• Ensure data quality, integrity, and security, following governance best practices
• Collaborate with engineering, data science, and analytics teams
• Monitor and optimize data pipelines, identifying bottlenecks and opportunities for improvement

Requirements:

• Bachelor's degree in Computer Science, Engineering, Information Systems, or related fields
• Proficiency in SQL and Python
• Experience with Airflow for pipeline orchestration
• Experience with Apache Spark, especially PySpark in Databricks
• Experience with Azure Data Factory and pipeline orchestration in cloud environments
• Experience with code versioning (Git)

The role offers:

• Vale-Refeição: R$ 46,00 per business day
• Health Plan: SulAmérica
• Dental Assistance: SulAmérica Odonto
• Life Insurance: Metlife
• Wellhub
• Birthday day off