C6 Bank is seeking a Junior Data Engineer to join its Data Engineering team in São Paulo, Brazil. The team is responsible for developing and maintaining the Data Platform and all data ingestion pipelines from transactional, operational, and customer relationship systems. The role involves ensuring the availability of data in the Data Lake for business decision-making and monitoring the pipelines to guarantee their reading and loading functionalities, as well as their performance and efficiency.He/She will work in data ingestion, develop features, monitor execution, and maintain pipelines. The engineer will also participate in daily squad meetings for alignment.
Responsibilities include: - Ingesting raw data using Google Cloud stack.
- Developing and maintaining ingestion features with methods that aim for better efficiency and performance.
- Monitoring the execution of platform ingestions using Google Cloud resources.
- Maintaining/sustaining legacy and platform pipelines.
- Participating in daily data squad meetings for execution alignment.
Requirements: - Experience with orchestration tools like Airflow.
- Proficiency in programming languages such as Python, Golang, and Apache Beam.
- Experience in ingesting data from SQL, NoSQL, API, Salesforce, and SAP.
- Knowledge of Test-Driven Development (TDD).
- Understanding of software development concepts and best practices.
- Familiarity with Docker and Kubernetes.
C6 Bank offers: - Meal vouchers.
- Food vouchers.
- Health and dental plan.
- Childcare assistance.
- Life insurance.
- WellHub.
- Online therapy.