Browse All Jobs

Data Engineering Sênior | Platform

Senior Data Engineer for building and maintaining data infrastructure.
Creditas
Hybrid
On-Site
Brazil
Undisclosed salary
Job Description
Creditas is seeking a Senior Data Engineer to join their Platform team in São Paulo, Brazil. The ideal candidate will be instrumental in developing and maintaining Creditas' data infrastructure, ensuring efficient processing and storage of large-scale data, and supporting the construction of their Data Platform.This role involves:
  • Designing, building, and maintaining scalable and reliable data pipelines and database systems.
  • Managing solutions and automating processes using tools like Spark, AirFlow, Redash, EMR, and Redshift.
  • Ensuring adherence to data governance policies.
  • Developing scalable data processing solutions on AWS.
  • Implementing CI/CD processes and utilizing Infrastructure as Code (IaC) to streamline data operations.
  • Implementing data solutions using technologies like Spark, Python, and various AWS services (S3, Redshift, EMR, Athena, Glue).
  • Mentoring and training fellow engineers, fostering a culture of continuous improvement.
  • Identifying and addressing gaps in team capabilities and processes to enhance efficiency.
Requirements include:
  • Experience in data engineering and Big Data.
  • Strong programming skills in Python, Java, Scala, or similar languages.
  • Hands-on experience building scalable data platforms and reliable data pipelines using technologies like Spark, Hadoop, Databricks, AWS SQS, AWS Kinesis, Kafka, etc.
  • Deep understanding of data processing and comfort working with large datasets.
  • Familiarity with data warehousing, data lakes, ETL, and relational databases.
  • Commitment to data quality, accuracy, performance, and reliability.
  • Availability to be present at the office in São Paulo-SP once per trimester for 4 consecutive days.
Creditas offers:
  • Life insurance.
  • Health and dental plans.
  • Profit Sharing Program (PPR).
  • Corporate University (Academy).
  • Mental health support.
  • Gym access.
  • Birthday day off.
  • Childcare assistance.
  • Parental leave.
  • Flexible work model.
  • Transportation assistance.
  • Flexible benefits card.
  • Pharmacy benefits.
  • Salary advance.
Apply Manually

Creditas

All Jobs at Creditas (32)