Freelance Principal Data Engineer - Remote Colombia

Job Description

Seamless.AI is seeking a Freelance Principal Data Engineer to contribute to their data initiatives. The ideal candidate will be responsible for designing, developing, and maintaining scalable ETL pipelines, working with stakeholders to understand data requirements, and implementing data transformation logic using Python and relevant frameworks. They will also utilize AWS Glue to manage ETL jobs and optimize ETL processes for large datasets.

The role involves applying data matching, deduplication, and aggregation techniques to enhance data accuracy and quality, ensuring compliance with data governance and security best practices, and providing recommendations on emerging technologies.

Responsibilities:

• Design, develop, and maintain scalable ETL pipelines.
• Work with stakeholders to understand data requirements.
• Implement data transformation logic using Python.
• Utilize AWS Glue to create and manage ETL jobs.
• Optimize ETL processes for large datasets.
• Apply data matching and aggregation techniques.
• Ensure compliance with data governance and security practices.
• Provide recommendations on emerging technologies.

Requirements:

• Strong proficiency in Python and related frameworks.
• Hands-on experience with AWS Glue or similar ETL tools.
• Solid understanding of data modeling and data warehousing principles.
• Expertise in working with large datasets and distributed computing frameworks.
• Strong proficiency in SQL.
• Familiarity with data matching and deduplication methodologies.
• Excellent communication and collaboration skills.
• Fluency in English and Spanish.

Seamless.AI offers:

• Opportunity to work as an independent contractor.
• Project-based or fixed contractual rate compensation.
• A 6-month or 12-month contract with possible renewal.