Data Engineer- Maternity Leave Replacement

Job Description

Similarweb is seeking a Data Engineer for a maternity leave replacement to contribute to the design, construction, and upkeep of scalable, cloud-based data pipelines. The Data Engineer will collaborate with AWS services such as Redshift, S3, Glue, Managed Airflow, and Lambda to integrate, process, and analyze large datasets, ensuring data dependability and efficiency. This role directly impacts business intelligence, analytics, and data-driven decision-making throughout the company.

What the role involves:

• Developing and maintaining ETL processes, integrating data from various sources (APIs, databases, external platforms) using Python, SQL, and cloud technologies.
• Implementing solutions using PySpark, Databricks, Airflow, and cloud platforms (AWS) to process large-scale datasets efficiently.
• Designing and maintaining logical and physical data models to support business needs.
• Improving process efficiency and optimizing runtime performance to handle large-scale data workloads.
• Working closely with BI analysts and business stakeholders to define data requirements and functional specifications.
• Ensuring data integrity and reliability by proactively monitoring pipelines and resolving issues.

Requirements:

• BSc in Computer Science, Engineering, or equivalent practical experience.
• 3+ years of experience in data engineering or related roles.
• Proficiency in Python for data engineering and automation.
• Experience with Big Data technologies such as Spark, Databricks, DBT, and Airflow.
• Hands-on experience with AWS services (S3, Redshift, Glue, Managed Airflow, Lambda).
• Knowledge of Docker, Terraform, Kubernetes, and infrastructure automation.
• Strong understanding of data warehouse (DWH) methodologies and best practices.
• Strong problem-solving abilities and a proactive approach to learning new technologies.
• Excellent communication and collaboration skills, with the ability to work independently and in a team.

What the role offers:

• The opportunity to work with the most powerful digital intelligence platform in the world.
• A workplace that encourages open dialogue and empowers employees to bring their ideas to the table.
• Competitive perks & benefits.
• Opportunities to grow your career in any direction you choose.
• A diverse and inclusive workplace.