Data Engineer III

Job Description

SurveyMonkey is seeking a highly skilled Data Engineer III to join their central data organization. The ideal candidate will be responsible for building and managing end-to-end data pipelines (batch and near real-time) using modern cloud technologies. This role involves leading data engineering initiatives and building analytical solutions that are highly available, scalable, stable, secure, and cost-effective. The Data Engineer III will report to the Senior Manager, Data Engineering.Role involves:

• Designing, architecting, and building data pipelines to support existing data models.
• Ensuring data quality by building quality checks into the end-to-end data pipelines.
• Building new data models (Fact vs Dimension).
• Writing performant and idempotent transformations in Snowflake.
• Building data pipelines using Python scripting.
• Writing well-tested, production-ready code in Python and Snowflake SQL.
• Implementing ETL (or ELT) best practices.
• Translating business requirements to technical specifications.
• Writing complex data engineering Snowflake SQL jobs.
• Documenting systems for internal and external stakeholders.
• Monitoring and debugging data pipelines running on Airflow.
• Participating in code reviews and mentoring data engineers.

Requirements:

• 5+ years of experience in data engineering and data warehousing technologies.
• 3+ years of experience in Snowflake/ETL or similar technologies like Redshift.
• Experience with AWS cloud services (S3, EC2, RDS, Spark, EMR etc.).
• Experience with object-oriented/object function scripting languages (Python preferred, Java, Scala, etc.).
• Experience in orchestrating, automating, and deploying production data pipelines using Airflow/Luigi, etc.
• Experience with DevOps practices (Git, Github actions, CI/CD pipelines, Terraform etc.).
• Experience with tools such as DBT or other similar technologies.
• In-depth knowledge of Data lakes, EDW concepts, data modeling (Star, Snowflake and Galaxy schemas).

Role offers:

• Opportunity to work with modern cloud technologies.
• In-person collaboration.