Senior Data Engineer at Smarkets

Smarkets is seeking a Senior Data Engineer to join their Data Team in London. The ideal candidate will contribute to the development and maintenance of ETL pipelines, ensure the health of the data lake (Redshift and Bigquery), and develop Flask services and Postgres databases. The Senior Data Engineer will also assist with automated reporting pipelines and data exploration, as well as training and deploying ML models.

The role involves:

• Developing and maintaining data ETL pipelines.
• Ensuring data lake health, particularly Redshift and Bigquery.
• Developing and maintaining Flask services and Postgres databases.
• Assisting with automated reporting pipelines.
• Performing data exploration and training & deploying ML models.

Requirements:

• 4+ years of experience.
• Understanding of developing ETL pipelines using Python frameworks.
• Experience with Python-based REST APIs / services and database integration (e.g. Postgres).
• Familiarity with Python data science stack tools (Pandas, Numpy, scikit-learn).
• Some experience with training and deploying ML models.
• Ability to write elegant, well-tested, and maintainable code.
• Team player with a proactive and friendly approach.
• Bachelor’s in Computer Science, Math, or equivalent experience.

Smarkets offers:

• Stock options
• Pension scheme
• Health insurance
• Fresh fruit and snacks
• Cycle-to-work scheme
• £1000 yearly education budget
• 25 days paid holiday + bank holidays
• Flexible working (2 days a week working from home)
• 20 days a year of global working
• Lunch everyday provided by in-house Chef