Manager, Data Engineering 

Job Description

Interwell Health is seeking a Manager of Data Engineering to spearhead the development and optimization of data pipelines and workflows. The manager will ensure seamless integration across the organization's data infrastructure. They will harness the power of Azure MI, Databricks, and OneLake to implement and scale innovative data solutions for big data processing, machine learning, and real-time analytics. In this role, the manager will optimize the data lake infrastructure, ensuring it is secure, efficient, and compliant. They will also lead a team of engineers, collaborate with cross-functional teams, and drive the strategic direction of the data architecture to empower business insights and decision-making.The role involves:

• Leading and mentoring a team of data engineers.
• Overseeing the design, implementation, and optimization of data pipelines and ETL processes.
• Designing and architecting large-scale data systems that leverage ADF, Databricks and OneLake.
• Implementing monitoring and alerting systems to ensure data pipeline reliability and health.
• Overseeing the delivery of data engineering projects on time and within scope.
• Implementing and enforcing data governance frameworks.

Requirements:

• 3-5 years related experience in data engineering with bachelor’s degree; or a master’s degree with 3 years’ experience.
• Ability to architect simple and complex solutions related to integration with other applications and design.
• Excellent communication skills, both verbal and written.
• Strong presentation skills.
• Experience working under tight deadlines while maintaining high product relevance and quality.
• Azure/SQL focus.
• Strong understanding of data lake and Lakehouse architecture principles, data modeling techniques, and data warehousing concepts.
• 3-5 years’ experience using Azure Data Factory pipelines and Databricks.
• 5 years’ experience working with Azure databases.
• Extensive experience with MS SQL stack. (SSIS and ADF)
• Extensive experience with Azure - Cloud migration.
• Python experience.

The role offers: