Lead Data Engineer(Snowflake/DBT)

Job Description

Tide is seeking a Lead Data Engineer to join their team in Bengaluru, India. The Lead Data Engineer will be responsible for building and running data pipelines and services to support business functions. This role involves working with BigQuery/Snowflake, Airflow, Stitch/Fivetran, dbt, Tableau/Looker, and AWS.

The Lead Data Engineer will work with data analysts and develop end-to-end ETL/ELT pipelines. The role also involves designing, developing, and implementing scalable, automated processes for data extraction, processing, and analysis in a Data Mesh architecture. This individual will mentor junior engineers, provide troubleshooting support, and identify ways to improve data pipeline delivery.

Responsibilities:

• Developing end to end ETL/ELT Pipeline working with Data Analysts of business Function
• Designing, developing, and implementing scalable, automated processes for data extraction, processing, and analysis in a Data Mesh architecture
• Mentoring other Junior Engineers in the Team
• Troubleshooting and resolving technical issues as they arise
• Translating business requirements into technical requirements
• Owning the delivery of data models and reports end to end
• Performing exploratory data analysis to identify data quality issues
• Working with Data Analysts to ensure that all data feeds are optimised and available
• Discovering, transforming, testing, deploying and documenting data sources
• Applying, help defining, and championing data warehouse governance
• Building Looker Dashboard for use cases if required

Requirements:

• 4+ years of extensive development experience using snowflake or similar data warehouse technology
• Working experience with dbt and other technologies of the modern data stack, such as Snowflake, Apache Airflow, Fivetran, AWS, git, Looker
• Experience in agile processes, such as SCRUM
• Extensive experience in writing advanced SQL statements and performance tuning them
• Experience in Data Ingestion techniques using custom or SAAS tool like fivetran
• Experience in data modelling and can optimise existing/new data models
• Experience in data mining, data warehouse solutions, and ETL, and using databases in a business environment with large-scale, complex datasets
• Experience working in agile cross-functional delivery team
• High development standards, especially for code quality, code reviews, unit testing, continuous integration and deployment
• Strong technical documentation skills and the ability to be clear and precise with business users
• Business-level of English and good communication skills
• Basic understanding of various systems across the AWS platform

What Tide Offers:

• Make work, work for you! We are embracing new ways of working and support flexible working arrangements. With our Working Out of Office (WOO) policy our colleagues can work remotely from home or anywhere in their assigned Indian state. Additionally, you can work from a different country or Indian state for 90 days of the year.
• Competitive salary
• Self & Family Health Insurance
• Term & Life Insurance
• OPD Benefits
• Mental wellbeing through Plumm
• Learning & Development Budget
• WFH Setup allowance
• 15 days of Privilege leaves
• 12 days of Casual leaves
• 12 days of Sick leaves
• 3 paid days off for volunteering or L&D activities
• Stock Options