Senior Data Engineer

Job Description

Zeals, a fast-growing tech company in Japan, is seeking a Senior Data Engineer to join their data engineering team. The ideal candidate will be responsible for designing, building, and maintaining data pipelines and infrastructure, transforming raw data into structured formats to support advanced analytics and reporting. This role ensures the smooth ingestion, transformation, and organization of data in the data lakehouse for data analysts to create actionable dashboards and reports.

Responsibilities include:

• Designing, developing, and optimizing data pipelines to ingest data into the data lakehouse.
• Implementing and managing ETL processes using Google Cloud Composer, Dataproc, and dbt.
• Developing data transformations within a medallion architecture (bronze, silver, gold layers).
• Collaborating with data analysts, data scientists, and business stakeholders to understand data requirements.
• Implementing data quality checks and monitoring.
• Monitoring and optimizing the performance of BigQuery datasets and queries.
• Documenting processes, designs, and architectural decisions.
• Designing and developing a read-optimized data warehouse layer.
• Troubleshooting daily reporting pipelines.
• Conducting code reviews and providing mentorship to junior engineers.

Requirements:

• 5+ years of experience in data engineering or related roles.
• Strong analytical skills with the ability to manipulate and interpret complex datasets.
• Proficiency in SQL and experience with databases such as MySQL and BigQuery.
• Experience in both Python and Scala is preferred.
• Knowledge of dbt is a must.
• Experience with data platforms like Airflow, Dataproc, Great Expectations.
• Excellent communication and interpersonal skills, with the ability to effectively collaborate with cross-functional teams.
• Demonstrated ability to work independently and manage multiple projects simultaneously.
• English proficiency is a must.
• Conversational Japanese is nice to have.

Zeals offers:

• Flexible working: Highly flexible, remote-first organization (in Japan), Interim work from overseas
• Visa support for the right candidates
• Holidays: 10 days of annual leave in the first year, weekends off, national holidays, summer and winter breaks, and 5 refreshment leave days per year
• Housing allowance (within 1.5KM away from office)
• Club activity allowance
• Team building allowance and Lunch allowance
• Zeals Bar (bi-monthly free flow beer party)