Senior Data Engineer at Technology & Product

Zeals, a fast-growing tech company in Japan, is seeking a Senior Data Engineer to join their data engineering team. The role involves designing, building, and maintaining data pipelines and infrastructure to support advanced analytics and reporting. The Senior Data Engineer will transform raw data into structured formats, ensuring smooth data ingestion, transformation, and organization within the data lakehouse.

Responsibilities include:

• Designing, developing, and optimizing data pipelines to ingest data into the data lakehouse.
• Implementing and managing ETL processes using Google Cloud Composer, Dataproc, and dbt.
• Developing data transformations within a medallion architecture (bronze, silver, gold layers).
• Collaborating with data analysts, data scientists, and business stakeholders to understand data requirements.
• Implementing data quality checks and monitoring.
• Monitoring and optimizing the performance of BigQuery datasets and queries.
• Documenting processes, designs, and architectural decisions.
• Designing and developing a read-optimized data warehouse layer.
• Troubleshooting daily reporting pipelines.
• Conducting code reviews and providing mentorship to junior engineers.

Requirements:

• 5+ years of experience in data engineering or related roles.
• Strong analytical skills with the ability to manipulate and interpret complex datasets.
• Proficiency in SQL and experience with databases such as MySQL and BigQuery.
• Experience in both Python and Scala is preferred.
• Knowledge of dbt is a must.
• Experience with data platforms like Airflow, Dataproc, Great Expectations.
• Excellent communication and interpersonal skills, with the ability to effectively collaborate with cross-functional teams.
• Demonstrated ability to work independently and manage multiple projects simultaneously.
• English proficiency is a must.
• Conversational Japanese is nice to have.

Zeals offers:

• Competitive salary
• Performance review twice a year
• 10 days paid holidays during the first year, weekends off, national holidays, summer and winter break and refreshment leaves.
• Visa support for the right candidates.
• Highly flexible, remote-first organization (in Japan), Interim work from overseas
• Housing allowance (within 1.5KM away from office)
• Club activity allowance
• Team building allowance and Lunch allowance
• Zeals Bar (bi-monthly free flow beer party)