Staff Software Engineer, Data Backend - Tokyo, Japan at Appier

Appier is looking for a Staff Software Engineer to join their data engineering team in Tokyo. The ideal candidate will have extensive experience in large-scale data systems and be able to own, design, and develop offline and online computing systems.

The Staff Software Engineer will work with data engineers, data scientists, ML engineers, and software engineers to understand their requirements, build solutions, and enforce best practices. They will also innovate how ETLs, online, and offline compute should work, and set high standards for the team.

Responsibilities:

• Own, lead and set the vision for one or more large scale offline and online compute systems
• Work with data engineers, data scientists, ML engineers and software engineers from other orgs to understand their requirements, build solutions and enforce best practices
• Innovate how ETLs, online, and offline compute should work. Set high standards, mentor and coach other engineers on the team

Requirements:

• 9+ years of experience working with open source systems like Hive, Spark, Presto etc.
• 7+ years of experience building and developing large-scale infrastructure, distributed systems or networks, and/or experience with compute technologies
• Expertise in configuring, optimizing and debugging large scale compute clusters
• Possess a strong understanding of the latest data technologies and has the ability to bring in cross-industry partnerships and knowledge into the team
• Strong proficiency in working with Kubernetes and container technologies (e.g. Docker, cri-o, etc)
• Excellent communication skills and ability to collaborate with teams across various orgs
• Experience working with kubernetes and container technologies (e.g. Docker, cri-o, etc)
• Familiar with a cloud-based environments such as AWS/GCP/Azure