Browse All Jobs

Staff Software Engineer - Distributed Data Systems

Staff Software Engineer for Distributed Data Systems at Adyen.
Adyen
On-Site
Netherlands
Undisclosed salary
Job Description
Adyen is seeking a Staff Software Engineer to join their Distributed Data Systems team. Adyen is a financial technology platform that provides payments, data, and financial products in a single solution for global customers. The ideal candidate will have deep knowledge in distributed systems and will be responsible for improving the operations and scalability of existing offerings, as well as introducing and maturing new ones. This role will initially focus on scaling and tuning Adyen's Hadoop and Spark infrastructure, in addition to iterating on their OLAP platform using Apache Druid.

The role involves:
  • Designing, building, and optimizing data clusters for scalability and fault tolerance.
  • Improving the Spark, Hadoop, Kubernetes, Deltalake, and Druid ecosystems.
  • Contributing code upstream to open-source projects.
  • Educating and growing Adyen’s internal knowledge in distributed systems.

Requirements:
  • Experience scaling and tuning large deployments of Spark-on-k8s and Spark-on-Hadoop.
  • Experience with Hadoop and the HDFS protocol.
  • Experience designing and tuning shuffle heavy systems.
  • Experience with one of the lakehouse file formats (Delta, Iceberg, Hudi).
  • Experience with OLAP technologies (Clickhouse, Apache Druid, Apache Pinot, or Apache Doris).
  • Open-source contributions in relevant technologies.
  • Strong communication and teamwork skills.
  • Ability to troubleshoot and resolve issues in large-scale production environments.

Adyen offers:
  • A role based out of their Amsterdam office.
  • An environment with opportunities for people to succeed.
Apply Manually

Adyen

Adyen is a financial technology platform that provides payment, data, and financial products through a single solution. Serving global enterprises, Adyen delivers innovative and ethical solutions, enabling businesses to achieve their ambitions faster. The company fosters a culture that empowers employees to own their careers and tackle complex technical challenges collaboratively, supported by opportunities for growth and success. Adyen is committed to diversity, equity, and inclusion.

All Jobs at Adyen (220)