Data Engineer

Job Description

OKX is seeking a Data Engineer to join their data team. The ideal candidate will be responsible for designing and building resilient data pipelines, architecting data infrastructure on the cloud, and collaborating with various teams to build scalable data-driven platforms. They will ensure data integrity and scalability, improve data validation processes, and drive issue resolution.

Responsibilities:

• Design and build resilient and efficient data pipelines for both batch and real-time streaming data
• Architect and design data infrastructure on cloud using industry standard tools
• Execute projects with an Agile mindset
• Build software frameworks to solve data problems at scale
• Collaborate with product managers, software engineers, data analysts and data scientists to build scalable and data-driven platforms and tools
• Ensure data integrity and scalability through enforcement of data standards.
• Improve data validation and monitoring processes to proactively prevent issues and quickly identify issues.
• Drive resolution on the issues.
• Define, understand, and test external/internal opportunities to improve our products and services.

Requirements:

• Bachelor’s Degree in Computer Science or have equivalent professional experience
• Solid Experience with data processing tools such as Spark, Flink
• Solid Experience implementing batch and streaming data pipelines
• Solid experiences in Python/Go/Scala/Java.
• In-depth knowledge of both SQL and NoSQL databases, including performance tuning and troubleshooting
• Familiar with DevOps tools such as Git, Docker, k8s
• Experience with the cloud (e.g. AWS, Ali Cloud, GCP, Azure)
• Be proficient in SQL, familiar with advanced SQL features such as window functions, aggregate functions and creating scalar functions/user-defined functions.
• Proven successful and trackable experience in full end-to-end data solutions involving data ingestion, data persistence, data extraction and data analysis.
• Self-driven, innovative, collaborative, with good communication and presentation skills
• Fluent in English, both written and spoken.

OKX offers:

• Opportunity to work with cutting-edge data technologies
• Collaborative and innovative work environment