Job Description
Flow Traders is seeking a Core Data Engineer to manage the lifecycle of fundamental data products. This role involves ensuring high-quality, timely data delivery to drive the company's strategic growth initiatives. The Core Data Engineer will be responsible for the architecture and maintenance of valuable data, impacting various divisions within the firm.
Role involves:
- Delivering timely and high-quality core data products.
- Developing and owning the end-to-end lifecycle of data products.
- Defining and managing project plans.
- Creating and refining a common data model.
- Investigating and maximizing value from available data sources.
- Exploring, evaluating, and onboarding additional data sources.
Requirements:
- Excellent programming skills (any language, Python preferred).
- Proficiency with Linux, SQL, relational databases, and version control systems.
- Demonstrated ability to work with large datasets and familiarity with big data solutions.
- Experience with Airflow, Kafka, and GCP (esp. GKE, Dataproc, and Big Query) highly desired.
- Experience with Pandas, Spark, Apache Beam, Apache NiFi a plus.
- Strong interpersonal skills.
- Organized and able to manage and execute projects.
Role offers:
- Opportunity to impact Flow Traders' strategic growth initiatives.
- Annual discretionary variable remuneration.