Browse All Jobs

Data Engineer

Data Engineer role managing data infrastructure for trading in India.
IMC
On-Site
India
Undisclosed salary
Job Description
IMC is seeking a Data Engineer to join its Data team in Mumbai, India. This role is responsible for managing and monitoring distributed systems, storage infrastructure, and data processing platforms, ensuring the safe receipt and storage of trading-related data for the India teams. The Data Engineer will collaborate with systems and network engineers, traders, and developers to support and troubleshoot their queries. They will also stay updated with the latest technology trends and implement innovative solutions.
Role involves:
  • Managing and monitoring distributed systems, storage infrastructure, and data processing platforms (HDFS, Kubernetes, Dremio).
  • Driving systems automation and CI/CD for rapid deployment of hardware and software solutions.
  • Collaborating with systems and network engineers, traders, and developers.
  • Troubleshooting queries.
  • Staying up to date with technology trends and implementing innovative solutions.
Requirements:
  • 5–7 years of experience in managing large-scale multi-petabyte data infrastructure.
  • Advanced knowledge of Linux system administration and internals.
  • Deep expertise in at least one of Kafka, Spark, Cassandra/Scylla, or HDFS.
  • Strong working knowledge of Docker, Kubernetes, and Helm.
  • Experience with data access technologies such as Dremio and Presto.
  • Familiarity with workflow orchestration tools like Airflow and Prefect.
  • Exposure to cloud platforms such as AWS, GCP, or Azure.
  • Proficiency with CI/CD pipelines and version control systems like Git.
  • Understanding of best practices in data security and compliance.
Role offers:
  • Opportunity to work in a dynamic and high-impact Data team.
  • Exposure to a cutting-edge research environment and world-class technology backbone.
  • A collaborative, high-performance culture.
Apply Manually

IMC

IMC is a global trading firm that operates in the financial markets since 1989. The company leverages advanced research and technology to provide liquidity and stability across various markets. With offices in the US, Europe, Asia Pacific, and India, IMC fosters a collaborative culture among its research, engineering, trading, and business operations teams. IMC is committed to innovation, continuous improvement, and actively engages with regulatory bodies across multiple jurisdictions to ensure adherence to evolving industry standards and compliance requirements.

All Jobs at IMC (123)