Data Engineer

Job Description

Interactive Brokers, a global financial services company headquartered in Greenwich, CT, is seeking a Data Engineer to join their Realtime Order Analytics and Reporting team. This is a hybrid role, requiring 3 days in the office and 2 days remote.He will be responsible for transforming on-premises Kafka streams into actionable business insights and regulatory compliance reports through AWS cloud services. The ideal candidate will design robust ETL processes and build automated, scalable data solutions aligned with a zero-maintenance vision.What this role involves:

• Designing, developing, and maintaining ETL workflows using AWS services
• Processing data from Kafka streams and S3 storage to generate insights
• Implementing data transformation logic using Python, PySpark, and PyAthena
• Creating and optimizing data models for both analytical and regulatory reporting needs
• Building automated data quality checks and monitoring systems
• Developing and maintaining documentation for data pipelines and processes
• Troubleshooting and resolving data pipeline issues
• Contributing to architectural decisions for data infrastructure
• Ensuring data solutions meet performance, security, and compliance requirements
• Continuously improving our data systems for scalability and reduced maintenance

Requirements:

• Bachelor's or master's degree in Computer Science or a related field
• 3+ years of professional software engineering experience in Python, PySpark and PyAthena
• 3+ years of professional experience in Python as a primary language (non-scripting)
• Extensive experience in Pandas or NumPy
• Experience with ETL processes and data warehousing concepts
• Familiarity with cloud technologies, particularly AWS (S3, Glue, Athena, EMR)
• Experience using ELK Stack (Elasticsearch, Logstash, Kibana)
• Thorough understanding of databases and SQL
• 1+ years of professional experience with Linux operating systems
• An analytical mind and business acumen
• Strong communication skills

What this role offers:

• Competitive salary, annual performance-based bonus and stock grant
• Retirement plan 401(k) with competitive company match
• Excellent health and wellness benefits, including medical, dental, and vision benefits, and a company-paid medical healthcare premium
• Paid time off and a generous parental leave policy
• Daily company lunch allowance provided, and a fully stocked kitchen with healthy options for breakfast and snacks
• Education reimbursement and learning opportunities