Lead Data Pipeline Engineer

Job Description

Two Six Technologies is seeking a Lead Data Pipeline Engineer to contribute to the development and implementation of innovative products. In this role, the candidate will use their engineering skills and experience with machine learning (ML) and large language models (LLMs) to help policy makers, corporate leaders, and operators make sense of complex information spaces.Two Six Technologies uses these technologies to provide Information Advantage to Government, Military, and private sector customers tasked with mission critical decision making. The candidate will work with product engineering teams, data scientists, DevOps, and architects to integrate data science into products.Responsibilities:

• Developing and enhancing high-volume data pipelines where data is enriched using ML and NLP functionality.
• Integrating models that data science creates into applications that are fast and scalable.
• Building and enhancing user-facing applications that use generative AI and LLMs.
• Operating in a collaborative, agile environment.
• Creating proofs-of-concept and prototypes to quickly test ideas.
• Considering security best practices at every phase of software development.
• Continuously learning and improving.
• Working in a fully remote team.
• Independently identifying and solving problems.
• Actively participating in the peer code review process.
• Managing a small team of data pipeline engineers

Qualifications:

• Experience building scalable server-side applications and data pipelines using Python.
• Experience working with ML, LLMs, and collaborating closely with data science teams.
• Experience with Elastic or similar data stores, as well as with SQL database technologies, ideally Postgres.
• Experience with AWS or similar cloud-based infrastructure.
• Experience with the design, development, testing, and support of scalable, data-driven applications deployed to production SaaS environments.
• Experience working independently and as a part of an Agile team.

The role offers:

• Opportunity to work in a fully remote team.
• Chance to manage a small team of data pipeline engineers.
• Competitive and comprehensive compensation packages.
• Benefits including medical, dental, and vision insurance, life and disability insurance, retirement benefits, paid leave, tuition assistance, and professional development.