Search - Extract & Transform - Senior Software Engineer

Job Description

Elastic is seeking a Senior Software Engineer to join the Elasticsearch - Extract and Transformation team. The ideal candidate will be a versatile software engineer and communicator who can help push the product and team to new heights. This role involves working collaboratively in a distributed environment to deliver features for the Elastic Search solution, focusing on data ingestion and its adoption into GenAI use cases.

Responsibilities:

• Contributing to the development of large-scale extraction and transformation applications.
• Architecting, optimizing, and maintaining pipelines for processing and analyzing data in various formats (PDF, HTML, image).
• Collaborating with and mentoring international teammates in a remote-first environment.
• Reviewing work and providing constructive feedback.
• Collaborating on features and breaking them down into technical deliverables.
• Integrating AI-driven solutions with data scientists and product teams.

Requirements:

• Experience building software using Ruby and/or Python.
• Experience building and maintaining ETL pipelines and processes.
• Experience with operational components of modern web applications (asynchronous job queues, daemonized services, CI/CD).
• Experience with open source.
• Measured and articulated written and spoken communication skills.
• Interest in learning new tools, languages, workflows, and philosophies.
• Experience with multi-modal data formats (PDF, HTML, Word docs).
• Knowledge of tooling and transformer architecture around LLMs.
• Knowledge of authentication and authorization, especially OAuth flows (a plus).

Benefits Offered:

• Competitive pay.
• Health coverage for you and your family in many locations.
• Flexible locations and schedules for many roles.
• Generous vacation days.
• Matching for financial donations and service.
• Paid time to use toward volunteer projects.
• Parental leave.