Job Description
Lynx Analytics is seeking a Data Engineer to join a cross-functional project team. The Data Engineer will be responsible for automating and productizing advanced analytics pipelines, working with technologies like Generative AI and a proprietary big graph analysis framework. This role involves implementing and deploying data analysis pipelines for various clients.
Responsibilities:
- Understanding business problems and analytical solutions.
- Discovering client's existing data sources.
- Defining the technical architecture for analytical solutions.
- Implementing data ingestion subsystems.
- Implementing data analysis pipelines.
- Integrating results into business UIs.
Requirements:
- Python (pytest, pre-commit, venv, etc.)
- Airflow, dbt, or other orchestration tool
- Apache Spark, PostgreSQL, BigQuery, or other SQL/NoSQL engines
- Docker, Docker Compose, Terraform or other IaC tools
- Linux OS
- Experience with cloud platforms like GCP, AWS, or Azure
- Experience with CI/CD tools like GitHub Actions
- Experience with FastAPI or Flask for service endpoints
- Experience with Network setup (DNS, TLS, SSH, IP routes, etc.)
- Prior experience in Generative AI (ideally RAG) and data science / analytics.
Benefits:
- High ownership, zero micromanagement
- Rapid learning opportunities and diverse challenges
- Flexible work hours, remote-friendly setup
- A collaborative culture
- Flat organisational hierarchy