Job Description
Lotlinx is seeking a Senior Data Engineer to contribute to the development and deployment of cloud-first ETL processes within the automotive digital advertising industry. The ideal candidate will thrive in a fast-paced, collaborative environment and leverage data to enhance and optimize data aggregation processes.Role Involves:
- Designing, building, and maintaining robust, scalable data pipelines.
- Developing and managing ETL/ELT workflows.
- Architecting and implementing cloud-based solutions (AWS, GCP).
- Collaborating with stakeholders to address data-related technical issues.
- Partnering with DevOps and Security teams for data governance and security.
- Engineering solutions for large data storage and management.
- Identifying and resolving performance bottlenecks.
- Exploring technologies to improve data quality and workflow reliability.
- Acting as an internal expert on data sources and data quality.
Requirements:
- 5+ years of experience in data engineering.
- Expertise with cloud platforms (AWS and/or GCP).
- Proficiency in SQL and data modeling techniques.
- Strong programming skills in Python, Scala, or Java.
- Experience with Data Engineering tools such as Airflow, Dataflow, DBT.
- Experience with big data frameworks like Apache Spark, Hadoop, or Beam.
- Hands-on experience with real-time data streaming platforms.
- Knowledge of CI/CD pipelines and containerization technologies.
- Experience managing data warehouses and lakes.
- Familiarity with data governance frameworks and security best practices.
- Ability to solve complex technical challenges.
Role Offers:
- Competitive compensation and benefits.
- Flex time off.
- Career development opportunities.