Data Engineer

Job Description

Prolific is seeking a Data Engineer to join their team. The Data Engineer will be responsible for building and optimizing scalable data pipelines to ensure teams have access to high-quality, reliable data. The role involves close collaboration with data scientists, analysts, and engineers to enhance data workflows and drive impactful insights across the business.

Responsibilities:

• Build and maintain robust data pipelines from internal databases and SaaS applications.
• Maintain the data warehouse with high-quality, well-structured data.
• Design and implement scalable data infrastructure.
• Create and maintain APIs and microservices that expose data to applications.
• Establish processes and tools to monitor data quality.
• Create and maintain comprehensive documentation of data flows, models, and systems.
• Collaborate with analytics, research, and product teams.
• Implement and advocate for data engineering best practices.
• Plan and execute system expansion as needed.
• Continuously optimize data pipelines and warehouse performance.
• Ensure all data systems adhere to security best practices and compliance requirements.

Requirements:

• 2+ years of hands-on experience deploying production quality code with proficiency in Python.
• Deep understanding of SQL and analytical data warehouses (Snowflake, Redshift preferred).
• Experience with data pipeline tools (Airflow, dbt).
• Ability to design and develop robust data APIs and services.
• Strong data modeling skills and familiarity with the Kimball methodology.
• Commitment to continuously improving product quality, security, and performance.
• Meticulous approach to creating and maintaining architecture and systems documentation.
• Ability to work across teams to understand and address diverse data needs.
• Desire to continually keep up with advancements in data engineering practices and technologies.
• Exceptional analytical skills to troubleshoot complex data issues.
• Capability to ship medium features independently.

Prolific offers:

• Competitive salary
• Benefits
• Remote working
• Impactful, mission-driven culture