Job Description
Nearform is seeking a Senior Data Engineer to join their team. This is a permanent, full-time remote opportunity for candidates based in Ireland. The Senior Data Engineer will be responsible for designing, building, and maintaining scalable data platforms, pipelines, and warehouses using SQL, Python, Spark, and other relevant technologies. The role involves building efficient data solutions, optimizing performance, and ensuring seamless data integration.
Responsibilities include:
- Designing, building, and optimizing data pipelines and ETL processes.
- Developing and maintaining data platforms and warehousing solutions.
- Implementing scalable data storage solutions.
- Enhancing performance in data processing workflows.
- Collaborating with data scientists, analysts, and stakeholders.
- Ensuring data quality, governance, and compliance.
- Supporting CI/CD processes for data pipeline deployments.
- Conducting code reviews and enforcing best practices.
- Assisting with defining structured source code management and deployment processes.
- Working with and supporting Technical Leaders in project execution.
- Collaborating with client teams.
Requirements include:
- Significant experience delivering at a Senior Engineer level, specializing in Data engineering (6+ years).
- Practical experience delivering in an agile environment.
- Practical experience and knowledge of developing real-world solutions.
- Extensive hands-on experience in Databricks, SQL, Python, and Spark.
- Strong expertise in data warehousing technologies (e.g., Snowflake, Redshift, BigQuery).
- Experience with distributed data processing frameworks (Spark, Hadoop).
- Deep understanding of ETL processes, data modeling, and schema design.
- Strong experience with cloud-based data solutions (AWS, Azure, GCP) and data lake architectures.
- Experience with automation, CI/CD for data pipelines, and Infrastructure as Code (IaC).
- Deep understanding of versioning control tools - e.g. Git.
- Experience building software collaboratively using pull requests and code reviews.
- Familiarity with data governance, security, and compliance best practices.
- Excellent communication and collaboration skills.
- Professional proficiency in English.
Nearform offers:
- Annual Company Bonus
- Remote and Flexible Work
- Paid Time Off Package (24 days + public holidays)
- Remote Working Allowance (€1250 every 2 years)
- Training and Development Allowance (€1000)
- Healthcare
- Pension & Insurances