Senior Big Data Engineer (Python, Scala, Spark) - Banking at Capco

Capco Poland is seeking a Senior Big Data Engineer to design, implement, and maintain scalable data pipelines and solutions for large-scale data processing and analytics projects. This role involves working with some of the largest banks in the world, contributing to the transformation of the financial services industry. The engineer will be part of a digital engineering team, developing new and enhancing existing financial and data solutions. They will participate in digital and data transformation processes through a continuous delivery model, automating and optimizing data engineering processes, and enhancing security standards on both cloud and on-premise deployments.

Role Involves:

• Developing end-to-end ETL processes with Spark/Scala.
• Using Scrum methodology as part of a high-performing team.
• Documenting solutions in tools like JIRA, Confluence, and ALM.
• Certifying deliveries and their integration with other components.

Requirements:

• 5+ years of experience with Python.
• 2+ years of experience with Spark and Scala.
• Knowledge of good coding practices, including clean code, software design patterns, and TDD.
• Agile approach for software development.
• Experience with data integration and management with high data volumes.
• Experience working in agile continuous integration/DevOps paradigm (Git, GitHub, Jenkins, Sonar, Nexus, Jira).
• Experience with different database structures, including Postgres, SQL, Hive.

Capco Offers:

• Employment contract and/or Business to Business opportunity.
• Remote work possibilities.
• Multiple employee benefits packages (MyBenefit Cafeteria, private medical care, life-insurance).
• Access to 3.000+ Business Courses Platform (Udemy).
• Access to necessary IT equipment.
• Paid Referral Program