BJSS is seeking a Senior Data Engineer to join their team in Porto. BJSS is an award-winning innovative tech consultancy that helps clients solve complex technology problems. The company has a collaborative and open culture. They are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions.He/she will be responsible for building, optimizing, and maintaining data applications, systems, and services. He/she will work in a fast-moving, agile environment within multi-disciplinary teams, delivering modern data platforms. The role will involve working with cloud data services such as Databricks, Data Factory, Synapse, Kafka, Redshift, Glue, Athena, and BigQuery.
Role involves: - Building, optimizing, and maintaining data applications, systems, and services.
- Deploying data pipelines and processes in a production-safe manner.
- Working with the latest technologies and within a DataOps culture.
- Collaborating in multi-disciplinary teams to deliver modern data platforms.
Requirements: - Experience in writing well tested object-oriented python.
- Experience with using CI/CD tooling to analyse, build, test and deploy your code.
- Good understanding of design choices for data storage and data processing, with a particular focus on cloud data services.
- Experience in using parallel computing to process large datasets and to optimise computationally intensive tasks.
- Experience in programmatically deploying, scheduling and monitoring components in a workflow.
- Experience in writing complex queries against relational and non-relational data stores.
Offer: - Coverflex Flexible Benefit allowance.
- 22 days holiday per year, plus National Bank Holidays.
- Industry-leading referral scheme.
- Hybrid working with flexibility.
- Training opportunities and incentives, including unlimited access to O’Reilly.
- Participation in BJSS Clubs and various group activities.