Job Description
XP Inc., a major independent financial institution in Brazil, is seeking a Senior Data Engineer to join their Compliance area. This role is crucial for ensuring regulatory demands are met. The Senior Data Engineer will be responsible for building and supporting analyses, pipelines, jobs, and queries using PySpark on the DataBricks platform. They will also conduct script analysis and maintenance, support the creation of analytical materials, and assist in the technical development of team members. The role involves designing and implementing data projects, participating in stakeholder meetings, and aligning expectations.
Responsibilities:
- Build and support analyses, pipelines, Jobs and queries using the pyspark on the platform DataBricks
- Perform analyses and maintenance on query scripts
- Support the creation and development of analytical materials and presentations
- Support the technical development of other team members
- Design, conduct and implement data and etl projects
- Participate in and conduct meetings with stakeholders to align expectations and communicate results
Requirements:
- 2+ years of experience as a Senior Data Engineer
- Practical experience on the Databricks platform
- Advanced knowledge in Pyspark
- Knowledge in Adf
- Knowledge in Control-M
- Experience with Microsoft Azure cloud
- Practical knowledge in Python and SQL Server
- Excellent communication skills
- Organizational skills and a sense of urgency
- Reside in São Paulo (Hybrid 3x per week initially)
What XP Inc. Offers:
- Health and well-being benefits (health plan, dental plan, Wellhub, Zenklub, life insurance)
- iFood Benefits (flexible VA and VR)
- Vale Transporte
- New Value benefits club
- Parental leave (6 months maternity, 20 days paternity)
- Childcare assistance
- Exclusive Investment Funds
- Investment Advisory
- XP Visa Infinite card without annuity
- Credit options