Senior Azure Data Engineer

Job Description

PALO IT is seeking a Senior Azure Data Engineer to contribute to the design, implementation, and maintenance of robust and scalable data pipelines. The ideal candidate will work on acquiring, storing, governing, and processing large datasets, both structured and unstructured. They will collaborate with experts in Data Intelligence, Research, UX Design, Digital Technology, and Agile teams to deliver impactful solutions to clients.

Responsibilities:

• Design, implement, and maintain robust and scalable data pipelines.
• Build and manage data warehouses and data lakes.
• Design data models to support business requirements and analytics.
• Leverage cloud platforms (Azure) to design and deploy scalable data infrastructure.
• Implement data quality checks and data governance frameworks.
• Monitor and optimize data pipelines and infrastructure.
• Collaborate with data scientists, analysts, and other stakeholders.
• Support business users by implementing data presentation layer.
• Stay up-to-date with emerging technologies in the big data and data engineering space.
• Support the definition and optimization of underlying data infrastructure.

Requirements:

• Bachelor's, Master's, or Ph.D. degree in IT, Information Management, or Computer Science.
• At least 6 years of experience.
• Good knowledge of the big data technology landscape.
• Experience with big data frameworks (e.g., Hadoop, Spark).
• Experience with batch & ETL jobs.
• Experience with NoSQL databases (e.g., Cassandra, MongoDB, Neo4J, ElasticSearch).
• Experience with querying tools (e.g Hive, Spark SQL, Impala).
• Experience with PowerBI.
• Experience or willingness to learn real-time stream processing.
• Experience or willingness to learn about DevOps and DataOps principles.
• High-level understanding of Data Science concepts and methodologies.

What PALO IT Offers:

• Stimulating working environments
• Unique career path
• International mobility
• Internal R&D projects
• Knowledge sharing
• Personalized training