A software company in Hyderabad is seeking a Data Engineer to help scale digital businesses in global utility retail markets. The Data Engineer will play a crucial role in ensuring the timely delivery of high-quality data solutions within budget constraints.
Responsibilities:
Design, develop, and deploy robust and scalable data pipelines using Python.
Utilize a deep understanding of AWS services (e.g., S3, Glue, Lambda, Athena, DMS, RDS, Bedrock) to design and manage cloud-based data platforms.
Implement and optimize data integration processes from various sources into data lakes and data warehouses on AWS.
Development and implementation of robust security within the data lifecycle on AWS.
Proactively identify data challenges and propose innovative solutions to address them.
Troubleshoot complex data issues and provide resolutions to ensure project success in a timely manner.
Requirements:
5+ years of experience in data engineering, data pipelines, and cloud-based data solutions on AWS.
Proven programming ability in SQL, Python and database knowledge.
Extensive experience in AWS data services such as S3, Athena, Glue, Lambda, DMS, RDS, Bedrock etc.
Experience in data modeling and ETL processes.
Strong expertise in data pipeline development and optimization on AWS.
Working knowledge of data warehousing solutions on AWS.
Working knowledge of Linux Ubuntu environment is a plus.
Familiarity with data testing frameworks.
Experience with data visualization and BI tools is a plus.
Experience working in an agile development model.
Excellent written and verbal communication skills.