Big Data Cloud Engineer

Job Description

IPG is seeking a Big Data Cloud Engineer to join its Data Platform and Infrastructure Engineering (DPIE) Team. The ideal candidate will be responsible for building, deploying, and operating large-scale Big Data solutions across Public Cloud environments. The candidate should possess technical, programming, and engineering skills to architect, automate, and optimize Big Data solutions using Databricks, Snowflake, Apache Spark, and/or Amazon EMR.

Responsibilities:

• Build, manage, maintain, and optimize Big Data deployments in Public Cloud environments using Databricks, Snowflake, and Amazon EMR.
• Deploy and maintain Big Data solutions and Public Cloud resources using Infrastructure as Code tools (e.g., Terraform) on Amazon AWS, Microsoft Azure, and Google GCP.
• Provide data engineering support and services, including Databricks workflows, delta sharing, and notebooks.
• Automate repetitive tasks through hands-on programming with Perl, Bash, and/or Python.
• Optimize query performance and tuning for jobs running on Spark, Impala, and Hive.
• Deliver operational and on-call support, ensuring maximum service availability through monitoring, troubleshooting, and issue resolution.

Requirements:

• 4+ years of experience in deploying and managing Big Data workloads in Public Cloud environments using Databricks, Snowflake, and Amazon EMR.
• At least 3 years of experience in building and maintaining Public Cloud resources using Ansible and Terraform.
• 3+ years of hands-on scripting expertise in Spark, Perl, Python, or Bash Shell.
• 2+ years of experience in software and code management utilizing Git.
• Bachelor’s degree in a related field or equivalent experience.

The role offers:

• Healthcare Options (Medical, Dental, Vision, Prescription)
• Dependent and Health Care Flexible Spending Accounts
• 401(k) savings plan with company match
• Flexible based Paid Time Off
• Employee Assistance Program
• Legal Assistance Plan
• Tuition Reimbursement
• Employee Stock Purchase Plan
• Exclusive discounts on cell phones, gyms, and everyday purchases