Data Engineer II (@Remote, Chile)

Job Description

OfferUp is seeking an experienced Data Engineer to contribute to the development, operation, and scaling of its batch and near real-time data processing platforms and tools. This role is crucial for enhancing data-driven capabilities across the organization. The ideal candidate will build systems that improve end-user experience and support backend engineers, business intelligence, data analysts, and data scientists.OfferUp faces unique data challenges due to its large and responsive mobile marketplace, requiring the use of the latest data infrastructure developments. The company leverages open-source infrastructure and is prepared to build and share solutions when necessary.Responsibilities:

• Design and develop applications to process large amounts of critical information.
• Monitor and resolve data pipeline or data integrity issues.
• Collaborate with multiple teams to understand their data needs.
• Maintain and expand the data infrastructure.

Requirements:

• 3+ years of professional software development experience.
• Strong ability in distributed systems for large-scale data processing.
• Proficiency in SQL and Python.
• Experience with open-source data infrastructure projects (e.g., Airflow, Kafka, Avro, Parquet, Hadoop, Hive, HBase, Presto, or Druid).
• Experience building scalable data pipelines and real-time data streams.
• Experience building software in AWS or a similar cloud environment.
• Computer Science or Engineering degree required, Masters degree preferred.
• Excellent communication skills in English.

OfferUp offers:

• Opportunity to work on systems that drive end-user experience.
• Chance to support backend engineers, business intelligence, data analysts and data scientists.
• Opportunity to work with open-source infrastructure.