Sr. Data Engineer (@Remote, Chile) at OfferUp

OfferUp is seeking a Senior Data Engineer to contribute to the building, operation, and scaling of its batch and near real-time data processing platforms. This role involves developing data-driven capabilities across the organization, supporting user experience, backend engineers, business intelligence, data analysts, and data scientists.

The Senior Data Engineer will be a technical lead, owning the architecture of data solutions and the data platform. They will drive engineering best practices, set standards, mentor other engineers, and propose projects requiring cross-team collaboration.

Responsibilities:

• Being the technical lead on the team, owning the architecture of the data solutions, and the data platform.
• Leading the team by example, mentor other engineers and help them with their growth.
• Driving engineering best practices, set standards and propose larger projects which may require cross-team collaboration.
• Designing and developing applications to process large amounts of critical information in batch and near real-time to power user-facing features.
• Influencing technical direction for the company, leveraging your prior experiences and helping evaluate emerging technologies and approaches.
• Helping bring engineering maturity to a growing team that is at the center of a lot of critical initiatives for the company

Requirements:

• 5+ years of professional software development experience
• Strong ability in distributed systems for processing large-scale data processing
• Ability to communicate technical information effectively to technical and non-technical audiences
• Proficiency in SQL and Python
• Experience leveraging open source data infrastructure projects, such as Apache Spark, Airflow, Kafka, Flink, Samza, Avro, Parquet, Hadoop, Hive, HBase, Phoenix, Presto or Druid
• Experience building scalable data pipelines and real-time data streams
• Experience building software in AWS or a similar cloud environment
• Experience with AWS services like Kinesis, Firehose, Lambda, Sagemaker is a big plus
• Experience with GCP services like BigQuery, Cloud Functions is a big plus
• Experience with MLOPS platform like Databricks, VertexAI, Sagemaker is a big plus
• Computer Science or Engineering degree required, Masters degree preferred
• Excellent communication skills, both written and spoken (fluency in English required)