Job Description
Oportun is seeking a Senior Data Engineer to join their team. The Senior Data Engineer will be responsible for designing, developing, and maintaining sophisticated software and data platforms. This role involves leading technology efforts from technical requirements gathering to successful product delivery for large initiatives. The Senior Data Engineer will also contribute to architectural decisions, mentor junior engineers, and collaborate with cross-functional teams to deliver high-quality, scalable software solutions.
Responsibilities:
- Lead the design and implementation of scalable, efficient, and robust data architectures.
- Design and develop data pipelines, ETL processes, and data integration solutions.
- Oversee the management and maintenance of databases, data warehouses, and data lakes.
- Establish and enforce data quality standards and governance practices.
- Provide technical leadership and mentorship to junior team members.
- Collaborate with cross-functional teams to understand data needs and deliver solutions.
- Implement monitoring systems to track data pipeline performance and optimize for efficiency.
Requirements:
- Bachelor's or Master's degree in Computer Science, Data Science, or a related field.
- 5+ years of experience in data engineering, with a focus on data architecture, ETL, and database management.
- Proficiency in programming languages like Python/PySpark and Java or Scala.
- Expertise in big data technologies such as Hadoop, Spark, Kafka, etc.
- In-depth knowledge of SQL and experience with various database technologies.
- Experience and expertise in building complex end-to-end data pipelines.
- Experience with orchestration and designing job schedules using CICD tools like Jenkins, Airflow or Databricks.
- Ability to work in an Agile environment.
- Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and their data services.
- Strong leadership, problem-solving, and decision-making skills.
- Excellent communication and collaboration abilities.
Oportun offers:
- Opportunity to work on large initiatives and lead technology efforts.
- A diverse, equitable, and inclusive culture.
- Mentorship opportunities.