Senior Data Engineer

Job Description

Topsort is seeking a Senior Data Engineer to join their rapidly growing team. The ideal candidate will be responsible for designing, building, and maintaining scalable data infrastructure and pipelines. This role involves collaborating with cross-functional teams to ensure the availability, reliability, and efficiency of data systems, enabling data-driven decision-making across the organization. Topsort believes in straightforward communication, embracing feedback, and fostering a collaborative environment.Role involves:

• Designing, developing, and maintaining robust ETL/ELT pipelines.
• Optimizing data architecture and storage solutions.
• Working with cloud platforms (AWS) to implement scalable data solutions.
• Ensuring data quality, integrity, and security.
• Collaborating with data scientists, analysts, and software engineers.
• Monitoring and troubleshooting data workflows.
• Creating APIs to provide analytical information to clients.

Requirements:

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
• 5+ years of experience in data engineering or a related field.
• Strong proficiency in SQL and database technologies (e.g., PostgreSQL, MySQL, Snowflake, BigQuery).
• Experience with data pipeline orchestration tools (e.g., Apache Airflow, Prefect, Dagster).
• Proficiency in programming languages such as Python and Scala.
• Hands-on experience with AWS cloud data services.
• Familiarity with big data processing frameworks like Apache Spark.
• Knowledge of data modeling, warehousing concepts, and distributed computing.
• Experience implementing CI/CD for data pipelines.
• Real-time data processing and streaming architectures (RisingWave, Kafka, Flink).
• Database performance tuning and query optimization.
• Strong problem-solving skills and the ability to work independently and collaboratively.

Topsort offers:

• Direct Feedback and Rapid Growth
• Be part of an elite and collaborative sports team
• Intellectual Rigor and Individuality
• Company Offsite and Industry Exposure
• Working Equipment and Hubs
• Flexible PTO schedule with floating holidays
• Meditation App, Birthday and Anniversary Celebrations