AI Software Engineer - Data Platform

Job Description

Perplexity is looking for an experienced AI Software Engineer to join their team and focus on building the next-generation AI Data Platform. This platform will revolutionize how people search and interact online. The engineer will help build Perplexity’s end-to-end AI data stack and flywheel, which powers all AI products, ML use cases, and language models.Role involves:

• Collaborating with AI Product, Applied ML, Post-Training, and Data Science teams.
• Designing, building, and maintaining scalable data pipelines and data lakes.
• Developing, deploying, and monitoring the entire data lifecycle for ingestion, transformation, streaming, and storage at high scale.
• Implementing tools and abstractions on top of data infrastructure for various use cases.
• Working closely with product and AI teams to develop reusable data resources and design patterns.

Requirements:

• Extensive programming and data engineering skills, with proficiency in open source & distributed data processing (AWS, Spark, Flink, Iceberg).
• Familiarity with cloud-based data services (e.g., AWS, RDS, DynamoDB), containerized infrastructure (e.g., EKS, Docker), and data streaming (Flink, Spark streaming, CDC).
• Strong quantitative and engineering skills with experience in estimating performance at high scale.
• Experience supporting various ML/AI engineering teams to build scalable platforms to accelerate R&D for frontier models and AI products.
• Self-motivated with a strong sense of ownership of systems and designs.
• 5+ years of industry experience in distributed systems or AI infrastructure.

Perplexity offers:

• Comprehensive health, dental, and vision insurance.
• 401(k) plan.
• Equity may be part of the total compensation package.