Job Description
Glean is seeking a Senior/Staff Applied Scientist to join its Data Organization in Palo Alto. The Applied Scientist will contribute to improving Glean's document indexing, retrieval, and ranking infrastructure, which powers its search and LLM-powered products. This role involves collaboration with product data science and engineering teams to enhance online A/B experimentation and generative AI evaluation.
Role Involves: - Defining KPIs and building visualizations to measure the efficacy of Glean’s document indexing, retrieval, and ranking infrastructure.
- Conducting empirical analyses to identify and prototype ways to improve ranking.
- Collaborating with product data science and engineering teams to improve online A/B experimentation.
- Developing and maintaining the A/B experimentation platform.
- End-to-end evaluation of various hero use cases like document/URL uploads.
- Designing, developing, and owning best practices, tools, and processes across various evaluation problems.
Requirements: - Masters/PhD degree in Statistics, Mathematics, Computer Science, or a quantitative field.
- 5+ years of experience as a Masters degree holder, 3+ as a PhD degree holders
- Strong skills in statistics and/or machine learning.
- Proficiency in Python and SQL.
- Experience with the modern data stack (e.g., source-controlled dbt pipelines for ETL/ELT).
- Strong ability to define product KPIs/guardrail metrics and analyze raw data.
- Experience in B2B SaaS is a plus.
- Experience working on ranking, developing and maintaining A/B experimentation platforms and/or ML measurement problems is a plus.
Glean Offers: - Competitive compensation
- Medical, Vision and Dental coverage
- Flexible work environment and time-off policy
- 401k
- Company events
- Home office improvement stipend
- Annual education stipend
- Wellness stipend
- Healthy lunches and dinners provided daily