The company is seeking an AI Tester to identify business risks and assess the quality of applications built on Large Language Models. This role involves close collaboration with data scientists, engineers, and business stakeholders to design and execute test strategies that address functional and non-functional requirements. The AI Tester's expertise will be crucial in ensuring the application's performance, risk mitigation, and alignment with regulatory and ethical standards. Responsibilities:
Develop comprehensive test plans and strategies.
Test the accuracy, consistency, and reliability of LLM outputs.
Assess the model for biases and unfair treatment.
Measure response times, throughput, and scalability.
Identify vulnerabilities and ensure security standards.
Develop and maintain automated test suites.
Document issues and collaborate with developers for resolution.
Requirements:
Bachelor’s degree in Computer Science, Engineering, or related field.
3+ years of experience in software testing, including 1+ year in AI/ML testing.
Familiarity with Large Language Models, NLP, and AI frameworks.
Strong understanding of testing methodologies for AI systems.
Programming skills in Python, JavaScript, or another relevant language.
Excellent analytical and problem-solving skills.
Experience working in agile development environments.
The Role Offers:
Opportunities for professional growth and upskilling in cutting-edge technologies.