AI SDET

A company is looking for a SDET - AI to develop and implement quality assurance strategies for AI-powered applications.

Key Responsibilities

Develop and implement QA strategies focusing on accuracy, bias, fairness, robustness, and performance of AI applications

Design and execute automated and manual test cases for AI models, APIs, and data pipelines

Conduct scalability, latency, and performance testing for AI-driven applications while collaborating with data engineers

Required Qualifications

Proven expertise in testing AI models, LLMs, and Generative AI applications

Strong proficiency in Python for writing test scripts and automating model validation

Demonstrated SQL expertise for validating data integrity and backend processes

Experience with AI evaluation metrics and testing tools like Arize, MAIHEM, and LangTest

Strong analytical skills and experience in AI bias detection and adversarial testing