Talent.com
AI QA/Testing Engineer
AI QA/Testing EngineerPozent Corporation • South Plainfield, NJ, US
AI QA / Testing Engineer

AI QA / Testing Engineer

Pozent Corporation • South Plainfield, NJ, US
job_description.job_card.variable_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

Skill Set – Model Validation, Bias / Fairness Testing, Automation

Role Overview

Ensure quality, fairness, and reliability of AI / ML models through comprehensive testing, validation, and automation. Focus on model performance, bias detection, and ethical AI practices.

Responsibilities

  • Design and execute test strategies for AI / ML models and systems
  • Perform model validation including accuracy, robustness, and performance testing
  • Conduct bias and fairness testing to identify and mitigate discriminatory outcomes
  • Develop automated testing frameworks for continuous model evaluation
  • Test data pipelines, feature engineering, and model inference systems
  • Create test cases for edge cases, adversarial inputs, and model behavior analysis
  • Monitor model drift and performance degradation in production
  • Collaborate with ML engineers and data scientists to ensure model quality standards

Requirements

  • Bachelor's degree in Computer Science, Engineering, Data Science, or related field
  • Strong experience in model validation and ML testing methodologies
  • Proven expertise in bias and fairness testing for AI systems
  • Hands-on experience with test automation frameworks and tools
  • Understanding of ML model evaluation metrics and statistical testing
  • Proficiency in Python and testing libraries (pytest, unittest)
  • Knowledge of AI ethics, responsible AI principles, and regulatory requirements
  • Experience with CI / CD pipelines and version control (Git)
  • Preferred

  • Experience testing various ML models (LLMs, computer vision, NLP, recommender systems)
  • Familiarity with fairness metrics (demographic parity, equalized odds, disparate impact)
  • Knowledge of adversarial testing and model robustness evaluation
  • Experience with A / B testing and experimental design
  • Understanding of data quality testing and validation
  • Familiarity with ML frameworks (PyTorch, TensorFlow, scikit-learn)
  • Experience with monitoring tools (MLflow, Weights & Biases, Evidently AI)
  • Knowledge of GDPR, AI Act, or other AI governance frameworks
  • J-18808-Ljbffr

    serp_jobs.job_alerts.create_a_job

    Ai Engineer • South Plainfield, NJ, US

    Job_description.internal_linking.related_jobs
    AI Engineer

    AI Engineer

    OneStream Software • New York, New York, United States
    serp_jobs.job_card.full_time
    Range applies to US candidates only) + Benefits / Variable Comp / Equity - Range may vary based on experience.Vision, Medical, Life, Dental, 401K. This role requires the candidate to work from one of th...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    AI Engineer

    AI Engineer

    LifeMD • New York, NY, US
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    LifeMD is a leading digital healthcare company committed to expanding access to virtual care, pharmacy services, and diagnostics by making them more affordable and convenient for all.Focused on bot...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30
    GENERATIVE AI ARCHITECT

    GENERATIVE AI ARCHITECT

    The Dignify Solutions, LLC • Raritan, NJ, US
    serp_jobs.job_card.full_time
    Hopewell, NJ; Somerville, NJ; Pennington, NJ.Must have 15+ years of experience working in Data science, Machine learning and especially NLP technologies. Exposure to various LLM technologies and sol...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Sr Data Engineer - AI

    Sr Data Engineer - AI

    Humana Inc • Trenton, NJ, US
    serp_jobs.job_card.full_time
    Become a part of our caring community and help us put health first.As a Senior Data Engineer, you will play a critical role in building the Agentic AI platform and delivering cutting-edge AI-powere...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Product Engineer, Applied AI

    Product Engineer, Applied AI

    Pocus • New York, NY, US
    serp_jobs.job_card.full_time
    Pocus exists to supercharge GTM teams.We make every rep a 10x seller.With Pocus, organizations can have fewer, better reps to drive increased pipeline and revenue. How? We've created the world's mos...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Consultant Engineer I

    Consultant Engineer I

    FM • PARSIPPANY, New Jersey, United States
    serp_jobs.job_card.full_time
    If you enjoy variety, we will put your time-management and organization skills to use handling field visits, office work, and projects for large commercial clients. We will provide you with extensiv...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Technical AI Product Manager

    Technical AI Product Manager

    Atlas • Peapack, NJ, US
    serp_jobs.job_card.full_time
    Atlas is a global strategic consulting firm, focused on the life sciences industry.Our services include Management Consulting, Managed Services, and Agile Services. Global pharmaceutical companies a...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Generative AI Engineer. No 3rd parties

    Generative AI Engineer. No 3rd parties

    C&G Consulting Services Inc • Raritan, NJ, United States
    serp_jobs.job_card.full_time
    DO NOT RESPOND UNLESS YOU ARE DIRECT.High-Throughput RAG Pipeline Development : .Design and build scalable document processing pipelines to ingest and semantically chunk large batches of documents (P...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_hours • serp_jobs.job_card.promoted • serp_jobs.job_card.new
    Agentic AI Engineer / LLMOps

    Agentic AI Engineer / LLMOps

    Spectraforce Technologies • Newark, NJ, United States
    serp_jobs.job_card.full_time
    Job Title : Agentic AI Engineer / LLMOps.Duration : 6+ Months (Temp to Hire).This role will focus on developing, integrating, and managing enterprise-scale. AI and MCP (Model Context Protocol).Kong AI G...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    CompoSecure • Somerset, NJ, US
    serp_jobs.job_card.full_time
    Reports to : Director of Application Services.Founded in 2000, CompoSecure (Nasdaq : CMPO) is a technology partner to market leaders, fintechs and consumers, enabling trust for millions of people aro...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_hours • serp_jobs.job_card.promoted • serp_jobs.job_card.new
    AI Architect

    AI Architect

    Yochana • Raritan, NJ, US
    serp_jobs.job_card.full_time
    Extensive experience in building and deploying.Hands-on experience in GCP / Data Engineering / DevOps.serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Agentic AI Engineer

    Agentic AI Engineer

    nTech Workforce • New York, NY, United States
    serp_jobs.job_card.full_time
    Title : Agentic AI Engineer Location : Hybrid position in Reston, VA The selected candidate should be comfortable working on-site once per week. There will be times where up to three days per week on-...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    QA Automation Engineer

    QA Automation Engineer

    Sulekha.com New Media Pvt Ltd • Edison, NJ, US
    serp_jobs.job_card.full_time
    QA Automation Engineer - Edison, NJ (ST) Jobs in Edison, NJ at Magnus Technologies.We are seeking a QA Automation Engineer to design, develop, and maintain automated test frameworks that ensure the...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Lead AI / ML Engineer

    Lead AI / ML Engineer

    HSAD North America • Englewood Cliffs, NJ, US
    serp_jobs.job_card.full_time
    This range is provided by HSAD North America.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Direct message the job poster from HSAD North Ameri...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Big Data Engineer

    Big Data Engineer

    Throtle • Red Bank, NJ, US
    serp_jobs.job_card.full_time
    Please consider joining our technology team at Throtle as a Big Data Developer.In this role, you will be part of the team that is responsible for transforming and maintaining several billion record...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    GEN AI Architect

    GEN AI Architect

    Pozent Corporation • Raritan, NJ, US
    serp_jobs.job_card.full_time
    Must have 15+ years of experience working in Data science, Machine learning and especially NLP technologies.Strong architecture exp is a must. Must have experience with Agentic AI frameworks LangGra...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Artificial Intelligence Architect

    Artificial Intelligence Architect

    The Dignify Solutions, LLC • Raritan, NJ, US
    serp_jobs.job_card.full_time
    Be among the first 25 applicants.Seniority level : Mid-Senior level.Industries : IT Services and IT Consulting.Artificial Intelligence, Machine Learning, or a related field with 10+ years of experien...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Lead AI Engineer

    Lead AI Engineer

    Humana Inc • Trenton, NJ, US
    serp_jobs.job_card.full_time
    Become a part of our caring community and help us put health first.We are seeking Lead AI Engineers who has extensive hands-on experience developing Python-based applications intended for use by ot...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted