Talent.com
Sr QA Engineer for GenAI Product Team
Sr QA Engineer for GenAI Product TeamJobs via Dice • New York, NY, US
Sr QA Engineer for GenAI Product Team

Sr QA Engineer for GenAI Product Team

Jobs via Dice • New York, NY, US
job_description.job_card.variable_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

Overview

Sr QA Engineer for GenAI Product Team. Role at Jobs via Dice. This is a contract assignment with one of our premier Management Consulting clients. Remote work is available, preferably located in EST. The candidate should have excellent communication skills and a hands-on QA Engineering background, including writing automated test scripts, and will work on various technical elements for a GenAI platform / product used by clients for ontology and relationship mapping and associated analytics / insights.

Experience required in API Testing, some experience with AI prompt engineering and data element testing (database, data engineering, ingestion pipelines, etc), AI agentic testing, and the ability to work as part of a 4-5 person Agile testing team. Technical background should include : Neo4J, Vector Databases (Pinecone, Milvus or similar), Python / PyTorch, Docker / Kubernetes, GraphQL (or similar).

Responsibilities

  • Define and drive the quality strategy for complex services, designing test approaches that cover data, services, and UI.
  • Build robust automation in Python, establish quality gates in CI / CD, and partner closely with engineers and data scientists to catch defects early and measure real-world reliability and safety.
  • Turn observability and evaluation signals into actionable improvements that accelerate safe, high-confidence releases.
  • Develop and execute test plans, test cases, and test scripts to ensure software meets quality standards.
  • Perform functional, regression, performance, and usability testing to identify and report defects.
  • Collaborate with cross-functional teams to understand project requirements and ensure testing aligns with project objectives.
  • Document and track defects, and work closely with developers to resolve issues.
  • Conduct root cause analysis to identify underlying issues and suggest process improvements.
  • Maintain test environments and test data for accurate and reliable testing.
  • Stay up-to-date with industry trends and best practices in software testing methodologies and tools.

Required Skills

  • 5-8+ years in QA / SDET roles testing backend services, data-intensive systems, and web applications in fast-moving environments
  • Previous experience with enterprise platforms
  • Strong Python skills (pytest / unittest, fixtures, mocking); able to author maintainable test suites, utilities, and lightweight harnesses
  • Automated API testing expertise (REST / GraphQL), including schema / contract testing (OpenAPI / AsyncAPI, Pact), negative tests, and auth / SSO flows (OAuth / OIDC)
  • Web UI automation experience (Cypress), with a pragmatic approach to the test pyramid and flake-reduction techniques
  • Data and model-centric testing : data quality validation (Great Expectations / Pandera), experiment reproducibility, golden datasets, drift / robustness checks, and offline vs. online evaluation strategies
  • Familiarity with evaluation of LLM-powered features (prompt robustness, deterministic scaffolding, guardrail checks, safety / quality metrics), plus RAG / search-quality testing where applicable
  • Performance and reliability testing (load, soak, latency, scalability) using tools such as Locust, k6, or JMeter; ability to interpret results and drive remediation with engineering
  • CI / CD quality gates (GitHub Actions / GitLab / Jenkins), test impact analysis, parallelization, and quarantine strategies for flaky tests
  • Observability-driven quality : logs / metrics / traces (OpenTelemetry, Prometheus / Grafana), synthetic monitoring, canary / shadow testing, and SLO / SLA alignment
  • Containers and orchestration (Docker / Kubernetes) and cloud fluency (AWS / Azure / Google Cloud Platform), including ephemeral test environments and secrets management
  • Database and messaging fundamentals (SQL, schema evolution, migrations; Kafka / Pub / Sub) and comfort validating data pipelines end-to-end
  • Security / privacy awareness across testing (PII handling, least-privilege, secrets, vulnerability scanning) and collaboration with security and compliance partners
  • Excellent communication, clear defect narratives, crisp risk / mitigation framing, and the ability to translate findings for engineers, product managers, and non-technical stakeholders
  • Education : Degree in CS / Engineering or equivalent experience
  • Location : Location is flexible, but ET time zone preferred. Some travel may be required
  • Location and Travel

    Remote (EST preferred). Some travel may be required.

    Equal Opportunity

    SGA is an Equal Opportunity Employer and does not discriminate on the basis of Race, Color, Sex, Sexual Orientation, Gender Identity, Religion, National Origin, Disability, Veteran Status, Age, Marital Status, Pregnancy, Genetic Information, or Other Legally Protected Status. We are committed to providing access, equal opportunity, and reasonable accommodation for individuals with disabilities in employment, and our services, programs, and activities. Please visit our company to request an accommodation or assistance regarding our policy.

    J-18808-Ljbffr

    serp_jobs.job_alerts.create_a_job

    Sr Product Engineer • New York, NY, US

    Job_description.internal_linking.related_jobs
    Lead Software Development Engineer, Consumer Domains

    Lead Software Development Engineer, Consumer Domains

    Amazon.com • New Brunswick, NJ, USA
    serp_jobs.job_card.full_time
    At Audible, we believe stories have the power to transform lives.It’s why we work with some of the world’s leading creators to produce and share audio storytelling with our millions of global liste...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Sr. Controls Engineer

    Sr. Controls Engineer

    Jobot • Paterson, NJ, US
    serp_jobs.job_card.full_time
    This Jobot Job is hosted by : Nick Strebig.Are you a fit? Easy Apply now by clicking the "Apply Now" buttonand sending us your resume. Salary : $100,000 - $160,000 per year.Based in New Jers...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Senior QA Automation Engineer

    Senior QA Automation Engineer

    VirtualVocations • Paterson, New Jersey, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior QA Automation Engineer (Selenium / Java).Key Responsibilities Design, develop, and maintain automated test frameworks using Selenium WebDriver with Java and Test...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Senior Product Manager, AI Content Discovery

    Senior Product Manager, AI Content Discovery

    Amazon.com • New Brunswick, NJ, USA
    serp_jobs.job_card.full_time
    At Audible, we believe stories have the power to transform lives.It’s why we work with some of the world’s leading creators to produce and share audio storytelling with our millions of global liste...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    QA / Test Engineer

    QA / Test Engineer

    VirtualVocations • Elizabeth, New Jersey, United States
    serp_jobs.job_card.full_time
    A company is looking for a QA / Test Engineer (CMS) to support the design, testing, and validation of an enterprise Case Management System. Key Responsibilities Develop and execute test plans, cases...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    AEM QA Engineer

    AEM QA Engineer

    VirtualVocations • Newark, New Jersey, United States
    serp_jobs.job_card.full_time
    A company is looking for an AEM QA and Automation Engineer (Remote).Key Responsibilities Develop and implement comprehensive QA strategies and processes for AEM-based projects Design, write, and...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Software Development Engineer, Playback Team

    Software Development Engineer, Playback Team

    Amazon.com • New Brunswick, NJ, USA
    serp_jobs.job_card.full_time
    At Audible, we believe stories have the power to transform lives.It’s why we work with some of the world’s leading creators to produce and share audio storytelling with our millions of global liste...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    QA Engineer

    QA Engineer

    VirtualVocations • Paterson, New Jersey, United States
    serp_jobs.job_card.full_time
    A company is looking for a Level II QA Engineer.Key Responsibilities Execute and maintain test plans and test cases to ensure software quality and reliability Perform functional, regression, loa...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Sr. Software Engineer- Gen AI Team (Hybrid)

    Sr. Software Engineer- Gen AI Team (Hybrid)

    Selective Insurance • Millburn, NJ, United States
    serp_jobs.job_card.temporary
    At Selective, we don't just insure uniquely, we employ uniqueness.Selective's unique position as both a leading insurance group and an employer of choice is recognized in a wide variety of awards a...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Sr. QA Engineer

    Sr. QA Engineer

    The Knot Worldwide • New York, NY, US
    serp_jobs.job_card.full_time
    At The Knot Worldwide, we champion celebration - and that starts with celebrating our people.Our employees are passionate dreamers, thoughtful doers, and lifelong learners who power meaningful mome...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Senior QA Engineer

    Senior QA Engineer

    ROSE • New York, NY, US
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    ROSE is an award-winning digital innovation agency focused on helping leading brands leverage cutting-edge technology to innovate and delight their customers. As one of the INC 500 fastest-growing p...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30
    Sr. Product Engineer

    Sr. Product Engineer

    Motion Recruitment • New York, NY, US
    serp_jobs.job_card.full_time
    Be among the first 25 applicants.We're building the operating system for infrastructure construction — software that helps contractors and operators collaborate on production tracking, cost managem...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Lead Software Development Engineer, Apps and Consumption Services

    Lead Software Development Engineer, Apps and Consumption Services

    Amazon.com • New Brunswick, NJ, USA
    serp_jobs.job_card.full_time
    At Audible, we believe stories have the power to transform lives.It’s why we work with some of the world’s leading creators to produce and share audio storytelling with our millions of global liste...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_hours • serp_jobs.job_card.promoted • serp_jobs.job_card.new
    Device QA Engineer

    Device QA Engineer

    VirtualVocations • Elizabeth, New Jersey, United States
    serp_jobs.job_card.full_time
    A company is looking for a Device QA Engineer II to build and execute test cases for device functionality, performance, and usability. Key Responsibilities Build and execute test cases for device ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Senior Software QA Engineer

    Senior Software QA Engineer

    VirtualVocations • Brooklyn, New York, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior Software QA Engineer who will focus on ensuring software quality and efficiency.Key Responsibilities Collaborate with cross-functional teams to plan new work ite...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Senior Quality Assurance Engineer

    Senior Quality Assurance Engineer

    VirtualVocations • Newark, New Jersey, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior Quality Assurance Engineer to enhance their QA efforts and ensure high standards of software quality. Key Responsibilities Conduct Agile QA for bugs and stories c...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Senior QA Engineer

    Senior QA Engineer

    MILE • New York, NY, US
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    MILE is the new members-only shopping destination redefining luxury commerce.We offer access to a curated, seasonless catalogue of the most sought-after products from globally renowned fashion hous...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days
    Senior iOS Engineer

    Senior iOS Engineer

    Amazon.com • New Brunswick, NJ, USA
    serp_jobs.job_card.full_time
    At Audible, we believe stories have the power to transform lives.It’s why we work with some of the world’s leading creators to produce and share audio storytelling with our millions of global liste...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted