Overview
Sr QA Engineer for GenAI Product Team. Role at Jobs via Dice. This is a contract assignment with one of our premier Management Consulting clients. Remote work is available, preferably located in EST. The candidate should have excellent communication skills and a hands-on QA Engineering background, including writing automated test scripts, and will work on various technical elements for a GenAI platform / product used by clients for ontology and relationship mapping and associated analytics / insights.
Experience required in API Testing, some experience with AI prompt engineering and data element testing (database, data engineering, ingestion pipelines, etc), AI agentic testing, and the ability to work as part of a 4-5 person Agile testing team. Technical background should include : Neo4J, Vector Databases (Pinecone, Milvus or similar), Python / PyTorch, Docker / Kubernetes, GraphQL (or similar).
Responsibilities
- Define and drive the quality strategy for complex services, designing test approaches that cover data, services, and UI.
- Build robust automation in Python, establish quality gates in CI / CD, and partner closely with engineers and data scientists to catch defects early and measure real-world reliability and safety.
- Turn observability and evaluation signals into actionable improvements that accelerate safe, high-confidence releases.
- Develop and execute test plans, test cases, and test scripts to ensure software meets quality standards.
- Perform functional, regression, performance, and usability testing to identify and report defects.
- Collaborate with cross-functional teams to understand project requirements and ensure testing aligns with project objectives.
- Document and track defects, and work closely with developers to resolve issues.
- Conduct root cause analysis to identify underlying issues and suggest process improvements.
- Maintain test environments and test data for accurate and reliable testing.
- Stay up-to-date with industry trends and best practices in software testing methodologies and tools.
Required Skills
5-8+ years in QA / SDET roles testing backend services, data-intensive systems, and web applications in fast-moving environmentsPrevious experience with enterprise platformsStrong Python skills (pytest / unittest, fixtures, mocking); able to author maintainable test suites, utilities, and lightweight harnessesAutomated API testing expertise (REST / GraphQL), including schema / contract testing (OpenAPI / AsyncAPI, Pact), negative tests, and auth / SSO flows (OAuth / OIDC)Web UI automation experience (Cypress), with a pragmatic approach to the test pyramid and flake-reduction techniquesData and model-centric testing : data quality validation (Great Expectations / Pandera), experiment reproducibility, golden datasets, drift / robustness checks, and offline vs. online evaluation strategiesFamiliarity with evaluation of LLM-powered features (prompt robustness, deterministic scaffolding, guardrail checks, safety / quality metrics), plus RAG / search-quality testing where applicablePerformance and reliability testing (load, soak, latency, scalability) using tools such as Locust, k6, or JMeter; ability to interpret results and drive remediation with engineeringCI / CD quality gates (GitHub Actions / GitLab / Jenkins), test impact analysis, parallelization, and quarantine strategies for flaky testsObservability-driven quality : logs / metrics / traces (OpenTelemetry, Prometheus / Grafana), synthetic monitoring, canary / shadow testing, and SLO / SLA alignmentContainers and orchestration (Docker / Kubernetes) and cloud fluency (AWS / Azure / Google Cloud Platform), including ephemeral test environments and secrets managementDatabase and messaging fundamentals (SQL, schema evolution, migrations; Kafka / Pub / Sub) and comfort validating data pipelines end-to-endSecurity / privacy awareness across testing (PII handling, least-privilege, secrets, vulnerability scanning) and collaboration with security and compliance partnersExcellent communication, clear defect narratives, crisp risk / mitigation framing, and the ability to translate findings for engineers, product managers, and non-technical stakeholdersEducation : Degree in CS / Engineering or equivalent experienceLocation : Location is flexible, but ET time zone preferred. Some travel may be requiredLocation and Travel
Remote (EST preferred). Some travel may be required.
Equal Opportunity
SGA is an Equal Opportunity Employer and does not discriminate on the basis of Race, Color, Sex, Sexual Orientation, Gender Identity, Religion, National Origin, Disability, Veteran Status, Age, Marital Status, Pregnancy, Genetic Information, or Other Legally Protected Status. We are committed to providing access, equal opportunity, and reasonable accommodation for individuals with disabilities in employment, and our services, programs, and activities. Please visit our company to request an accommodation or assistance regarding our policy.
J-18808-Ljbffr