AI Agent Evaluation Analyst
VirtualVocationsVirginia Beach, Virginia, United Statesjob_description.job_card.variable_days_ago
serp_jobs.job_preview.job_type
- serp_jobs.job_card.full_time
job_description.job_card.job_description
A company is looking for an AI Agent Evaluation Analyst.
Key Responsibilities
Review evaluation tasks and scenarios for logic, completeness, and realism
Identify inconsistencies, missing assumptions, or unclear decision points
Help define clear expected behaviors for AI agents
Required Qualifications
Excellent analytical thinking regarding complex systems and logical implications
Familiarity with structured data formats like JSON / YAML
Experience with policy evaluation, logic puzzles, or structured scenario design
Background in consulting, academia, or research
Some understanding of scoring or evaluation in agent testing
serp_jobs.job_alerts.create_a_job
Ai Analyst • Virginia Beach, Virginia, United States
Job_description.internal_linking.related_jobs
Cybersecurity Engineer Location : Dam Neck, VA (100% On-Site) Come work for a company that values innovation , collaboration , and making a difference !.
Cybersecurity Engineer to join our tea...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
DATA AND AI SENIOR SOFTWARE DEVELOPER.DEFTEC delivers mission-critical solutions through skillfully delivered services and innovative products.
We are inspired by our clients' critical missions ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Virginia Beach, VA at our wonderful G2 Ops office.In person, some remote opportunity and / or flexible working hours, not a fully remote position.
August / September 2025 Salary Range : $130-$150K p...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Information Systems Security Engineer / Officer (ISSE / ISSO) Location : .On-Site – Dam Neck, VA Security Clearance : TS / SCI Required Position Summary RPI Group, Inc.
Information Systems Security Eng...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
Contractor will need to come to Richmond quarterly.The Virginia Department of Transportation's Information Technology Division is seeking a highly skilled AI Developer UI Strategy mainly crafting a...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Founded in 1995, ESN is a Small Disadvantaged Business (SDB), Service-Disabled Veteran-Owned Small Business (SDVOSB) and Veteran Owned Small Business (VOSB).
ESN delivers trusted solutions that supp...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
We cannot provide sponsorship at this time.Data Analytics Manager-SQL to Big Query.At Family Dollar, we strive for exceptional collaboration between talented individuals who exhibit our values and ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
CYBERSPACE CONCEPT DEVELOPER AND VALIDATOR.DEFTEC delivers mission-critical solutions through skillfully delivered services and innovative products.
We are inspired by our clients' critical missions...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Cyberspace Concept Developer & Validator (LC 32) – Onsite at NATO ACT Norfolk Location : .HQ SACT, Norfolk, VA Position Type : Full-time, Onsite Clearance Requirement : Active NATO or Nationa...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days DATA AND AI FULL STACK DEVELOPER.DEFTEC delivers mission-critical solutions through skillfully delivered services and innovative products.
We are inspired by our clients' critical missions and drive...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days 
Campaign Data Manager Kingston Strategy Location : .Suffolk / Virginia Beach / Eastville, VA Job Type : Temporary, Contract Experience Level : 1-2 Cycles preferred, not required Compensation : Sal...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Control Systems Integration firm is currently seeking full-time SCADA / PLC / HMI Programmers with a minimum of 5+ years of experience using Ignition SCADA, Allen Bradley FactoryTalk, VT SCADA, Schn...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
AVP, Specialty Underwriting & Portfolio Management - Corporate & Sponsor Lending.The Commercial Underwriting and Portfolio Management organization is responsible for working with internal partners ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
Spektrum have a wide range of exciting opportunities in several global locations.We are always looking to add great new talent to our team and look forward to hearing from you.Spektrum supports ape...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
The Trait Management Analyst is responsible for ensuring the highest level of data integrity across multiple systems and departments.
Key responsibilities include ownership of creation and maintenan...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours DEFTEC delivers mission-critical solutions through skillfully delivered services and innovative products.We are inspired by our clients' critical missions and driven to provide the most effecti...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Cybersecurity Engineer
RPI Group IncDam Neck, VA, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
DATA AND AI SENIOR SOFTWARE DEVELOPER
DEFTEC CorporationChesapeake, VA, USserp_jobs.job_card.full_time
Data Scientist / Software Engineer
G2 Ops, Inc.Virginia Beach, VA, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Information Systems Security Engineer / Officer (ISSE / ISSO)
RPI Group IncDam Neck, VA, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
STI is hiring : AI Developer UI Strategy in Virginia Beach
MediabistroVirginia Beach, VA, United Statesserp_jobs.job_card.full_time
Database Management Analyst lll
ENGINEERING SERVICES NETWORK, Inc.Chesapeake, VA, USAserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
Data Analytics Manger-SQL to Big Query
Family DollarChesapeake, VA, USserp_jobs.job_card.full_time
CYBERSPACE CONCEPT DEVELOPER AND VALIDATOR
DEFTEC CorporationNorfolk, VA, USAserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Cyberspace Concept Developer & Validator
Ironclad Defense WorksNorfolk, VA, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
DATA AND AI FULL STACK DEVELOPER
DEFTEC CorporationNorfolk, VA, USAserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
1.2 Campaign Data Manager
Kingston StrategyVirginia Beachserp_jobs.job_card.temporary
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
SCADA / PLC / HMI Programmer -5+ yrs Required
Systems East, Inc.Seaford, VA, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Lead Machine Learning Engineer (Intelligent Foundations & Experiences)
Capital OneNorfolk, VA, United Statesserp_jobs.job_card.full_time +1
Cyberspace Concept Developer and Validator
SpektrumNorfolk, Virginia, United Statesserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
Trait Management Analyst
Family DollarChesapeake, VA, USserp_jobs.job_card.full_time +1
- serp_jobs.job_card.promoted
DATA SCIENCE AND AI ENGINEER
DEFTEC CorporationChesapeake, VA, USserp_jobs.job_card.full_time