Talent.com
serp_jobs.error_messages.no_longer_accepting
AI Agent Evaluation Analyst

AI Agent Evaluation Analyst

VirtualVocationsRockville, Maryland, United States
job_description.job_card.variable_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

A company is looking for an AI Agent Evaluation Analyst.

Key Responsibilities

Review evaluation tasks and scenarios for logic, completeness, and realism

Identify inconsistencies, missing assumptions, or unclear decision points

Help define clear expected behaviors for AI agents

Required Qualifications

Excellent analytical thinking regarding complex systems and logical implications

Familiarity with structured data formats like JSON / YAML

Experience with policy evaluation, logic puzzles, or structured scenario design

Background in consulting, academia, or research

Some understanding of scoring or evaluation in agent testing

serp_jobs.job_alerts.create_a_job

Ai Analyst • Rockville, Maryland, United States

Job_description.internal_linking.related_jobs
  • serp_jobs.job_card.promoted
Applied AI Engineer

Applied AI Engineer

VirtualVocationsAlexandria, Virginia, United States
serp_jobs.job_card.full_time
A company is looking for an Applied AI Engineer to design and deploy AI systems for construction workflows.Key Responsibilities Build and deploy agentic AI systems that automate construction work...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
AI Applications Engineer

AI Applications Engineer

VirtualVocationsBaltimore, Maryland, United States
serp_jobs.job_card.full_time
A company is looking for an AI Application Engineer to bridge cutting-edge AI research and practical implementation.Key Responsibilities Identify and prioritize high-potential experiments based o...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
AI Specialist

AI Specialist

Johns Hopkins UniversityBaltimore, MD, United States
serp_jobs.job_card.full_time
AI) in research and scholarly communication.This position is designed to help researchers not only use AI, but use it responsibly, ethically, and effectively. Reporting to the Manager of Digital Sch...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Research Lead - AI Cyber Testing & Evaluation

Research Lead - AI Cyber Testing & Evaluation

RANDWashington, DC, United States
serp_jobs.job_card.temporary
RAND's Meselson Center, part of the Global and Emerging Risks (GER) division, is seeking an accomplished technical leader to drive our ambitious AI cyber evaluation agenda.As Research Lead - AI Cyb...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
AI / ML Engineer

AI / ML Engineer

Leidos IncReston, VA, United States
serp_jobs.job_card.full_time
Leidos' National Security Sector is seeking an AI / ML Engineer to join our growing Advantage Decision Solutions team within our National Security Sector. We are looking for a researcher who is expert...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Research Lead - AI Cyber Testing & Evaluation

Research Lead - AI Cyber Testing & Evaluation

RAND CorporationWashington, DC, United States
serp_jobs.job_card.temporary
Global and Emerging Risks (GER) division.As Research Lead - AI Cyber Testing & Evaluation, you'll direct a comprehensive research portfolio focused on assessing the offensive cyber capabilities of ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
AI Engineer

AI Engineer

VirtualVocationsRockville, Maryland, United States
serp_jobs.job_card.full_time
A company is looking for an AI Engineer, Principal.Key Responsibilities Collaborate with data scientists and ML engineers to containerize, deploy, and monitor AI / ML models Design, build, and man...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
Applied AI / ML Engineer

Applied AI / ML Engineer

Catalyst LabsWashington, DC, US
serp_jobs.job_card.full_time
Catalyst Labs is a leading talent agency with a specialized vertical in Applied AI, Machine Learning, and Data Science.We stand out as an agency thats deeply embedded in our clients recruitment ope...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_hour
Artificial Intelligence Engineer / Analyst

Artificial Intelligence Engineer / Analyst

Synertex LLCArlington, VA, USA
serp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Artificial Intelligence Engineer / Analyst.Full-Time | On-site | Position Contingent Upon Award.Join Synertex and apply your expertise to a mission that matters. We're seeking an AI Engineer / Analyst w...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Principal Engineering Analyst, Responsible AI Testing

Principal Engineering Analyst, Responsible AI Testing

Google Inc.Washington, DC, United States
serp_jobs.job_card.full_time
Principal Engineering Analyst, Responsible AI Testing.Experience owning outcomes and decision making, solving ambiguous problems and influencing stakeholders. deep expertise in domain.Bachelor's deg...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Agentic AI Engineer

Agentic AI Engineer

VirtualVocationsBaltimore, Maryland, United States
serp_jobs.job_card.full_time
A company is looking for an Agent Forward Engineer to lead the design and deployment of AI agents and software for application development and migration. Key Responsibilities Design and implement ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
AI Researcher for Conversational AI

AI Researcher for Conversational AI

VirtualVocationsWashington, District of Columbia, United States
serp_jobs.job_card.full_time
A company is looking for an AI Researcher specializing in Large Language Models.Key Responsibilities Conduct research on large language modeling and adaptation for Conversational Avatars Develop...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
  • serp_jobs.job_card.promoted
Assessment & Evaluation Analyst (Cntr for Research & Reform in Education)

Assessment & Evaluation Analyst (Cntr for Research & Reform in Education)

InsideHigherEdBaltimore, Maryland, United States
serp_jobs.job_card.full_time
Assessment & Evaluation Analyst.This position will involve working with multiple studies on an as-needed basis to supplement senior-level project management and research work by resident CRRE staff...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
AI Workflow Engineer

AI Workflow Engineer

VirtualVocationsWashington, District of Columbia, United States
serp_jobs.job_card.full_time
A company is looking for an AI Workflow Engineer to lead the design and implementation of an automated invoice-processing pipeline. Key Responsibilities Develop and deploy end-to-end AI-driven wor...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
Senior Agentic AI Test and Evaluation Engineer

Senior Agentic AI Test and Evaluation Engineer

Leidos IncReston, VA, United States
serp_jobs.job_card.full_time
At Leidos, you'll contribute to AI solutions that serve critical national and global missions-ranging from defense and intelligence to healthcare, energy, and space exploration.Our work emphasizes ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Agentic AI Engineer

Agentic AI Engineer

Leidos IncReston, VA, United States
serp_jobs.job_card.full_time
At Leidos, you'll contribute to AI solutions that serve critical national and global missions-ranging from defense and intelligence to healthcare, energy, and space exploration.Our work emphasizes ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Data Engineer - AI / ML Pipelines (Consultant)

Data Engineer - AI / ML Pipelines (Consultant)

BLN24McLean, VA, US
serp_jobs.job_card.full_time
Data Engineer – AI / ML Pipelines (Consultant).We find strength in teamwork-a better you is a better us.BLN24 is an award-winning Management Consulting Firm that supports the U.Federal Gov...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Artificial Intelligence (AI) Engineer

Artificial Intelligence (AI) Engineer

BuddoBot Inc.Chantilly, VA, United States
serp_jobs.job_card.full_time
Velocity-X, a VelocityBlack company, constructs and deploys data management and analytics solutions for the defense and intelligence communities. We're proud to boast a world-class engineering team ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Assessment & Evaluation Analyst (Cntr for Research & Reform in Education)

Assessment & Evaluation Analyst (Cntr for Research & Reform in Education)

Johns Hopkins UniversityBaltimore, MD, United States
serp_jobs.job_card.full_time
Assessment & Evaluation Analyst.This position will involve working with multiple studies on an as-needed basis to supplement senior-level project management and research work by resident CRRE staff...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Senior Agentic AI Engineer

Senior Agentic AI Engineer

Leidos IncReston, VA, United States
serp_jobs.job_card.full_time
At Leidos, you'll contribute to AI solutions that serve critical national and global missions-ranging from defense and intelligence to healthcare, energy, and space exploration.Our work emphasizes ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30