Talent.com
AI Evaluation Analyst
AI Evaluation AnalystVirtualVocations • Norcross, Georgia, United States
serp_jobs.error_messages.no_longer_accepting
AI Evaluation Analyst

AI Evaluation Analyst

VirtualVocations • Norcross, Georgia, United States
job_description.job_card.variable_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

A company is looking for an AI Agent Evaluation Analyst.

Key Responsibilities

Review evaluation tasks and scenarios for logic, completeness, and realism

Identify inconsistencies, missing assumptions, or unclear decision points

Help define clear expected behaviors (gold standards) for AI agents

Required Qualifications

Excellent analytical thinking regarding complex systems and logical implications

Familiarity with structured data formats, such as JSON / YAML

Experience with policy evaluation, logic puzzles, or structured scenario design

Background in consulting, academia, or research

Some understanding of scoring or evaluation in agent testing

serp_jobs.job_alerts.create_a_job

Ai Analyst • Norcross, Georgia, United States

Job_description.internal_linking.related_jobs
Remote Commercial Banking Analyst - AI Trainer

Remote Commercial Banking Analyst - AI Trainer

Data Annotation • Brookhaven, Georgia
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_more
serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
Investigation Analyst (Atlanta)

Investigation Analyst (Atlanta)

Pyramid Consulting, Inc • Atlanta, GA, US
serp_jobs.job_card.part_time +1
Please review the job description below and contact me ASAP if you are interested.Employee benefits include, but are not limited to, health insurance (medical, dental, vision), 401(k) plan, and pai...serp_jobs.internal_linking.show_more
serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
Investigation Analyst

Investigation Analyst

Pyramid Consulting, Inc • Atlanta, GA, US
serp_jobs.job_card.temporary
Please review the job description below and contact me ASAP if you are interested.Employee benefits include, but are not limited to, health insurance (medical, dental, vision), 401(k) plan, and pai...serp_jobs.internal_linking.show_more
serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
Revenue Analyst

Revenue Analyst

Delta Air Lines • Atlanta, GA, US
serp_jobs.job_card.full_time
United States, Georgia, Atlanta.serp_jobs.internal_linking.show_more
serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
Remote Senior Financial Analyst - AI Trainer

Remote Senior Financial Analyst - AI Trainer

Data Annotation • Dunwoody, Georgia
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_more
serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
Associate - AI, Research & Innovation

Associate - AI, Research & Innovation

Energy Impact Partners • Atlanta, GA, US
serp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Energy Impact Partners (EIP) is a global investment platform leading the transition to a sustainable energy future.EIP brings together entrepreneurs and some of the world’s most forward-looking ene...serp_jobs.internal_linking.show_more
serp_jobs.last_updated.last_updated_variable_days
Data Analyst

Data Analyst

Edible Arrangements, LLC • Atlanta, GA, US
serp_jobs.job_card.full_time
Who are we and what do we do? .Edible Brands® is an innovative, Atlanta-based company that acquires, develops, and manages a world-class portfolio of consumer and service...serp_jobs.internal_linking.show_more
serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
Technical Research Analyst II - AI & Energy Systems

Technical Research Analyst II - AI & Energy Systems

Southwire Company, LLC • Atlanta, GA, United States
serp_jobs.job_card.full_time
A leader in technology and innovation, Southwire Company, LLC is one of North America's largest wire and cable producers. Southwire and its subsidiaries manufacture building wire and cable, utility ...serp_jobs.internal_linking.show_more
serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
Mobile Exploitation Analyst

Mobile Exploitation Analyst

Chimera Enterprises International • Atlanta, GA, US
serp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Chimera Enterprises is currently seeking a Mobile Exploitation Analyst (CELLEX / DOMEX) based in Fort Gillem, GA.The salary range for this position will be determined by the education, experience, kn...serp_jobs.internal_linking.show_more
serp_jobs.last_updated.last_updated_30
Data Analyst

Data Analyst

Jackson Healthcare • Alpharetta, GA, United States
serp_jobs.job_card.full_time
Jackson Healthcare is seeking an experienced Data Analyst to join our growing information technology team! In this position you’ll perform extensive quantitative and qualitative analysis to support...serp_jobs.internal_linking.show_more
serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
Lecturer of Data Science and Analytics and Director of the Center for Data Science and Analytics

Lecturer of Data Science and Analytics and Director of the Center for Data Science and Analytics

InsideHigherEd • Kennesaw, Georgia, United States
serp_jobs.job_card.full_time +1
Lecturer of Data Science and Analytics and Director of the Center for Data Science and Analytics.For more than 60 years, Kennesaw State University has been known for its entrepreneurial spirit and ...serp_jobs.internal_linking.show_more
serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
Remote Discovery Analyst

Remote Discovery Analyst

Samprasoft • Atlanta, GA, US
serp_jobs.filters.remote
serp_jobs.job_card.full_time
Structured way of working - responds to ambiguity and uncertainty with structure - documents his findings in a way that can be readily referenced, and iterated / refined to serve as.serp_jobs.internal_linking.show_more
serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
Research Engineer I

Research Engineer I

Georgia Tech • Atlanta, GA, United States
serp_jobs.job_card.full_time +2
Georgia Tech prides itself on its technological resources, collaborations, high-quality student body, and its commitment to building an outstanding and diverse community of learning, discovery, and...serp_jobs.internal_linking.show_more
serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
Sr. Associate Data Analyst

Sr. Associate Data Analyst

MCKESSON • Alpharetta, GA, United States
serp_jobs.job_card.full_time
McKesson is an impact-driven, Fortune 10 company that touches virtually every aspect of healthcare.We are known for delivering insights, products, and services that make quality care more accessibl...serp_jobs.internal_linking.show_more
serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
AI Solutions Architect

AI Solutions Architect

NEXTGEN Healthcare • Atlanta, GA, United States
serp_jobs.job_card.full_time
The AI Solutions Architect will develop and implement our healthcare platform's applications, data pipelines, and AI / ML components through hands-on software engineering and system integration.Devel...serp_jobs.internal_linking.show_more
serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
Data Analyst

Data Analyst

Alliance Animal Health • Atlanta, GA, US
serp_jobs.job_card.full_time
Alliance Animal Health is a fast-growing Veterinarian Service Organization that operates as a majority owner and business partner to many veterinarian practices across the US.Our goal is to make it...serp_jobs.internal_linking.show_more
serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
Remote Financial Analyst - AI Trainer

Remote Financial Analyst - AI Trainer

Data Annotation • Marietta, Georgia
serp_jobs.filters.remote
serp_jobs.job_card.full_time +1
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_more
serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
Sr. Data Analyst, AI

Sr. Data Analyst, AI

NEXTGEN Healthcare • Atlanta, GA, United States
serp_jobs.job_card.full_time
Data Analyst with advanced SQL expertise to support our Data Science and AI initiatives through high-impact analytics and insights. This role is pivotal in enabling the development of safe, effectiv...serp_jobs.internal_linking.show_more
serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
Sr. BI Analyst (Digital Analytics

Sr. BI Analyst (Digital Analytics

Akkodis • Atlanta, GA, US
serp_jobs.job_card.full_time
Hybrid schedule (3-days) in north Atlanta (Dunwoody).BI Analyst - Digital Analytics, you will be responsible for working cross-functionally with analytics enablement team, data engineering teams &a...serp_jobs.internal_linking.show_more
serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
Technical Accounting Research Analyst

Technical Accounting Research Analyst

NorthPoint Search Group • Atlanta, GA, US
serp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Technical Accounting Research Analyst Who : .We're seeking a detail-oriented and analytical professional with deep expertise in technical accounting and a passion for problem-solving.You'll be respon...serp_jobs.internal_linking.show_more
serp_jobs.last_updated.last_updated_30