AI Agent Evaluation Analyst
VirtualVocationsLincolnwood, Illinois, United Statesjob_description.job_card.1_day_ago
serp_jobs.job_preview.job_type
- serp_jobs.job_card.full_time
job_description.job_card.job_description
A company is looking for an AI Agent Evaluation Analyst.
Key Responsibilities
Review evaluation tasks and scenarios for logic, completeness, and realism
Identify inconsistencies, missing assumptions, or unclear decision points
Help define clear expected behaviors for AI agents
Required Qualifications
Excellent analytical thinking regarding complex systems and logical implications
Familiarity with structured data formats like JSON / YAML
Experience with policy evaluation, logic puzzles, or structured scenario design
Background in consulting, academia, or research
Some understanding of scoring or evaluation in agent testing
serp_jobs.job_alerts.create_a_job
Ai Analyst • Lincolnwood, Illinois, United States
Job_description.internal_linking.related_jobs
The Product Management team is looking for a Product Manager with a strong background in product lifecycle and DevOps / Agile practices as well as strong communication and collaboration skills.You wi...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Competitive Intelligence Analyst.Cooley is seeking a Competitive Intelligence Analyst to join the Data Delivery team.Cooley Innovation embraces a culture of customer service excellence and all memb...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
At Allstate, great things happen when our people work together to protect families and their belongings from life's uncertainties.
And for more than 90 years our innovative drive has kept us a step ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Turn your passion for luxury into a career opportunity.Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles.
Join CXG, the global leader in custo...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
We celebrate diversity and are committed to respecting one another, embracing individual differences, and creating an inclusive environment for all employees.
Technology Fellow AI Systems & Autom...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Do you hunger for more? Potbelly Sandwich Shop is looking for friendly and outgoing people who enjoy working in a fast-paced, friendly environment.
We are where good vibes and great careers are a wa...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Maneva, a startup founded by an ex-Google Deepmind researcher, is an AI service provider revolutionizing manufacturing operations with cutting-edge AI solutions for autonomous factory operation and...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
At accentedge, we are pioneering AI-driven solutions that transform industries and empower businesses to thrive in an ever-evolving digital landscape.
Our mission is to leverage cutting-edge Generat...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Our Client, a Internet Content & Information company, is looking for an AI Multimedia Generation Product Evaluator for their Remote location.
The Multimedia Generation team focuses on fine tuning an...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours Be among the first 25 applicants.This range is provided by Mercor.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.
Mercor connects elite creative...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Press Tab to Move to Skip to Content Link.Select how often (in days) to receive an alert : .We are seeking a talented and detail-oriented Visual Data Evaluator to join our team.The ideal candidate wi...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days 
Taft is currently seeking a Knowledge & Research Analyst to join our Knowledge and Research Services Department.Taft Stettinius & Hollister is seeking a full-time Knowledge & Research Analyst with ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Imagine a place where your talent can make a meaningful difference in peoples' lives.Working at Feeding America is a uniquely rewarding experience in which our employees work together as vital part...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
At HCSC, our employees are the cornerstone of our business and the foundation to our success.We empower employees with curated development plans that foster growth and promote rewarding, fulfilling...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Payer Contract Analytics Team Member.AbbVie's mission is to discover and deliver innovative medicines and solutions that solve serious health issues today and address the medical challenges of tomo...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Competitive Intelligence Analyst.Cooley is seeking a Competitive Intelligence Analyst to join the Data Delivery team.Position summary : Cooley Innovation embraces a culture of customer service excel...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Join a collaborative remote team working to make AI communication emotionally intelligent, culturally aware, and engaging.
Score AI messages for tone, empathy, and contextual awareness.Identify subt...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Turn your passion for luxury into a career opportunity.Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles.
Join CXG, the global leader in custo...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days 
The ideal candidate will have strong expertise in.This role will focus on building intelligent applications that leverage data to generate insights, automate processes, and enable decision-making.A...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
- serp_jobs.job_card.promoted
Product Manager, Public Sector Platform & AI
RelativityChicago, IL, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Competitive Intelligence Analyst
Cooley LLPChicago, IL, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Associate Analyst, Research
Allstate InsuranceChicago, IL, United Statesserp_jobs.job_card.full_time
Become a Luxury Brand Evaluator in Lake Bluff, IL- Apply Now
CXGLake Bluff, IL, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Technology Fellow – AI Systems & Automation (GenAI & Agentic AI)
Coalfire SystemsChicago, Illinois, United States, 60611serp_jobs.job_card.full_time
VP, Data, Analytics & AI
Potbelly CorporateChicago, IL, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
Remote AI Writing Evaluator
OutlierChicago, IL, United Statesserp_jobs.filters.remote
serp_jobs.job_card.full_time
AI Engineer
ManevaChicago, IL, USserp_jobs.filters.remote
serp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Generative AI Engineer
accentedge, LLCChicago, IL, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.new
ICONMA is hiring : AI Multimedia Generation Product Evaluator in Chicago
MediabistroChicago, IL, United Statesserp_jobs.job_card.full_time
Audio Evaluation Expert - Fully Remote Job at Mercor in Chicago
MediabistroChicago, IL, United Statesserp_jobs.filters.remote
serp_jobs.job_card.full_time
Visual Data Evaluator Job at Firstsource Solutions Ltd in Chicago
MediabistroChicago, IL, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Knowledge & Research Analyst
Taft Stettinius & Hollister LLPChicago, IL, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Analyst, Research (Chicago / Hybrid)
Feeding AmericaChicago, IL, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Market Research Analyst
Health Care Service CorporationChicago, IL, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Senior Analyst, Market Research
AbbVieLake Forest, IL, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Competitive Intelligence Analyst
CooleyChicago, IL, USserp_jobs.job_card.full_time
AI Communication Quality & Culture Evaluator Job at Hireio, Inc. in Chicago
MediabistroChicago, IL, United Statesserp_jobs.job_card.full_time
Freelance Luxury Brand Evaluator in Chicago, IL
CXGEvanston, IL, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
AI Engineer
KonnectITChicago, Illinois, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply