AI Agent Evaluation Analyst
VirtualVocationsLincolnwood, Illinois, United Statesjob_description.job_card.1_day_ago
serp_jobs.job_preview.job_type
- serp_jobs.job_card.full_time
job_description.job_card.job_description
A company is looking for an AI Agent Evaluation Analyst.
Key Responsibilities
Review evaluation tasks and scenarios for logic, completeness, and realism
Identify inconsistencies, missing assumptions, or unclear decision points
Help define clear expected behaviors for AI agents
Required Qualifications
Excellent analytical thinking regarding complex systems and logical implications
Familiarity with structured data formats like JSON / YAML
Experience with policy evaluation, logic puzzles, or structured scenario design
Background in consulting, academia, or research
Some understanding of scoring or evaluation in agent testing
serp_jobs.job_alerts.create_a_job
Ai Analyst • Lincolnwood, Illinois, United States
Job_description.internal_linking.related_jobs
Onboard trading partners and EDI documents.Maintain EDI systems by updating trading partner connections and certificates, updating EDI setup data, and performing other related tasks.Facilitate upda...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Our product suite can adapt to the needs of diverse industries and use cases within one powerful platform, empowering ~245,000 customers worldwide to reimagine how work gets done, drive greater eff...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Description Location : onsite 5 days / week in Willis Tower, downtown Chicago.At this time, we are unable to consider candidates requiring visa sponsorship or third-party recruitment agencies for this...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Maneva, a startup founded by an ex-Google Deepmind researcher, is an AI service provider revolutionizing manufacturing operations with cutting-edge AI solutions for autonomous factory operation and...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
At accentedge, we are pioneering AI-driven solutions that transform industries and empower businesses to thrive in an ever-evolving digital landscape.
Our mission is to leverage cutting-edge Generat...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
We are looking for an experienced EDI Analyst to join our team on a contract basis.In this role, you will focus on managing and supporting EDI processes, ensuring seamless communication between tra...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Arial, Helvetica, sans-serif"> &l...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Metric Bio is recruiting on behalf of a San Francisco–based digital health company that is building an AI-powered platform to transform patient care and healthcare delivery.ML techniques to s...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Title : Data centric testing SME.Supply chain domain knowledge, Automation skills , Workday.Strong Data Centric Testing Background – ETL, ELT, SQL Queries, Reports Validation.Strong knowledge of BI ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Riddell is seeking a Senior Analytics Engineer to join the InSite Analytics team.The Senior Analytics Engineer is responsible for transforming raw data into views and models ready for reporting and...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Strong Data Centric Testing Background – ETL, ELT, SQL Queries, Reports Validation.Strong knowledge of BI report validation.
Strong QA foundation – Test Scenario, Test Case, Test Execution, Defect L...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Location : Chicago, Illinois (hybrid 1-2 days / week on-site).This position is part of the Employee UX (EUX) team and will collaborate closely with designers and UX project managers to create a best-i...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day 
Principal / Senior Machine Learning Engineer Position Type : FTE Location : San Francisco / Portland ,ME / Boston / Chicago / Seattle Salary Range : $ 20 0,000 - $ 270 , 000 (USD) Job ID# : ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Type : 6+ month contract to hire (C2H is a must have).Location : Willis Tower, downtown Chicago, IL - 5 days on-site, after conversion only 4 days on-site required.
This team is looking for someone pa...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Analyze and understand reporting requirements of various business streams.Develop BI reports using best practices and adhere to best performance standards.
Setup report security and user access to r...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days 
Tiger Analytics is an advanced analytics consulting firm.We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data.Our consultants b...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
If asked to describe the culture at Metropolitan Family Services, we could do that in one word.Reflected in both our internal culture as well as through the services we provide, community is at the...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
Position : AI / ML Engineer Duration : 12 months Lo...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
The ideal candidate will have strong expertise in.This role will focus on building intelligent applications that leverage data to generate insights, automate processes, and enable decision-making.A...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Position Title : Data Centric Testing.Salary : Base + Benefits + Relocation assistance.Hands on Experience in ETL automation (Query Surge / Ruby Cucumber / Informatica / Python).If interested please se...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
- serp_jobs.job_card.promoted
Lead EDI Analyst
Pierce Technology CorpWheeling, IL, USserp_jobs.job_card.full_time
monday.com is hiring : UX Researcher in Chicago
MediabistroChicago, IL, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Machine Learning Engineer
York Solutions, LLCChicago, IL, United Statesserp_jobs.job_card.full_time
AI Engineer
ManevaChicago, IL, USserp_jobs.filters.remote
serp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Generative AI Engineer
accentedge, LLCChicago, IL, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
EDI Analyst
Robert HalfLake Forest, IL, USserp_jobs.job_card.full_time
QA Engineer with Gen AI
Raks GroupChicago, IL, Illinois, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Machine Learning Engineer
Metric BioMundelein, IL, USserp_jobs.job_card.full_time
data centric testing sme
Two95 International Inc.Rosemont, IL, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
Senior Analytics Engineer
All American Sports CorporationDes Plaines, IL, USserp_jobs.job_card.full_time
DataCentric Testing
Two95 International Inc.Rosemont, IL, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Jobs via Dice is hiring : Senior UX Researcher in Chicago
MediabistroChicago, IL, United Statesserp_jobs.job_card.full_time
Principal / Senior Machine Learning Engineer
IntelliPro Group Inc.Chicago, IL, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
AI Machine Learning Engineer
York Solutions, LLCChicago, IL, United Statesserp_jobs.job_card.full_time +1
Tableau Consultant
Two95 International Inc.Chicago, IL, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Machine Learning Engineer
Tiger AnalyticsChicago, IL, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
- serp_jobs.job_card.promoted
- serp_jobs.job_card.new
ETL Developer
Metropolitan Family ServicesChicago, IL, USserp_jobs.job_card.full_time
AI / ML Engineer
Resource Point LLCChicago, IL, United Statesserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
AI Engineer
KonnectITChicago, Illinois, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Data Centric Testing
Two95 International Inc.Rosemont, IL, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply