AI Agent Evaluation Analyst
VirtualVocationsLouisville, Kentucky, United Statesjob_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
- serp_jobs.job_card.full_time
job_description.job_card.job_description
A company is looking for an AI Agent Evaluation Analyst.
Key Responsibilities
Review evaluation tasks and scenarios for logic, completeness, and realism
Identify inconsistencies, missing assumptions, or unclear decision points
Help define clear expected behaviors for AI agents
Required Qualifications
Excellent analytical thinking regarding complex systems and logical implications
Familiarity with structured data formats like JSON / YAML
Experience with policy evaluation, logic puzzles, or structured scenario design
Background in consulting, academia, or research
Some understanding of scoring or evaluation in agent testing
serp_jobs.job_alerts.create_a_job
Ai Analyst • Louisville, Kentucky, United States
Job_description.internal_linking.related_jobs
Posted Tuesday, August 12, 2025 at 6 : 00 AM.Come join the dynamic team at Kestra Financial! Kestra Financial provides a leading independent advisor platform that empowers sophisticated, independent ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Join a collaborative remote team working to make AI communication emotionally intelligent, culturally aware, and engaging.
Score AI messages for tone, empathy, and contextual awareness.Identify subt...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Compliance - Advertising Analyst.Be among the first 25 applicants.Compliance - Advertising Analyst.Come join the dynamic team at Kestra Financial! Kestra Financial provides a leading independent ad...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days RYNO Strategic Solutions is an innovative, full-service digital marketing company with 350+ RYNOs offering exceptional internet marketing services since 2008.
We stay ahead of our competition with t...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days 
Refined Medical Staffing is seeking a travel CT Technologist for a travel job in Madison, Indiana.Job Description & Requirements.
Refined Medical Staffing Job ID #36434506.Pay package is based o...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Uniti Med is seeking an experienced CT Tech for an exciting Travel Allied job in Madison, IN.Shift : Inquire Start Date : 10 / 26 / 2025 Duration : 13 weeks Pay : $2808 / Week.
Uniti Med provides career opp...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
Turn your passion for luxury into a career opportunity.Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles.
Join CXG, the global leader in custo...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Firstsource Solutions is a leading provider of customized Business Process Management (BPM) services.Firstsource specializes in helping customers stay ahead of the curve through transformational so...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days 
Cynet Health is seeking an experienced CT Tech for an exciting Travel Allied job in Madison, IN.Shift : 3x12 hr days Start Date : 10 / 26 / 2025 Duration : 13 weeks Pay : $2650 / Week.Ranked #5 Best Travel...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Be among the first 25 applicants.This range is provided by Mercor.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.
Mercor connects elite creative...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Press Tab to Move to Skip to Content Link.Select how often (in days) to receive an alert : .We are seeking a talented and detail-oriented Visual Data Evaluator to join our team.The ideal candidate wi...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Position at Ziff Davis Shopping.The Opportunity : We are looking for a data-driven and detail-oriented SEO Analyst to join our team.
The ideal candidate will have a strong understanding of SEO best p...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days 
PeopleMed a division of All About People is seeking a travel CT Technologist for a travel job in Madison, Indiana.Job Description & Requirements.
Must reside 75 miles from facility for travel ra...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
We are seeking an Inventory Analyst with additional specialized skills to join our growing team in Jeffersonville, IN.This hybrid role spans hands-on warehouse research and technical reporting and ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Statistical Analyst / Graphics Developer (Remote).This is a remote position (100% remote for candidates based in the United States or Canada).
The Athletic is looking for a journalist with experience...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours Become a Luxury Brand Evaluator in San Juan, PR - Apply Now.Turn your passion for luxury into a career opportunity.Explore the world of premium brands and make a lasting impact in fashion, beauty, ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days 
Join the GE Appliances Cost of Quality (COQ) team and make an impact by turning complex data into meaningful insights that drive improvement across our factories.
As an Associate Quality Analyst, yo...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days At Definitive Healthcare (NASDAQ : DH), we’re passionate about turning data, analytics, and expertise into meaningful intelligence that helps our customers achieve success and shape the future of he...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Audio Model Trainer - English Expert | Upto $20 / hr Remote.This range is provided by Mercor.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.Merco...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days 
TRS Healthcare is seeking a travel CT Technologist for a travel job in Madison, Indiana.Job Description & Requirements.TRS Healthcare Job ID #1376216.
Pay package is based on 12 hour shifts and ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
Kestra PWS is hiring : Compliance - Advertising Analyst in Louisville
MediabistroLouisville, KY, United Statesserp_jobs.job_card.full_time +1
AI Communication Quality & Culture Evaluator Job at Hireio, Inc. in Louisville
MediabistroLouisville, KY, United Statesserp_jobs.job_card.full_time
Compliance - Advertising Analyst Job at Kestra Financial in Louisville
MediabistroLouisville, KY, United Statesserp_jobs.job_card.full_time +1
Ryno Strategic Solutions, LLC. is hiring : SEO Analyst in Louisville
MediabistroLouisville, KY, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Travel CT Technologist
Refined Medical StaffingMadison, IN, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Travel CT Tech - $2808 / Week
Uniti MedMadison, IN, USserp_jobs.job_card.full_time
Freelance Luxury Brand Evaluator - Kentucky, US
CXGBRWNSBORO VLG, KY, USserp_jobs.filters.remote
serp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
AI Content Creator Job at Firstsource Solutions Ltd in Louisville
MediabistroLouisville, KY, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Travel CT Tech - $2650 / Week
Cynet HealthMadison, IN, USserp_jobs.job_card.full_time
Mercor is hiring : Audio Evaluation Expert - Fully Remote in Louisville
MediabistroLouisville, KY, United Statesserp_jobs.filters.remote
serp_jobs.job_card.full_time
Visual Data Evaluator Job at Firstsource Solutions Ltd in Louisville
MediabistroLouisville, KY, United Statesserp_jobs.job_card.full_time
Jr SEO Analyst Job at Ziff Davis in Louisville
MediabistroLouisville, KY, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Travel CT Technologist
PeopleMed a division of All About PeopleMadison, IN, USserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Inventory Data Analyst
Tellworks LogisticsJeffersonville, IN, USserp_jobs.job_card.full_time
- serp_jobs.job_card.new
Statistical Analyst / Graphics Developer (Remote) Job at The Athletic in Louisvil
MediabistroLouisville, KY, United Statesserp_jobs.filters.remote
serp_jobs.job_card.full_time
Become a Luxury Brand Evaluator in San Juan, PR- Apply Now Job at CXG in Louisvi
MediabistroLouisville, KY, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Associate Quality Analyst
GE AppliancesLouisville, KY, USserp_jobs.job_card.full_time
Digital Media & Audience Analyst Job at Definitive Healthcare in Louisville
MediabistroLouisville, KY, United Statesserp_jobs.job_card.full_time
Audio Model Trainer - English Expert | Upto $20 / hr Remote Job at Mercor in Louis
MediabistroLouisville, KY, United Statesserp_jobs.filters.remote
serp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Travel CT Technologist
TRS HealthcareMadison, IN, USserp_jobs.job_card.full_time