Talent.com
Audio Evaluation Expert - Fully Remote Job at Mercor in Los Angeles

Audio Evaluation Expert - Fully Remote Job at Mercor in Los Angeles

MediabistroLos Angeles, CA, United States
job_description.job_card.variable_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
  • serp_jobs.filters.remote
job_description.job_card.job_description

1 day ago Be among the first 25 applicants

This range is provided by Mercor. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

$35.00 / hr - $40.00 / hr

Mercor Overview

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D\'Angelo, Larry Summers, and Jack Dorsey.

Role Overview

  • Position : Writing Expert – Freelance, Remote
  • Commitment : 20 hours per week, Duration : 1 month
  • Contribute to a high-impact audio AI research project. Author prompt–golden answer pairs for training and evaluating language models.

Responsibilities

  • Design and Optimize Prompts : Create detailed audio prompts with multiple constraints and instructions.
  • Define and Document Evaluation Standards : Establish high-level expectations for correct responses in general audio consumer contexts, and develop a comprehensive rubric.
  • Conduct Model Testing and Grading : Run prompts through models and assess preliminary outputs against expectations.
  • Support Benchmarking and Quality Assurance : Collaborate in QA review processes to ensure prompt tasks and rubrics meet rigor, maintaining consistency and reliability before integration into official benchmarks.
  • Requirements / Qualifications

  • Must-Have : BS or BA from a reputable institution, completed or in progress
  • Strong writing and critical thinking skills
  • Ability to work independently and meet deadlines
  • Significant familiarity with ChatGPT or similar tools for personal decision-making or hobbies
  • Preferred Qualifications

  • 2+ years of experience in teaching or research
  • Engagement Details

  • Remote and asynchronous role
  • 20 hours per week commitment
  • Duration : 1 month
  • Application Process

  • Complete an AI-led interview (about 15 minutes)
  • Complete a 45-minute written assessment to guide you through writing rubrics
  • If selected, you will be invited to work on the project
  • Resources & Support

  • For details about the interview process and platform information, please check : https : / / talent.docs.mercor.com / welcome / welcome
  • For any help or support, reach out to : support@mercor.com
  • PS : Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

    #J-18808-Ljbffr

    serp_jobs.job_alerts.create_a_job

    Audio Evaluation Job • Los Angeles, CA, United States

    Job_description.internal_linking.related_jobs
    • serp_jobs.job_card.promoted
    Physics Expert for AI Training

    Physics Expert for AI Training

    VirtualVocationsOrange, California, United States
    serp_jobs.job_card.full_time
    A company is looking for an Advanced Physics Expert for AI Training.Key Responsibilities Evaluate AI-generated content for factual accuracy and relevance in Physics Develop and answer Physics-re...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    Crossing Hurdles is hiring : Audio Specialist | $20 / hr Remote in Los Angeles

    Crossing Hurdles is hiring : Audio Specialist | $20 / hr Remote in Los Angeles

    MediabistroLos Angeles, CA, United States
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time
    Audio Specialist | $20 / hr Remote.This range is provided by Crossing Hurdles.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.Crossing Hurdles is ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    Turing is hiring : Remote Audio Annotation Specialist (AI Training) - 33328 in Lo

    Turing is hiring : Remote Audio Annotation Specialist (AI Training) - 33328 in Lo

    MediabistroLos Angeles, CA, United States
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time
    Be among the first 25 applicants.Turing is an AI-powered tech services company with a mission to accelerate AGI advancement and deployment by bridging the gap between global talent from 100+ countr...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Research Specialist

    Research Specialist

    VirtualVocationsSignal Hill, California, United States
    serp_jobs.job_card.full_time
    A company is looking for a Research Specialist (MX).Key Responsibilities Research healthcare continuing education and licensing requirements to maintain an accurate training library Track change...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Biology Expert for AI Training

    Biology Expert for AI Training

    VirtualVocationsBurbank, California, United States
    serp_jobs.job_card.full_time
    A company is looking for an Advanced Biology Expert for AI Training.Key Responsibilities Evaluate AI-generated content for factual accuracy and relevance in Biology Develop and answer Biology-re...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    Audio Model Trainer - English Expert | Upto $20 / hr Remote Job at Mercor in Los A

    Audio Model Trainer - English Expert | Upto $20 / hr Remote Job at Mercor in Los A

    MediabistroLos Angeles, CA, United States
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time
    Audio Model Trainer - English Expert | Upto $20 / hr Remote.This range is provided by Mercor.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.Merco...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Online Program Evaluation Instructor

    Online Program Evaluation Instructor

    VirtualVocationsOrange, California, United States
    serp_jobs.job_card.part_time
    A company is looking for a Part-Time Faculty member to teach SWK 775 (M700) Program Evaluation for Spring 2026.Key Responsibilities Developing and / or updating a class syllabus Preparing lectures...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Customer Training Specialist

    Customer Training Specialist

    VirtualVocationsOrange, California, United States
    serp_jobs.job_card.full_time
    A company is looking for a Customer Training and Enablement Specialist.Key Responsibilities Conduct live training sessions tailored to different customer segments to facilitate effective platform...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    English Content Reviewer

    English Content Reviewer

    VirtualVocationsCarson, California, United States
    serp_jobs.job_card.full_time
    A company is looking for English Writing and Content Reviewing Expertise for AI Training.Key Responsibilities Produce natural data to meet realistic AI usage needs Evaluate and rank outputs from...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Remote Finance Advisor - AI Trainer

    Remote Finance Advisor - AI Trainer

    Data AnnotationCarson, California
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    AI Trainer Analyst

    AI Trainer Analyst

    VirtualVocationsHuntington Beach, California, United States
    serp_jobs.job_card.full_time
    A company is looking for an Agent Evaluation Analyst - AI Trainer.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missin...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    AI Data Specialist

    AI Data Specialist

    VirtualVocationsGarden Grove, California, United States
    serp_jobs.job_card.full_time
    A company is looking for an AI Data Specialist to support the improvement of AI-generated content in English.Key Responsibilities Perform data collection, evaluation, and annotation Conduct pair...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    Mercor is hiring : Audio Engineer | Upto $20 / hr Remote in Los Angeles

    Mercor is hiring : Audio Engineer | Upto $20 / hr Remote in Los Angeles

    MediabistroLos Angeles, CA, United States
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time
    Audio Engineer | Upto $20 / hr Remote.This range is provided by Mercor.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Headquartered in San Franci...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    Audio & Sound Specialist | $20 / hr Remote Job at Crossing Hurdles in Los Angeles

    Audio & Sound Specialist | $20 / hr Remote Job at Crossing Hurdles in Los Angeles

    MediabistroLos Angeles, CA, United States
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time
    Audio & Sound Specialist | $20 / hr Remote.Join Crossing Hurdles as an Audio & Sound Specialist.Crossing Hurdles is a recruitment firm that refers top candidates to partners working with the world’s ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Mixed-Method UX Researcher

    Mixed-Method UX Researcher

    VirtualVocationsCarson, California, United States
    serp_jobs.job_card.full_time
    A company is looking for a Mixed-Method UX Researcher.Key Responsibilities : Develop and share detailed research plans with stakeholders Select appropriate research methods for projects, includin...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    Audio Quality Evaluation (French - US) Job at Appen in Los Angeles

    Audio Quality Evaluation (French - US) Job at Appen in Los Angeles

    MediabistroLos Angeles, CA, United States
    serp_jobs.job_card.full_time
    Audio Quality Evaluation (French - US).Be the Voice of the Future – Join Project Lotus Today.Are you a native French speaker living in the U. Help shape the future of wearable tech by evaluating sma...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Google for Education Product Advisor

    Google for Education Product Advisor

    VirtualVocationsOrange, California, United States
    serp_jobs.job_card.full_time
    A company is looking for a Product Advisor - Google EDU.Key Responsibilities Support relationships with K12 Google for Education accounts and collaborate with sales teams Engage in pre-sales act...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    Audio Engineer - Fully Remote Job at Mercor in Los Angeles

    Audio Engineer - Fully Remote Job at Mercor in Los Angeles

    MediabistroLos Angeles, CA, United States
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time
    This range is provided by Mercor.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Headquartered in San Francisco, our investors include.Audio, Mu...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days