Talent.com
Mercor is hiring : Audio Evaluation Expert - Fully Remote in Town of Texas

Mercor is hiring : Audio Evaluation Expert - Fully Remote in Town of Texas

MediabistroTown of Texas, WI, United States
job_description.job_card.1_day_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
  • serp_jobs.filters.remote
job_description.job_card.job_description

1 day ago Be among the first 25 applicants

This range is provided by Mercor. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

$35.00 / hr - $40.00 / hr

Mercor Overview

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D\'Angelo, Larry Summers, and Jack Dorsey.

Role Overview

  • Position : Writing Expert – Freelance, Remote
  • Commitment : 20 hours per week, Duration : 1 month
  • Contribute to a high-impact audio AI research project. Author prompt–golden answer pairs for training and evaluating language models.

Responsibilities

  • Design and Optimize Prompts : Create detailed audio prompts with multiple constraints and instructions.
  • Define and Document Evaluation Standards : Establish high-level expectations for correct responses in general audio consumer contexts, and develop a comprehensive rubric.
  • Conduct Model Testing and Grading : Run prompts through models and assess preliminary outputs against expectations.
  • Support Benchmarking and Quality Assurance : Collaborate in QA review processes to ensure prompt tasks and rubrics meet rigor, maintaining consistency and reliability before integration into official benchmarks.
  • Requirements / Qualifications

  • Must-Have : BS or BA from a reputable institution, completed or in progress
  • Strong writing and critical thinking skills
  • Ability to work independently and meet deadlines
  • Significant familiarity with ChatGPT or similar tools for personal decision-making or hobbies
  • Preferred Qualifications

  • 2+ years of experience in teaching or research
  • Engagement Details

  • Remote and asynchronous role
  • 20 hours per week commitment
  • Duration : 1 month
  • Application Process

  • Complete an AI-led interview (about 15 minutes)
  • Complete a 45-minute written assessment to guide you through writing rubrics
  • If selected, you will be invited to work on the project
  • Resources & Support

  • For details about the interview process and platform information, please check : https : / / talent.docs.mercor.com / welcome / welcome
  • For any help or support, reach out to : support@mercor.com
  • PS : Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

    #J-18808-Ljbffr

    serp_jobs.job_alerts.create_a_job

    Is Hiring Evaluation • Town of Texas, WI, United States

    Job_description.internal_linking.related_jobs
    Audio Evaluation Expert - Fully Remote Job at Mercor in Dallas

    Audio Evaluation Expert - Fully Remote Job at Mercor in Dallas

    MediabistroDallas, TX, United States
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time
    Be among the first 25 applicants.This range is provided by Mercor.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Mercor connects elite creative...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    Neurophysiology Tech FT

    Neurophysiology Tech FT

    Methodist Health SystemRichardson, TX, US
    serp_jobs.job_card.full_time
    M-F plus rotating on-call and weekends.X5 Day (United States of America).The Neurophysiology Tech II professional responsible for performing standard and complex electrophysiology studies including...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Sales Representative (Remote)

    Sales Representative (Remote)

    American Income LifeWaxahachie, TX, US
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time
    American Income Life is growing! We are seeking ambitious individuals who are driven to build their own business while also leaving a positive impact within the community they serve.American Income...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Remote AI Writing Evaluator

    Remote AI Writing Evaluator

    OutlierDallas, TX, United States
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time
    Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    AI Trainer Analyst

    AI Trainer Analyst

    VirtualVocationsCarrollton, Texas, United States
    serp_jobs.job_card.full_time
    A company is looking for an Agent Evaluation Analyst - AI Trainer.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missin...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    California Licensed UX Researcher

    California Licensed UX Researcher

    VirtualVocationsCarrollton, Texas, United States
    serp_jobs.job_card.full_time
    A company is looking for a UX Researcher to join their team of technology consultants.Key Responsibilities Support the product design team in an iterative, user-centered design process Lead rese...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    Customer Training Specialist

    Customer Training Specialist

    VirtualVocationsGrand Prairie, Texas, United States
    serp_jobs.job_card.full_time
    A company is looking for a Customer Training and Enablement Specialist.Key Responsibilities Conduct live training sessions tailored to different customer segments to facilitate effective platform...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    Video Filtering Expert

    Video Filtering Expert

    Mercor IncDallas, TX, United States
    serp_jobs.job_card.full_time
    Role Overview Mercor is partnering with a frontier AI lab to support the evaluation of AI-generated videos.We are seeking detail-oriented video rating experts to assess whether visual outputs from ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Impact Evaluation Manager

    Impact Evaluation Manager

    Wounded Warrior ProjectDallas, TX, United States
    serp_jobs.job_card.full_time
    We know these are some of the things people look for in a job.If you're the kind of person who believes that honoring and empowering our nation's veterans is more than just a cause - that it's a ca...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    Mercor is hiring : Audio Engineer | Upto $20 / hr Remote in Town of Texas

    Mercor is hiring : Audio Engineer | Upto $20 / hr Remote in Town of Texas

    MediabistroTown of Texas, WI, United States
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time
    Audio Engineer | Upto $20 / hr Remote.This range is provided by Mercor.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Headquartered in San Franci...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    Travel Audiologist - $2,639 per week in Edinburg, TX

    Travel Audiologist - $2,639 per week in Edinburg, TX

    AlliedTravelCareersDallas, Texas, US
    serp_jobs.job_card.full_time
    AlliedTravelCareers is working with Triage Staffing LLC to find a qualified Audiologist in Edinburg, Texas, 78539!.Travel Rehab : Audiology Edinburg. Shift Details : 8H Days (12 : 00 AM-12 : 00 PM).Leng...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Customer Engagement Advisor

    Customer Engagement Advisor

    VirtualVocationsGrand Prairie, Texas, United States
    serp_jobs.job_card.full_time
    A company is looking for an Advisor to serve as the first point of contact for customers throughout their journey.Key Responsibilities Help customers grow and achieve goals while strengthening th...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    B2B Growth Strategist

    B2B Growth Strategist

    VirtualVocationsCarrollton, Texas, United States
    serp_jobs.job_card.full_time
    A company is looking for a B2B Growth Strategist for the Duolingo English Test.Key Responsibilities Map and document the full agent referral funnel from lead registration to student referrals Id...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Survey Taker : Earn up to $25 per survey (Remote)

    Survey Taker : Earn up to $25 per survey (Remote)

    Earn HausEnnis, TX, United States
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time +1
    Looking for people to participate in taking online surveys for Fortune 500 brands.All you need to do is complete online surveys by sharing your opinion. You will help influence brand decisions on se...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Travel Audiologist - $2,672 per week in Edinburg, TX

    Travel Audiologist - $2,672 per week in Edinburg, TX

    AlliedTravelCareersDallas, Texas, US
    serp_jobs.job_card.full_time
    AlliedTravelCareers is working with Medical Solutions to find a qualified Audiologist in Edinburg, Texas, 78539!.A facility in Edinburg, TX is seeking its next amazing Audiologist.Read on if this s...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    AV Project Engineer

    AV Project Engineer

    TEKsystemsPlano, TX, United States
    serp_jobs.job_card.temporary
    Job Title : • AV Project Engineer •Job Category : • Audio Visual Engineering / Technical Project Management.Contract Type : • 6-Month Contract-to-Hire. Recruiting Partner : • TEKsystems.Overview : • We are se...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    Research Specialist

    Research Specialist

    VirtualVocationsCarrollton, Texas, United States
    serp_jobs.job_card.full_time
    A company is looking for a Research Specialist (MX).Key Responsibilities Research healthcare continuing education and licensing requirements to maintain an accurate training library Track change...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Remote Finance Advisor - AI Trainer

    Remote Finance Advisor - AI Trainer

    Data AnnotationRockwall, Texas
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days