Talent.com
Mercor is hiring : Audio Evaluation Expert - Fully Remote in Atlanta

Mercor is hiring : Audio Evaluation Expert - Fully Remote in Atlanta

MediabistroAtlanta, GA, United States
job_description.job_card.1_day_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
  • serp_jobs.filters.remote
job_description.job_card.job_description

1 day ago Be among the first 25 applicants

This range is provided by Mercor. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

$35.00 / hr - $40.00 / hr

Mercor Overview

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D\'Angelo, Larry Summers, and Jack Dorsey.

Role Overview

  • Position : Writing Expert – Freelance, Remote
  • Commitment : 20 hours per week, Duration : 1 month
  • Contribute to a high-impact audio AI research project. Author prompt–golden answer pairs for training and evaluating language models.

Responsibilities

  • Design and Optimize Prompts : Create detailed audio prompts with multiple constraints and instructions.
  • Define and Document Evaluation Standards : Establish high-level expectations for correct responses in general audio consumer contexts, and develop a comprehensive rubric.
  • Conduct Model Testing and Grading : Run prompts through models and assess preliminary outputs against expectations.
  • Support Benchmarking and Quality Assurance : Collaborate in QA review processes to ensure prompt tasks and rubrics meet rigor, maintaining consistency and reliability before integration into official benchmarks.
  • Requirements / Qualifications

  • Must-Have : BS or BA from a reputable institution, completed or in progress
  • Strong writing and critical thinking skills
  • Ability to work independently and meet deadlines
  • Significant familiarity with ChatGPT or similar tools for personal decision-making or hobbies
  • Preferred Qualifications

  • 2+ years of experience in teaching or research
  • Engagement Details

  • Remote and asynchronous role
  • 20 hours per week commitment
  • Duration : 1 month
  • Application Process

  • Complete an AI-led interview (about 15 minutes)
  • Complete a 45-minute written assessment to guide you through writing rubrics
  • If selected, you will be invited to work on the project
  • Resources & Support

  • For details about the interview process and platform information, please check : https : / / talent.docs.mercor.com / welcome / welcome
  • For any help or support, reach out to : support@mercor.com
  • PS : Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

    #J-18808-Ljbffr

    serp_jobs.job_alerts.create_a_job

    Is Hiring Evaluation • Atlanta, GA, United States

    Job_description.internal_linking.related_jobs
    • serp_jobs.job_card.promoted
    Remote AI Writing Evaluator

    Remote AI Writing Evaluator

    OutlierAtlanta, GA, United States
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time
    Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Travel MRI Tech - $2175.52 / Week

    Travel MRI Tech - $2175.52 / Week

    Atlas MedStaffFayetteville, GA, US
    serp_jobs.job_card.full_time
    Atlas MedStaff is seeking an experienced MRI Tech for an exciting Travel Allied job in Fayetteville, GA.Shift : 5x8 hr PMs Start Date : 11 / 10 / 2025 Duration : 14 weeks Pay : $2175.Atlas Medstaff is curr...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    AI Trainer Analyst

    AI Trainer Analyst

    VirtualVocationsNorcross, Georgia, United States
    serp_jobs.job_card.full_time
    A company is looking for an Agent Evaluation Analyst - AI Trainer.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missin...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    AI Data Specialist

    AI Data Specialist

    VirtualVocationsLawrenceville, Georgia, United States
    serp_jobs.job_card.full_time
    A company is looking for an AI Data Specialist to support the improvement of AI-generated content in English.Key Responsibilities Perform data collection, evaluation, and annotation Conduct pair...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Senior Threat Research Engineer

    Senior Threat Research Engineer

    VirtualVocationsNorcross, Georgia, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior Threat Research Engineer.Key Responsibilities Research novel cloud-based cyber attacks and report findings Develop threat intelligence based on malware analysis...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Travel MRI Tech - $1706.65 / Week

    Travel MRI Tech - $1706.65 / Week

    Atlas MedStaffDouglasville, GA, US
    serp_jobs.job_card.full_time
    Atlas MedStaff is seeking an experienced MRI Tech for an exciting Travel Allied job in Douglasville, GA.Shift : 3x12 hr nights Start Date : 10 / 20 / 2025 Duration : 13 weeks Pay : $1706.Atlas Medstaff is ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Google for Education Product Advisor

    Google for Education Product Advisor

    VirtualVocationsLawrenceville, Georgia, United States
    serp_jobs.job_card.full_time
    A company is looking for a Product Advisor - Google EDU.Key Responsibilities Support relationships with K12 Google for Education accounts and collaborate with sales teams Engage in pre-sales act...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    Audio Engineer | Upto $20 / hr Remote Job at Mercor in Atlanta

    Audio Engineer | Upto $20 / hr Remote Job at Mercor in Atlanta

    MediabistroAtlanta, GA, United States
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time
    Audio Engineer | Upto $20 / hr Remote.This range is provided by Mercor.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Headquartered in San Franci...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    Customer Training Specialist

    Customer Training Specialist

    VirtualVocationsLawrenceville, Georgia, United States
    serp_jobs.job_card.full_time
    A company is looking for a Customer Training and Enablement Specialist.Key Responsibilities Conduct live training sessions tailored to different customer segments to facilitate effective platform...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    Paid Search Specialist

    Paid Search Specialist

    VirtualVocationsLawrenceville, Georgia, United States
    serp_jobs.job_card.full_time
    A company is looking for a Paid Search Specialist (Remote Friendly).Key Responsibilities Manage daily paid search campaigns on Google and Bing, including ongoing account maintenance Create and o...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    B2B Growth Strategist

    B2B Growth Strategist

    VirtualVocationsLawrenceville, Georgia, United States
    serp_jobs.job_card.full_time
    A company is looking for a B2B Growth Strategist for the Duolingo English Test.Key Responsibilities Map and document the full agent referral funnel from lead registration to student referrals Id...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    Research Specialist

    Research Specialist

    VirtualVocationsAlpharetta, Georgia, United States
    serp_jobs.job_card.full_time
    A company is looking for a Research Specialist (MX).Key Responsibilities Research healthcare continuing education and licensing requirements to maintain an accurate training library Track change...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Mixed-Method UX Researcher

    Mixed-Method UX Researcher

    VirtualVocationsLawrenceville, Georgia, United States
    serp_jobs.job_card.full_time
    A company is looking for a Mixed-Method UX Researcher.Key Responsibilities : Develop and share detailed research plans with stakeholders Select appropriate research methods for projects, includin...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    California Licensed UX Researcher

    California Licensed UX Researcher

    VirtualVocationsNorcross, Georgia, United States
    serp_jobs.job_card.full_time
    A company is looking for a UX Researcher to join their team of technology consultants.Key Responsibilities Support the product design team in an iterative, user-centered design process Lead rese...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Online Program Evaluation Instructor

    Online Program Evaluation Instructor

    VirtualVocationsDecatur, Georgia, United States
    serp_jobs.job_card.part_time
    A company is looking for a Part-Time Faculty member to teach SWK 775 (M700) Program Evaluation for Spring 2026.Key Responsibilities Developing and / or updating a class syllabus Preparing lectures...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Physics Expert for AI Training

    Physics Expert for AI Training

    VirtualVocationsLawrenceville, Georgia, United States
    serp_jobs.job_card.full_time
    A company is looking for an Advanced Physics Expert for AI Training.Key Responsibilities Evaluate AI-generated content for factual accuracy and relevance in Physics Develop and answer Physics-re...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    CT Technologist Reg, FT Nights

    CT Technologist Reg, FT Nights

    Wellstar Health Systems, Inc.Marietta, GA, United States
    serp_jobs.job_card.full_time
    How would you like to work in a place where your contributions and ideas are valued? A place where you can serve with compassion, pursue excellence and honor every voice? At Wellstar, our mission i...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    CT Tech Reg, FT Various

    CT Tech Reg, FT Various

    Wellstar Health Systems, Inc.Marietta, GA, US
    serp_jobs.job_card.full_time
    How would you like to work in a place where your contributions and ideas are valued? A place where you can serve with compassion, pursue excellence and honor every voice? At Wellstar, our mission i...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30