Talent.com
Mercor is hiring : Audio Evaluation Expert - Fully Remote in Boston

Mercor is hiring : Audio Evaluation Expert - Fully Remote in Boston

MediabistroBoston, MA, United States
job_description.job_card.variable_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
  • serp_jobs.filters.remote
job_description.job_card.job_description

1 day ago Be among the first 25 applicants

This range is provided by Mercor. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

$35.00 / hr - $40.00 / hr

Mercor Overview

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D\'Angelo, Larry Summers, and Jack Dorsey.

Role Overview

  • Position : Writing Expert – Freelance, Remote
  • Commitment : 20 hours per week, Duration : 1 month
  • Contribute to a high-impact audio AI research project. Author prompt–golden answer pairs for training and evaluating language models.

Responsibilities

  • Design and Optimize Prompts : Create detailed audio prompts with multiple constraints and instructions.
  • Define and Document Evaluation Standards : Establish high-level expectations for correct responses in general audio consumer contexts, and develop a comprehensive rubric.
  • Conduct Model Testing and Grading : Run prompts through models and assess preliminary outputs against expectations.
  • Support Benchmarking and Quality Assurance : Collaborate in QA review processes to ensure prompt tasks and rubrics meet rigor, maintaining consistency and reliability before integration into official benchmarks.
  • Requirements / Qualifications

  • Must-Have : BS or BA from a reputable institution, completed or in progress
  • Strong writing and critical thinking skills
  • Ability to work independently and meet deadlines
  • Significant familiarity with ChatGPT or similar tools for personal decision-making or hobbies
  • Preferred Qualifications

  • 2+ years of experience in teaching or research
  • Engagement Details

  • Remote and asynchronous role
  • 20 hours per week commitment
  • Duration : 1 month
  • Application Process

  • Complete an AI-led interview (about 15 minutes)
  • Complete a 45-minute written assessment to guide you through writing rubrics
  • If selected, you will be invited to work on the project
  • Resources & Support

  • For details about the interview process and platform information, please check : https : / / talent.docs.mercor.com / welcome / welcome
  • For any help or support, reach out to : support@mercor.com
  • PS : Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

    #J-18808-Ljbffr

    serp_jobs.job_alerts.create_a_job

    Is Hiring Evaluation • Boston, MA, United States

    Job_description.internal_linking.related_jobs
    • serp_jobs.job_card.promoted
    Travel Physical Therapist - $2,700 per week

    Travel Physical Therapist - $2,700 per week

    CompHealth Inc.Scituate, MA, United States
    serp_jobs.job_card.full_time +1
    Physical Therapist for a travel job in Scituate, Massachusetts.Job Description & Requirements.CompHealth services are always free to you. Let us do the heavy lifting and handle the headache of crede...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Travel Physical Therapist - $2,141 per week

    Travel Physical Therapist - $2,141 per week

    Uniti MedScituate, MA, United States
    serp_jobs.job_card.full_time
    Uniti Med is seeking a travel Physical Therapist for a travel job in Scituate, Massachusetts.Job Description & Requirements. Uniti Med is looking for a Travel Physical Therapist (PT) in Scituate, MA...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Travel Physical Therapist

    Travel Physical Therapist

    Medical Solutions AlliedScituate, MA, US
    serp_jobs.job_card.full_time
    Medical Solutions Allied is seeking a travel Physical Therapist for a travel job in Scituate, Massachusetts.Job Description & Requirements. We’re seeking talented healthcare professionals ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Travel Physical Therapist

    Travel Physical Therapist

    CompHealth Inc.Scituate, MA, US
    serp_jobs.job_card.permanent
    Physical Therapist for a travel job in Scituate, Massachusetts.Job Description & Requirements.CompHealth services are always free to you. Let us do the heavy lifting and handle the headache of c...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    Physical Therapist (PT) with valid license in Iowa.

    Physical Therapist (PT) with valid license in Iowa.

    MedAdventuresRockport, MA, United States
    serp_jobs.job_card.full_time
    Physical Therapist Role $2,219 to $2,319 per week Position Overview : Medadventures is seeking a compassionate and dedicated Physical Therapist (PT) to provide high-quality rehabilitative care in a ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    Entry Level Retail Merchandiser (Create Your Own Schedule)

    Entry Level Retail Merchandiser (Create Your Own Schedule)

    Spar GroupPlymouth, MA, US
    serp_jobs.job_card.part_time
    Come join SFS as a Retail Merchandiser independent contractor and enjoy all the benefits of creating your own schedule.This flexible environment is created by the clients we service, they provide a...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    Sales Representative (Remote)

    Sales Representative (Remote)

    American Income LifeGloucester, MA, US
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time
    A Sales Career That Grows With You.Are you looking for a career path that gives you the freedom and flexibility to control your schedule, but also has the security and stability of a large company?...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Traveling Retail Merchandiser

    Traveling Retail Merchandiser

    SAS Retail ServicesScituate, MA, US
    serp_jobs.job_card.full_time
    We want you to help us shape the future of shopping experiences and deliver on our purpose of connecting people with the products and experiences that enrich their lives. Joining SAS Retail Services...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Clinical Application Specialist

    Clinical Application Specialist

    SentecLincoln, RI, US
    serp_jobs.job_card.full_time
    Clinical Application Specialist (CAS).In this position, you’ll provide hands-on and virtual education to clinicians in Rhode Island, working in close partnership with our.Continuing Education...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Share Your Thoughts, Pocket Some Cash : Join Opinion Outpost's Survey Opportunities!

    Share Your Thoughts, Pocket Some Cash : Join Opinion Outpost's Survey Opportunities!

    DynataGloucester, MA, United States
    serp_jobs.job_card.full_time
    Ready to turn your opinions into cash? Explore the world of remote paid online survey gigs with Opinion Outpost!.It's as simple as sharing your thoughts from the comfort of your own home and watchi...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    Tax Expert

    Tax Expert

    IntuitESSEX, MA, US
    serp_jobs.job_card.full_time
    Intuit is seeking highly motivated individuals to join our dynamic team as dedicated TurboTax Live Seasonal Local Service Experts in one of our new TurboTax locations across the United States on a ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    Employment Specialist

    Employment Specialist

    Youre With US IncSalem, MA, US
    serp_jobs.job_card.full_time
    You’re With Us! Employment Specialist Job Description.You’re With Us! is a registered 501 (c)(3) non-profit organization and Department of Developmental Services (DDS) service provider ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Travel Physical Therapist - $2,142 per week

    Travel Physical Therapist - $2,142 per week

    The Good Life MedStaffScituate, MA, United States
    serp_jobs.job_card.full_time
    The Good Life MedStaff is seeking a travel Physical Therapist for a travel job in Scituate, Massachusetts.Job Description & Requirements. The Good Life MedStaff Job ID #33803051.Pay package is based...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    Audio Engineer | Upto $20 / hr Remote Job at Mercor in Boston

    Audio Engineer | Upto $20 / hr Remote Job at Mercor in Boston

    MediabistroBoston, MA, United States
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time
    Audio Engineer | Upto $20 / hr Remote.This range is provided by Mercor.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Headquartered in San Franci...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    Audio Engineer - Fully Remote Job at Mercor in Boston

    Audio Engineer - Fully Remote Job at Mercor in Boston

    MediabistroBoston, MA, United States
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time
    This range is provided by Mercor.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Headquartered in San Francisco, our investors include.Audio, Mu...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Product Evaluation Manager

    Product Evaluation Manager

    Axcelis TechnologiesBeverly, MA, US
    serp_jobs.job_card.full_time
    The Product Evaluation Manager is responsible for overseeing the deployment, tracking, and analysis of product evaluation units with key customers or partners. This role ensures that evaluation prog...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Regional Sales - Boston / New England - Audio / Visual

    Regional Sales - Boston / New England - Audio / Visual

    Michael PageBoston, MA, US
    serp_jobs.job_card.full_time
    An innovator in sound masking solutions is expanding its U.Sales Manager to cover the New England territory.This company's patented acoustic technologies are trusted by Fortune 1000 organizations t...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Survey Taker : Earn up to $25 per survey (Remote)

    Survey Taker : Earn up to $25 per survey (Remote)

    Earn HausHaverhill, MA, United States
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time +1
    Looking for people to participate in taking online surveys for Fortune 500 brands.All you need to do is complete online surveys by sharing your opinion. You will help influence brand decisions on se...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30