Audio Evaluation Expert - Fully Remote Job at Mercor in Minneapolis
MediabistroMinneapolis, MN, United Statesjob_description.job_card.variable_days_ago
serp_jobs.job_preview.job_type
- serp_jobs.job_card.full_time
- serp_jobs.filters.remote
job_description.job_card.job_descriptionDesign and Optimize Prompts : Create detailed audio prompts with multiple constraints and instructions. Define and Document Evaluation Standards : Establish high-level expectations for correct responses in general audio consumer contexts, and develop a comprehensive rubric. Conduct Model Testing and Grading : Run prompts through models and assess preliminary outputs against expectations. Support Benchmarking and Quality Assurance : Collaborate in QA review processes to ensure prompt tasks and rubrics meet rigor, maintaining consistency and reliability before integration into official benchmarks. Must-Have : BS or BA from a reputable institution, completed or in progress Strong writing and critical thinking skills Ability to work independently and meet deadlines Significant familiarity with ChatGPT or similar tools for personal decision-making or hobbies 2+ years of experience in teaching or research Remote and asynchronous role 20 hours per week commitment Duration : 1 month Complete an AI-led interview (about 15 minutes) Complete a 45-minute written assessment to guide you through writing rubrics If selected, you will be invited to work on the project For details about the interview process and platform information, please check : https : / / talent.docs.mercor.com / welcome / welcome For any help or support, reach out to : support@mercor.com
1 day ago Be among the first 25 applicants
This range is provided by Mercor. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.
Base pay range
$35.00 / hr - $40.00 / hr
Mercor Overview
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D\'Angelo, Larry Summers, and Jack Dorsey.
Role Overview
- Position : Writing Expert – Freelance, Remote
- Commitment : 20 hours per week, Duration : 1 month
- Contribute to a high-impact audio AI research project. Author prompt–golden answer pairs for training and evaluating language models.
Responsibilities
Requirements / Qualifications
Preferred Qualifications
Engagement Details
Application Process
Resources & Support
PS : Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
#J-18808-Ljbffr
serp_jobs.job_alerts.create_a_job
Audio Evaluation Job • Minneapolis, MN, United States
Job_description.internal_linking.related_jobs Language Services Associates is looking for US based Quechuainterpreters for our remote video interpretation service line.
As a member of LSA’s network of Independently Contracted Interpreters, you ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days 
Bravas is the #1 traditional custom integrator nationwide, installing and servicing high-end home automation solutions for predominantly residential customers.
Focused on the luxury market, Bravas c...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Phoenix Support Services, established in 2019 and located in the Philippines, is the in-house support center of Advanced Digital Media Services—a startup full-service digital marketing company in t...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days A company is looking for a UGC Content Creator & Freelance Actor / Anchor.Collaborate with clients to understand brand identity and content objectives.
Conduct research on topics to ensure accurate pr...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Black Power wants to use your voice! Has anyone ever told you that you have a voice for radio?! If that's you, #BP96 is looking for dynamic voices to populate our airwaves! We can also train person...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days 
Sports (Dance) Videographer / Camera Operator.Nationwide travel across the U.DanceBUG is the industry leader in Dance Media and Software, with nearly 25 years of innovation serving the dance commun...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Every day at Disney Cruise Line we take pride in bringing the magic of Disney to life.We find joy in creating cherished memories and form genuine connections with our guests.We hold each other to t...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Bravas is the #1 traditional custom integrator nationwide, installing and servicing high-end home automation solutions for predominantly residential customers.
Focused on the luxury market, Bravas c...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Remote Sound Technicians and Broadcast Technicians - USA.Common Lives Project, a research program using wearable GoPro footage to improve AI understanding of technical and creative work.Role Overvi...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Benefits Communication Specialist (Remote).We are seeking a skilled Benefits Specialist to join our Human Resources team.
This role is pivotal in the successful administration and optimization of ou...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Be among the first 25 applicants.This range is provided by eTeam.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.
Direct message the job poster f...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 
Through our combination of video, sophisticated paid and organic outreach, and journey-based constituent engagement, the {{firstname}} team works with nonprofit organizations to better engage suppo...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 Oversee and structure multimedia production pipelines to ensure quality and consistency.Maintain continuity across scenes and sequences for coherence in AI training datasets.Design and refine visua...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Join Paysend to shape the future of a fintech brand trusted by over 11 million customers worldwide and help us build the world’s largest digital payments network to simplify money transfers for eve...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Vercel Communications / Presentation Designer.Vercel’s Frontend Cloud provides the developer experience and infrastructure to build, scale, and secure a faster, more personalized web.Customers like...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days The ideal candidate has a strong background in post-production for higher education, e-learning, or corporate training.This role requires the ability to transform raw footage, screen captures, and ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Join a remote project focused on audio annotation, where you will listen to short audio clips in Spanish or Brazilian Portuguese and provide precise labels and scores according to established guide...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours Multimedia Visual Communications Specialist.Multimedia Visual Communications Specialist.Continue with Google Continue with Google.
Multimedia Visual Communications Specialist.Multimedia Visual Commu...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days Be among the first 25 applicants.Get AI-powered advice on this job and more exclusive features.Through our offering of furniture, walls, and audio-visual solutions, Continua Interiors is on a missi...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30 As a Remote Video Editor, you will be responsible for assembling recorded footage, adding special effects, sound, and music, and creating polished, professional videos for various platforms includi...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
Language Services Associates, Inc. is hiring : Quechua Video Interpreter in Minne
MediabistroMinneapolis, MN, United Statesserp_jobs.job_card.full_time
AV Service Technician
BravasMinneapolis, MN, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Phoenix Support Services is hiring : Video Editor in Minneapolis
MediabistroMinneapolis, MN, United Statesserp_jobs.job_card.full_time
Freelance Video Anchor Job at Passionbits Technologies (WHITEPANDA MEDIA PVT LTD
MediabistroMinneapolis, MN, United Statesserp_jobs.job_card.full_time
ATTB - The Big Jobsite is hiring : Black Power Radio Wants Your Voice! in Minneap
MediabistroMinneapolis, MN, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.promoted
Sports (Dance) Camera Operator
DanceBUG Inc.Minneapolis, MN, United Statesserp_jobs.job_card.full_time
Senior Technician Broadcast Job at The Walt Disney Company in Saint Paul
MediabistroSaint Paul, MN, United Statesserp_jobs.job_card.full_time
Residential AV Technician
BravasMinneapolis, MN, USserp_jobs.job_card.full_time
serp_jobs.filters_job_card.quick_apply
Highbrow Technology Inc is hiring : Remote Sound Technicians and Broadcast Techni
MediabistroMinneapolis, MN, United Statesserp_jobs.filters.remote
serp_jobs.job_card.full_time
Benefits Communication Specialist (Remote) Job at Midwaretech in Minneapolis
MediabistroMinneapolis, MN, United Statesserp_jobs.filters.remote
serp_jobs.job_card.full_time
eTeam is hiring : Audio Video technician in Wayzata
MediabistroWayzata, MN, United Statesserp_jobs.job_card.part_time
- serp_jobs.job_card.promoted
Program Associate, Video
firstname.coMinneapolis, MN, USserp_jobs.job_card.full_time
Crossing Hurdles is hiring : Multimedia Specialist in Minneapolis
MediabistroMinneapolis, MN, United Statesserp_jobs.job_card.full_time
Communication Designer Job at Paysend in Minneapolis
MediabistroMinneapolis, MN, United Statesserp_jobs.job_card.full_time
Creativefuego is hiring : 4 months ago Vercel Communications / Presentation Desig
MediabistroMinneapolis, MN, United Statesserp_jobs.job_card.full_time
InSource Services Group, LLC. is hiring : Video Editor, US in Minneapolis
MediabistroMinneapolis, MN, United Statesserp_jobs.job_card.full_time
- serp_jobs.job_card.new
Freelance Audio Annotator Job at Twine in Minneapolis
MediabistroMinneapolis, MN, United Statesserp_jobs.job_card.part_time
Multimedia Visual Communications Specialist Job at Joint Strategic Technologies
MediabistroMinneapolis, MN, United Statesserp_jobs.job_card.full_time
Audio Visual Technician 2 Job at Intereum in Minneapolis
MediabistroMinneapolis, MN, United Statesserp_jobs.job_card.full_time +1
- serp_jobs.job_card.new
Jobs via Dice is hiring : Video Editor in Minneapolis
MediabistroMinneapolis, MN, United Statesserp_jobs.job_card.full_time