Talent.com
AI Multimedia Generation Product Evaluator Job at ICONMA in Orlando

AI Multimedia Generation Product Evaluator Job at ICONMA in Orlando

MediabistroOrlando, FL, United States
job_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

Overview

Our Client, a Internet Content & Information company, is looking for an AI Multimedia Generation Product Evaluator for their Remote location.

Responsibilities

  • The Multimedia Generation team focuses on fine tuning and productionizing media foundational models in the GenAI space.
  • The team consists of AI applied scientists, each responsible for different products like videos, image editing, and developing evaluation metrics.
  • Set up Halo tasks and run model inference.
  • Enqueue new queues to Halo.
  • Audit annotations from vendors.
  • Build tooling for managing evaluation datasets.
  • Collaborate with model development teams to conduct offline evaluations and automate pipelines.
  • Facilitate, set up queues, manage image data, and audit results.
  • Ensure consistency and accuracy in measurements, involving programming and auditing tasks.
  • Collaborate with model development teams to connect offline metrics with online user behavior and ensure offline metrics predict online user engagement.
  • Support engineers in ensuring consistency and accuracy in measurements, involving programming and auditing tasks.

Requirements

  • 2+ years of basic Python knowledge, specifically for managing data and working with image and video data.
  • 1-2 years of Python knowledge, particularly in working with image / video data and JSON.
  • Experience in SQL and handling large data tables.
  • Experience in the image and video domain.
  • Ability to adapt to new code.
  • General know-how.
  • Bachelor’s degree preferred, not required.
  • Nice-to-Have Skills

  • Experience as a GenAI user in the image and video domain.
  • Basic shell script knowledge.
  • Why Should You Apply?

  • Health Benefits
  • Referral Program
  • Excellent growth and advancement opportunities
  • As an equal opportunity employer, ICONMA provides an employment environment that supports and encourages the abilities of all persons without regard to race, color, religion, gender, sexual orientation, gender identity or expression, ethnicity, national origin, age, disability status, political affiliation, genetics, marital status, protected veteran status, or any other characteristic protected by federal, state, or local laws.

    #J-18808-Ljbffr

    serp_jobs.job_alerts.create_a_job

    Ai Multimedia Generation Product Evaluator • Orlando, FL, United States

    Job_description.internal_linking.related_jobs
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    AI Evaluation Analyst

    AI Evaluation Analyst

    VirtualVocationsKissimmee, Florida, United States
    serp_jobs.job_card.full_time
    A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    AI Agent Evaluation Analyst

    AI Agent Evaluation Analyst

    VirtualVocationsKissimmee, Florida, United States
    serp_jobs.job_card.full_time
    A company is looking for an AI Agent Evaluation Analyst.Key Responsibilities Review evaluation tasks and scenarios for logic, completeness, and realism Identify inconsistencies, missing assumpti...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    Freelance Product Evaluator (Hiring Immediately)

    Freelance Product Evaluator (Hiring Immediately)

    Product Review JobsOVIEDO, FL, United States
    serp_jobs.job_card.full_time
    Compensation : Varies per assignment.Thank you for your interest in becoming a Paid Product Tester.This opportunity is for completing market research opportunities with independent brands via online...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    AI Communication Quality & Culture Evaluator Job at Hireio, Inc. in Orlando

    AI Communication Quality & Culture Evaluator Job at Hireio, Inc. in Orlando

    MediabistroOrlando, FL, United States
    serp_jobs.job_card.full_time
    Join a collaborative remote team working to make AI communication emotionally intelligent, culturally aware, and engaging. Score AI messages for tone, empathy, and contextual awareness.Identify subt...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Remote AI Writing Evaluator

    Remote AI Writing Evaluator

    OutlierOrlando, FL, United States
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time
    Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    Staff Product Manager, AI

    Staff Product Manager, AI

    VirtualVocationsKissimmee, Florida, United States
    serp_jobs.job_card.full_time
    A company is looking for a Staff Product Manager, AI Evaluations.Key Responsibilities Define and drive the roadmap for the AI Evaluation Framework, focusing on quantitative metrics and human-in-t...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    Freelance Product Evaluation Specialist (Hiring Immediately)

    Freelance Product Evaluation Specialist (Hiring Immediately)

    Product Review JobsASTOR, FL, United States
    serp_jobs.job_card.full_time
    Compensation : Varies per assignment.Thank you for your interest in becoming a Paid Product Tester.This opportunity is for completing market research opportunities with independent brands via online...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    AI Trainer

    AI Trainer

    VirtualVocationsKissimmee, Florida, United States
    serp_jobs.job_card.full_time
    A company is looking for an AI Trainer / Senior Prompt Evaluation.Key Responsibilities Conduct thorough reviews of AI model dialogues with users to assess quality and relevance Identify growth a...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    AI Prototype Specialist

    AI Prototype Specialist

    VirtualVocationsKissimmee, Florida, United States
    serp_jobs.job_card.full_time
    A company is looking for an AI Prototype Specialist (Vibe Coder).Key Responsibilities Collaborate with strategy and sales teams to understand client needs and challenges Design and build functio...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    Mercor is hiring : Audio Evaluation Expert - Fully Remote in Orlando

    Mercor is hiring : Audio Evaluation Expert - Fully Remote in Orlando

    MediabistroOrlando, FL, United States
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time
    Be among the first 25 applicants.This range is provided by Mercor.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Mercor connects elite creative...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    AI Product Designer

    AI Product Designer

    VirtualVocationsKissimmee, Florida, United States
    serp_jobs.job_card.full_time
    A company is looking for an AI Product Designer to lead the design of AI-powered incident intelligence and automation solutions. Key Responsibilities Own the end-to-end design strategy for the AI ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Consumer Product Evaluator (Hiring Immediately)

    Consumer Product Evaluator (Hiring Immediately)

    Product Review JobsPORT ORANGE, FL, United States
    serp_jobs.job_card.full_time
    Compensation : Varies per assignment.Thank you for your interest in becoming a Paid Product Tester.This opportunity is for completing market research opportunities with independent brands via online...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Remote Finance Advisor - AI Trainer

    Remote Finance Advisor - AI Trainer

    Data AnnotationPort Orange, Florida
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Radiology

    Radiology

    GO StaffingMims, Florida, US
    serp_jobs.job_card.full_time
    Radiology physician employment in Florida : .Locums- A great group is looking for a Locum Radiologist - Tele for Day, Swing, or Overnight shifts near Mims, FL. Board Certified Diagnostic Radiologist....serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Independent Brand Product Evaluator (Hiring Immediately)

    Independent Brand Product Evaluator (Hiring Immediately)

    Product Review JobsORLANDO, FL, United States
    serp_jobs.job_card.full_time
    Compensation : Varies per assignment.Thank you for your interest in becoming a Paid Product Tester.This opportunity is for completing market research opportunities with independent brands via online...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Remote Financial Analyst - AI Trainer

    Remote Financial Analyst - AI Trainer

    Data AnnotationPort Orange, Florida
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Online Product Evaluator (Hiring Immediately)

    Online Product Evaluator (Hiring Immediately)

    Product Review JobsORLANDO, FL, United States
    serp_jobs.job_card.full_time
    Compensation : Varies per assignment.Thank you for your interest in becoming a Paid Product Tester.This opportunity is for completing market research opportunities with independent brands via online...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Online Product Evaluation Expert (Hiring Immediately)

    Online Product Evaluation Expert (Hiring Immediately)

    Product Review JobsORLANDO, FL, United States
    serp_jobs.job_card.full_time
    Compensation : Varies per assignment.Thank you for your interest in becoming a Paid Product Tester.This opportunity is for completing market research opportunities with independent brands via online...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30