Talent.com
Data Annotation AI Specialist
Data Annotation AI SpecialistBiogensys • NJ, United States
Data Annotation AI Specialist

Data Annotation AI Specialist

Biogensys • NJ, United States
job_description.job_card.1_day_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
  • serp_jobs.filters_job_card.quick_apply
job_description.job_card.job_description

We are hiring a Data Annotation AI Specialist for one of our clients .

Overview

  • Client AI group is seeking a Data Annotation AI Specialist to be part of a team that will be dedicated to build and support Generative AI, Machine learning, Deep Learning and Data science solutions across the organization.
  • The position could be based out of our Chicago or NY offices. We are seeking a Data Annotation AI Specialist to lead the evaluation, selection, and onboarding of a data annotation platform, and to establish best-in-class annotation workflows for our NLP and CV initiatives.
  • This role will bridge product, data science, MLOps, and compliance to ensure high-quality labeled datasets that accelerate model development for tasks such as text classification, entity extraction, unstructured data extraction, document summarization, and prompt / response curation.

What We Offer :

  • This will be a high impact role with significant visibility where the candidate will work on some flagship Fitch products
  • The candidate will have an excellent opportunity to work in the cutting-edge field of AI, NLP, Computer vision and MLOPs / LLMOps
  • Fitch promotes an excellent work culture and is known for providing a good work life balance
  • We ll Count on You To :

  • Platform Evaluation and Onboarding :
  • Assess and compare data annotation platforms (e.g., Labelbox, Prodigy, Snorkel, Scale AI, SuperAnnotate, LightTag, custom open-source stacks) against business and technical requirements.
  • Lead proof-of-concept trials; define evaluation criteria (quality, throughput, cost, security, privacy, compliance, UI / UX, workflow features, integrations, auditability).
  • Drive vendor due diligence, security reviews, and coordinate procurement / contracting with Legal, Security, and Procurement.
  • Plan and execute platform deployment, integrations (SSO, data lakes, MLOps pipelines), and role-based access controls.
  • Workflow and Taxonomy Design :
  • Collaborate with NLP and CV scientists and product owners to define labeling taxonomies, guidelines, and rubrics for tasks such as NER, data extraction, intent classification, topic modeling, toxicity / BI risk tagging, and document QA.
  • Establish annotation protocols, inter-annotator agreement measures (IAA), and quality gates; design multi-pass review processes and adjudication steps.
  • Develop gold standards and calibration sets; maintain versioning and change management of label schemas.
  • Quality Management :
  • Implement QA metrics and dashboards (precision / recall on labeled subsets, IAA, disagreement analysis, drift detection, sampling strategies).
  • Design active learning and human-in-the-loop strategies to continually improve data quality and labeling efficiency.
  • Conduct audits, bias checks, and error analyses; enforce data governance and documentation (data sheets, model cards inputs).
  • Operations and Scale :
  • Build and manage a hybrid workforce model (in-house annotators, expert reviewers, external vendors) including training, SLAs, throughput planning, and budget tracking.
  • Create training materials and onboarding programs for annotators, SMEs, and reviewers; run calibration sessions and periodic refreshers.
  • Optimize throughput and cost with workflow automation, pre-labeling, heuristics, and annotation tooling features.
  • Integration and MLOps :
  • Integrate the annotation platform with data pipelines, model training loops, experiment tracking, and storage (e.g., Databricks, Snowflake, AWS / GCP / Azure, MLflow).
  • Implement programmatic interfaces (APIs / SDKs) for data ingestion / export, schema management, and reproducibility.
  • Collaborate on dataset curation, splitting strategies, and governance (PII handling, encryption, retention policies).
  • What You Need to Have :

  • 4 7+ years of experience in data annotation, data operations, or applied NLP / CV / ML, with direct responsibility for building and managing labeling programs.
  • Hands-on experience with annotation platforms and workflows for NLP tasks; familiarity with enterprise deployment considerations (SSO, RBAC, audit, SOC2).
  • Strong understanding of NLP and CV techniques : tokenization, embeddings, NER, text classification, sentiment, summarization, prompt engineering, and evaluation.
  • Proficiency in Python and data tooling (Pandas, spaCy, Hugging Face, NLTK); experience using APIs / SDKs to automate annotation and active learning loops.
  • Experience defining label taxonomies, guidelines, and measuring IAA; practical knowledge of QA methodologies and error / bias analysis.
  • Familiarity with cloud platforms (AWS / GCP / Azure), data governance, and secure data handling.
  • Excellent communication skills; ability to collaborate with data scientists, product managers, engineers, SMEs, and vendors.
  • What Would Make You Stand Out :

  • Experience with large language model (LLM) data curation, RLHF / RLAIF pipelines, and prompt / response quality evaluation.
  • Background in financial services, risk analytics, or regulated industries with strong compliance requirements.
  • Prior experience building hybrid annotation teams and managing external vendors.
  • Knowledge of annotation for multilingual NLP and document-heavy workflows (PDF parsing, OCR)
  • About Us :

    We are specialized in recruiting and deliver the best professional talent of industry and we are committed to deliver best experience for our clients and job seekers. With over two decades of experience in the recruitment industry, we proudly help you to find the next job that matches your professional skills. Our team understands your needs or requirement before starting the recruitment, that enables to find the high quality of talent with high success rate of talent delivery, keeps us continue to be the best in the industry. By responding to this job posting, you are consenting to receive text / SMS messages from us. Thank you.

    serp_jobs.job_alerts.create_a_job

    Ai Specialist • NJ, United States

    Job_description.internal_linking.related_jobs
    Freelance Data Annotation Specialist

    Freelance Data Annotation Specialist

    VirtualVocations • Hamilton, New Jersey, United States
    serp_jobs.job_card.full_time
    A company is looking for a Freelance Italian and / or Portuguese Data Annotation Specialist (100% Remote within Italy).Key Responsibilities : Prepare and maintain medically oriented datasets for mac...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Remote Equity Research Analyst – AI Trainer ($50-$60 / hour)

    Remote Equity Research Analyst – AI Trainer ($50-$60 / hour)

    Data Annotation • New Brunswick, New Jersey
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    AI Data Analyst

    AI Data Analyst

    VirtualVocations • Hamilton, New Jersey, United States
    serp_jobs.job_card.full_time
    A company is looking for an AI Data Analyst to support the design, implementation, and optimization of AI-powered solutions for clients. Key Responsibilities Analyze structured and unstructured da...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Remote Investment Analyst – AI Trainer ($50-$60 / hour)

    Remote Investment Analyst – AI Trainer ($50-$60 / hour)

    Data Annotation • New Brunswick, New Jersey
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Remote FP&A Manager – AI Trainer ($50-$60 / hour)

    Remote FP&A Manager – AI Trainer ($50-$60 / hour)

    Data Annotation • New Brunswick, New Jersey
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    AI Data Specialist

    AI Data Specialist

    VirtualVocations • Hamilton, New Jersey, United States
    serp_jobs.job_card.part_time
    A company is looking for an AI Data Specialist to support the improvement of AI-generated content in English.Key Responsibilities Perform data collection, evaluation, and annotation Conduct pair...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Finance AI Enabling Specialist

    Finance AI Enabling Specialist

    VirtualVocations • Hamilton, New Jersey, United States
    serp_jobs.job_card.full_time
    A company is looking for an AI Enabling Specialist - Finance.Key Responsibilities Guide finance teams in selecting and implementing data tools tailored to their business needs Collaborate with f...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_hours • serp_jobs.job_card.promoted • serp_jobs.job_card.new
    AI Prototype Specialist

    AI Prototype Specialist

    VirtualVocations • Hamilton, New Jersey, United States
    serp_jobs.job_card.full_time
    A company is looking for an AI Prototype & Product Specialist (Product Thinker).Key Responsibilities Collaborate with strategy and sales teams to understand client business needs and challenges ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Content Intelligence & AI Innovation Manager

    Content Intelligence & AI Innovation Manager

    ISMG - Information Security Media Group • Princeton, NJ, US
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    About Us ISMG is a global intelligence firm and media powerhouse, leading the way in cybersecurity, enterprise IT, and digital transformation. With 10+ brands, 38 digital media properties, an...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days
    Content Intelligence & AI Innovation Manager

    Content Intelligence & AI Innovation Manager

    ISMG - Information Security Media Group • Princeton, NJ, US
    serp_jobs.job_card.full_time
    IT, and digital transformation.With 10+ brands, 38 digital media properties, and over 400 premier events annually—ISMG connects a network of over 2M executives, decision-makers, and innovator...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Remote FinTech Product Analyst - AI Trainer ($50-$60 / hour)

    Remote FinTech Product Analyst - AI Trainer ($50-$60 / hour)

    Data Annotation • Sayreville, New Jersey
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Senior Data and AI Engineer

    Senior Data and AI Engineer

    VirtualVocations • Hamilton, New Jersey, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior Engineer specializing in Data and AI to transform business operations through advanced AI applications. Key Responsibilities Lead the design, development, and dep...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    AI Strategic Consultant

    AI Strategic Consultant

    VirtualVocations • Hamilton, New Jersey, United States
    serp_jobs.job_card.full_time
    A company is looking for a Strategic Consultant for using AI in Advisory and Training Workflows.Key Responsibilities Conduct a needs assessment to identify AI tools that enhance disaster risk fin...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_hours • serp_jobs.job_card.promoted • serp_jobs.job_card.new
    Data Annotator

    Data Annotator

    VirtualVocations • Hamilton, New Jersey, United States
    serp_jobs.job_card.full_time
    A company is looking for a Data Annotator.Key Responsibilities Label and prepare data in the form of images, audio, video, and text for machine learning Contribute to projects that support the t...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_hours • serp_jobs.job_card.promoted • serp_jobs.job_card.new
    Remote Financial Analyst - AI Trainer ($50-$60 / hour)

    Remote Financial Analyst - AI Trainer ($50-$60 / hour)

    Data Annotation • Sayreville, New Jersey
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    AI Query Vetting Specialist

    AI Query Vetting Specialist

    VirtualVocations • Hamilton, New Jersey, United States
    serp_jobs.job_card.full_time
    A company is looking for a Query Vetting expert.Key Responsibilities : Engage with GEN AI researchers and engineers to understand data collection / evaluation requirements Execute collection & eval...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_hours • serp_jobs.job_card.promoted • serp_jobs.job_card.new
    AI Compliance Specialist

    AI Compliance Specialist

    VirtualVocations • Hamilton, New Jersey, United States
    serp_jobs.job_card.full_time
    A company is looking for an AI Compliance Specialist to ensure the quality assurance of AI-generated call transcripts and insights. Key Responsibilities Review and validate AI-generated call trans...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Data Scientist for AI Systems

    Data Scientist for AI Systems

    VirtualVocations • Hamilton, New Jersey, United States
    serp_jobs.job_card.full_time
    A company is looking for a ML - Data Scientist (Statistical Modeling & AI Systems).Key Responsibilities Develop and scale LLM-based tools for analyzing news, social media, and message performance...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_1_day • serp_jobs.job_card.promoted