Talent.com
Data Annotation AI Specialist
Data Annotation AI SpecialistBiogensys • NJ, United States
Data Annotation AI Specialist

Data Annotation AI Specialist

Biogensys • NJ, United States
job_description.job_card.variable_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
  • serp_jobs.filters_job_card.quick_apply
job_description.job_card.job_description

We are hiring a Data Annotation AI Specialist for one of our clients .

Overview

  • Client AI group is seeking a Data Annotation AI Specialist to be part of a team that will be dedicated to build and support Generative AI, Machine learning, Deep Learning and Data science solutions across the organization.
  • The position could be based out of our Chicago or NY offices. We are seeking a Data Annotation AI Specialist to lead the evaluation, selection, and onboarding of a data annotation platform, and to establish best-in-class annotation workflows for our NLP and CV initiatives.
  • This role will bridge product, data science, MLOps, and compliance to ensure high-quality labeled datasets that accelerate model development for tasks such as text classification, entity extraction, unstructured data extraction, document summarization, and prompt / response curation.

What We Offer :

  • This will be a high impact role with significant visibility where the candidate will work on some flagship Fitch products
  • The candidate will have an excellent opportunity to work in the cutting-edge field of AI, NLP, Computer vision and MLOPs / LLMOps
  • Fitch promotes an excellent work culture and is known for providing a good work life balance

    • We ll Count on You To :

  • Platform Evaluation and Onboarding :
  • Assess and compare data annotation platforms (e.g., Labelbox, Prodigy, Snorkel, Scale AI, SuperAnnotate, LightTag, custom open-source stacks) against business and technical requirements.
  • Lead proof-of-concept trials; define evaluation criteria (quality, throughput, cost, security, privacy, compliance, UI / UX, workflow features, integrations, auditability).
  • Drive vendor due diligence, security reviews, and coordinate procurement / contracting with Legal, Security, and Procurement.
  • Plan and execute platform deployment, integrations (SSO, data lakes, MLOps pipelines), and role-based access controls.
  • Workflow and Taxonomy Design :
  • Collaborate with NLP and CV scientists and product owners to define labeling taxonomies, guidelines, and rubrics for tasks such as NER, data extraction, intent classification, topic modeling, toxicity / BI risk tagging, and document QA.
  • Establish annotation protocols, inter-annotator agreement measures (IAA), and quality gates; design multi-pass review processes and adjudication steps.
  • Develop gold standards and calibration sets; maintain versioning and change management of label schemas.
  • Quality Management :
  • Implement QA metrics and dashboards (precision / recall on labeled subsets, IAA, disagreement analysis, drift detection, sampling strategies).
  • Design active learning and human-in-the-loop strategies to continually improve data quality and labeling efficiency.
  • Conduct audits, bias checks, and error analyses; enforce data governance and documentation (data sheets, model cards inputs).
  • Operations and Scale :
  • Build and manage a hybrid workforce model (in-house annotators, expert reviewers, external vendors) including training, SLAs, throughput planning, and budget tracking.
  • Create training materials and onboarding programs for annotators, SMEs, and reviewers; run calibration sessions and periodic refreshers.
  • Optimize throughput and cost with workflow automation, pre-labeling, heuristics, and annotation tooling features.
  • Integration and MLOps :
  • Integrate the annotation platform with data pipelines, model training loops, experiment tracking, and storage (e.g., Databricks, Snowflake, AWS / GCP / Azure, MLflow).
  • Implement programmatic interfaces (APIs / SDKs) for data ingestion / export, schema management, and reproducibility.
  • Collaborate on dataset curation, splitting strategies, and governance (PII handling, encryption, retention policies).

    • What You Need to Have :

  • 4 7+ years of experience in data annotation, data operations, or applied NLP / CV / ML, with direct responsibility for building and managing labeling programs.
  • Hands-on experience with annotation platforms and workflows for NLP tasks; familiarity with enterprise deployment considerations (SSO, RBAC, audit, SOC2).
  • Strong understanding of NLP and CV techniques : tokenization, embeddings, NER, text classification, sentiment, summarization, prompt engineering, and evaluation.
  • Proficiency in Python and data tooling (Pandas, spaCy, Hugging Face, NLTK); experience using APIs / SDKs to automate annotation and active learning loops.
  • Experience defining label taxonomies, guidelines, and measuring IAA; practical knowledge of QA methodologies and error / bias analysis.
  • Familiarity with cloud platforms (AWS / GCP / Azure), data governance, and secure data handling.
  • Excellent communication skills; ability to collaborate with data scientists, product managers, engineers, SMEs, and vendors.

    • What Would Make You Stand Out :

  • Experience with large language model (LLM) data curation, RLHF / RLAIF pipelines, and prompt / response quality evaluation.
  • Background in financial services, risk analytics, or regulated industries with strong compliance requirements.
  • Prior experience building hybrid annotation teams and managing external vendors.
  • Knowledge of annotation for multilingual NLP and document-heavy workflows (PDF parsing, OCR)

    • About Us :

    We are specialized in recruiting and deliver the best professional talent of industry and we are committed to deliver best experience for our clients and job seekers. With over two decades of experience in the recruitment industry, we proudly help you to find the next job that matches your professional skills. Our team understands your needs or requirement before starting the recruitment, that enables to find the high quality of talent with high success rate of talent delivery, keeps us continue to be the best in the industry. By responding to this job posting, you are consenting to receive text / SMS messages from us. Thank you.

    serp_jobs.job_alerts.create_a_job

    Ai Specialist • NJ, United States

    Job_description.internal_linking.related_jobs
    Associate Director AI

    Associate Director AI

    Life Science Solutions Provider • Princeton, NJ, United States
    serp_jobs.job_card.full_time
    Associate Director / AI, Life Science Solutions Provider, Princeton, 220k plus bonus, Hybrid Model.MUST HAVE FIVE YEARS AI / DATA ANALYTICS. MUST HAVE STRONG API / CLOUD SKILLSET.The ideal candidate will ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Looking for the ultimate side hustle?

    Looking for the ultimate side hustle?

    Survey Authority • Hammonton, NJ, US
    serp_jobs.job_card.full_time
    Earn cash by matching with real companies that pay you for your opinions.serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Travel Physical Therapist - $1,773 per week

    Travel Physical Therapist - $1,773 per week

    AHS Staffing • Hammonton, NJ, US
    serp_jobs.job_card.full_time
    AHS Staffing is seeking a travel Physical Therapist for a travel job in Hammonton, New Jersey.Job Description & Requirements Specialty : Physical Therapist Discipline : Therapy Start Date : 11 / 10 / 2025...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Control Account Management Lead

    Control Account Management Lead

    Leidos Inc • Egg Harbor City, NJ, United States
    serp_jobs.job_card.full_time
    Leidos is seeking a Control Account Management (CAM) Lead - Air Traffic who will support the Federal Aviation Administration (FAA)'s Terminal Flight Data Manager (TFDM) program.TFDM is a management...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Online Survey Taker. Earn up to $25 per survey. - Remote

    Online Survey Taker. Earn up to $25 per survey. - Remote

    Earn Haus • Cologne, New Jersey, US
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time +1
    We are urgently looking for people interested in taking online surveys for Fortune 500 brands.If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Earn up...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    VP, AI Engineering and Applied Research

    VP, AI Engineering and Applied Research

    Wolters Kluwer • Princeton, NJ, US
    serp_jobs.job_card.full_time
    VP, AI Engineering and Applied Research.Be among the first 25 applicants.VP, AI Engineering and Applied Research.VP of AI Engineering and Applied Research. Generative AI capabilities across our prod...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Time Away & Life Solutions - Senior Consultant

    Time Away & Life Solutions - Senior Consultant

    Aon • Hammonton, NJ, United States
    serp_jobs.job_card.full_time +1
    Time Away and Life Solutions Senior Consultant.Are you interested in a dynamic position that provides consultative support for Life and Disability Benefits to the Professional Employer Organization...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Director of Artificial Intelligence Services

    Director of Artificial Intelligence Services

    Alpine Solutions Group • Princeton, NJ, United States
    serp_jobs.job_card.full_time
    Position : Director / Senior Director of AI Services.Compensation : Competitive Base + bonus + FTE benefits.Location : Princeton NJ- onsite when clients are in town but primarily remote.IT experience wi...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_1_day • serp_jobs.job_card.promoted
    Director of Artificial Intelligence Services (Princeton)

    Director of Artificial Intelligence Services (Princeton)

    Alpine Solutions Group • Princeton, NJ, US
    serp_jobs.job_card.part_time
    Position : Director / Senior Director of AI Services.Compensation : Competitive Base + bonus + FTE benefits.Location : Princeton NJ- onsite when clients are in town but primarily remote.IT experience wi...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_1_day • serp_jobs.job_card.promoted
    Associate Director AI (Princeton)

    Associate Director AI (Princeton)

    Life Science Solutions Provider • Princeton, NJ, US
    serp_jobs.job_card.part_time
    Associate Director / AI, Life Science Solutions Provider, Princeton, 220k plus bonus, Hybrid Model.MUST HAVE FIVE YEARS AI / DATA ANALYTICS. MUST HAVE STRONG API / CLOUD SKILLSET.The ideal candidate will ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Special Agent, $40,000 Recruitment Incentive

    Special Agent, $40,000 Recruitment Incentive

    The United States Secret Service • Cologne, NJ, US
    serp_jobs.job_card.full_time
    Recruitment Incentive : Applicants may be eligible for a $40,000 recruitment incentive in accordance with regulatory requirements. Click apply for complete details on the recruitment incentive detail...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Audit & Risk Mgmt Consultant (Remote EST CST or MST)

    Audit & Risk Mgmt Consultant (Remote EST CST or MST)

    Lexis Nexis • Long Beach Township, NJ, US
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time
    LexisNexis Risk Solutions is the essential partner in the assessment of risk.Within our Government vertical, our solutions assist government agencies and law enforcement to drive insights from comp...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Content Intelligence & AI Innovation Manager

    Content Intelligence & AI Innovation Manager

    ISMG - Information Security Media Group • Princeton, NJ, US
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    About Us ISMG is a global intelligence firm and media powerhouse, leading the way in cybersecurity, enterprise IT, and digital transformation. With 10+ brands, 38 digital media properties, an...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days
    Work from Home

    Work from Home

    Earn Haus • Barnegat Light, NJ, United States
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time +1
    We are urgently looking for people interested in taking online surveys for Fortune 500 brands.If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Earn up...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Travel CT Technologist - $3,004 per week

    Travel CT Technologist - $3,004 per week

    Care Career • Point Pleasant Boro, NJ, US
    serp_jobs.job_card.full_time
    Care Career is seeking a travel CT Technologist for a travel job in Brick, New Jersey.Job Description & Requirements Specialty : CT Technologist Discipline : Allied Health Professional Start Date : AS...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    QA Engineer

    QA Engineer

    DerbySoft • Barnegat Light, NJ, US
    serp_jobs.job_card.full_time
    Founded in 2002, DerbySoft is a technology company whose mission is to make the travel business easier through industry leading technology that empowers travel industry services.The company support...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Travel SNF Physical Therapy Assistant - $1,128 per week

    Travel SNF Physical Therapy Assistant - $1,128 per week

    AHS Staffing • Hammonton, NJ, United States
    serp_jobs.job_card.full_time
    AHS Staffing is seeking a travel Physical Therapy Assistant for a travel job in Hammonton, New Jersey.Job Description & Requirements Specialty : Physical Therapy Assistant Discipline : Therapy Start ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Digital Communications Specialist - Middle Market

    Digital Communications Specialist - Middle Market

    Aon • Hammonton, NJ, United States
    serp_jobs.job_card.full_time +1
    AON is looking for a Digital Communications Specialist - Hybrid or Virtual - (located in New Jersey).Aon is in the business of better decisions. At Aon, we shape decisions for the better to protect ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted