Talent.com
Prompt Engineer - Data Science & Quality Analysis (US)

Prompt Engineer - Data Science & Quality Analysis (US)

CheckmateNew York, NY, US
job_description.job_card.variable_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
  • serp_jobs.filters.remote
  • serp_jobs.filters_job_card.quick_apply
job_description.job_card.job_description

As a Prompt Engineer focused on Data Science and Quality Analysis, you’ll design, test, and evaluate prompts for AI systems that interact with real-world restaurant data. You’ll work cross-functionally to develop AI solutions that drive operational efficiency, improve data interpretation, and support smarter decision-making for restaurant operators.

Your work will directly shape how AI models perform in high-stakes, dynamic environments like order processing, reporting, support automation, and performance analysis.

Essential Job Functions :

  • Prompt Design & Evaluation : Develop, test, and refine prompts for tasks such as text generation, question answering, data classification, and structured data extraction to optimize Voice AI performance.
  • Data-Driven Analysis & Quality Measurement : Design evaluation frameworks and analyze prompt outputs using quantitative metrics, human-in-the-loop evaluation, and user feedback to identify improvement opportunities.
  • Experimentation & Iteration Conduct experiments to test prompt variations, measure their business and operational impact, and iterate to enhance accuracy, consistency, and safety.
  • Regression Testing & Compliance Build principled regression test suites using tools like LangFuse and Galileo to ensure prompts remain compliant and high-performing as models and use cases evolve.
  • Collaboration Across Teams : Work closely with data science, product, legal, engineering, and operations teams to align prompt designs with business goals, operational workflows, and compliance requirements.
  • Model Adaptation & Strategy Development prompts across multiple LLMs (GPT, LLaMA, Gemini, and Checkmate’s fine-tuned models), understanding model differences to optimize outputs effectively.
  • Team Leadership & Mentorship Lead a team of analysts focused on prompt evaluation and data quality analysis, guiding prioritization, experimentation, and reporting. Collaborate with ops teams for seamless deployment and feedback loops.
  • Research & Continuous Learning Stay up to date on emerging prompting techniques, LLM behaviors, evaluation frameworks, and AI safety practices to keep Checkmate’s AI solutions best-in-class.

100% Remote

Minimum of three years of experience in the areas of AI, ML, NLP, and prompt engineering.

$125,000 to $160,000

Requirements

  • Strong analytical and data science skills, with hands-on experience in Python (pandas, NumPy, scikit-learn )
  • Experience designing and conducting experiments and evaluations in applied AI or NLP contexts
  • Proficiency in SQL and working with relational databases (e.g. MySQL, PostgreSQL, Oracle, MS SQL)
  • Good understanding of data processing, quality measurement, and testing fundamentals
  • Experience leading analyst or operations teams, with strong prioritization, mentorship, and collaboration skills
  • Strong problem-solving mindset with a drive to explore, optimize, and automate workflows
  • Excellent communication skills for presenting insights to technical and non-technical stakeholders
  • Bachelor’s degree in Data Science, Computer Science, Statistics, Engineering, or a related field
  • Flexible to work US hours until at least 6 pm ET.
  • Preferred Qualifications

  • Experience with LLM evaluation and prompt engineering workflows
  • Familiarity with tools like LangFuse and Galileo for prompt evaluation and analysis
  • Knowledge of cloud platforms (AWS, GCP, Azure) and data pipeline tools
  • Familiarity with machine learning concepts and NLP workflows
  • Master’s or PhD in Data Science, Statistics, Computer Science, or a related field
  • Benefits

  • Health Care Plan (Medical, Dental & Vision)
  • Retirement Plan (401k)
  • Life Insurance (Basic, Voluntary & AD&D)
  • Flexible Paid Time Off
  • Family Leave (Maternity, Paternity)
  • Short Term & Long Term Disability
  • Training & Development
  • Work From Home
  • Stock Option Plan
  • serp_jobs.job_alerts.create_a_job

    Data Science Engineer • New York, NY, US

    Job_description.internal_linking.related_jobs
    • serp_jobs.job_card.promoted
    Data Science and IoT Engineer

    Data Science and IoT Engineer

    VirtualVocationsBronx, New York, United States
    serp_jobs.job_card.full_time
    A company is looking for an Analytics Data Science and IoT Engineer.Key Responsibilities Design and develop data pipelines for efficient data flow from various sources to centralized storage Man...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    Product Manager - Data Analytics

    Product Manager - Data Analytics

    CentralReachHolmdel, NJ, US
    serp_jobs.job_card.full_time
    CentralReach is a leading provider of autism and IDD care software for Applied Behavior Analysis (ABA), multidisciplinary therapy, and special education. Trusted by more than 200,000 users, we enabl...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Director, Data Science 1 of 2

    Director, Data Science 1 of 2

    Novartis Group CompaniesEast Hanover, NJ, United States
    serp_jobs.job_card.full_time
    This position will be located at the East Hanover, NJ location and will not have the ability to be located remotely.The Insights and Decision Science (IDS) team is dedicated to enabling improved de...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Senior Data Quality Analyst

    Senior Data Quality Analyst

    VirtualVocationsPaterson, New Jersey, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior Data Quality Analyst.Key Responsibilities Develop and enforce data quality standards, policies, and procedures Champion data governance best practices and colla...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Principal Engineer, AI

    Principal Engineer, AI

    VirtualVocationsFlushing, New York, United States
    serp_jobs.job_card.full_time
    A company is looking for a Principal Engineer, AI Agents.Key Responsibilities Architect foundational AI strategy and drive capabilities for agentic AI and advanced analytics Design scalable AI-d...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    Prompt Engineer - Data Science & Quality Analysis (US)

    Prompt Engineer - Data Science & Quality Analysis (US)

    CheckmateNew York, NY, US
    serp_jobs.job_card.full_time
    As a Prompt Engineer focused on Data Science and Quality Analysis, you’ll design, test, and evaluate prompts for AI systems that interact with real-world restaurant data.You’ll work cro...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Associate Director, Data Science

    Associate Director, Data Science

    VirtualVocationsPaterson, New Jersey, United States
    serp_jobs.job_card.full_time
    A company is looking for an Omni-Channel Data Science Lead.Key Responsibilities Designing and deploying machine learning recommender systems for personalization and engagement Building and scali...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Senior Data Engineer

    Senior Data Engineer

    VirtualVocationsNewark, New Jersey, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior Data Engineer to build scalable data solutions and pipelines in a remote environment.Key Responsibilities Build and maintain CI / CD pipelines and design scalable ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    Senior Databricks Engineer

    Senior Databricks Engineer

    VirtualVocationsYonkers, New York, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior Databricks Engineer / Cloud Data Engineer (Remote).Key Responsibilities Design, build, and optimize data pipelines using Databricks, Apache Spark, and Delta Lake...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    HEOR Analyst

    HEOR Analyst

    VirtualVocationsElizabeth, New Jersey, United States
    serp_jobs.job_card.full_time
    A company is looking for a HEOR Analyst.Key Responsibilities : Conduct data queries and analyses using real world data assets to support product portfolio and therapeutic areas Develop and implem...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Data Quality Analyst

    Data Quality Analyst

    VirtualVocationsNewark, New Jersey, United States
    serp_jobs.job_card.full_time
    A company is looking for a Data Quality Analyst to maintain the integrity and reliability of data for business decisions. Key Responsibilities Enter, update, and maintain large datasets across mul...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    Principal Data Intelligence Engineer

    Principal Data Intelligence Engineer

    VirtualVocationsNewark, New Jersey, United States
    serp_jobs.job_card.full_time
    A company is looking for a Principal Data Intelligence Engineer to lead the strategy and execution of Business Intelligence and Enterprise Data Warehouse platforms. Key Responsibilities : Define an...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    Quality Engineer

    Quality Engineer

    KLATotowa, NJ, United States
    serp_jobs.job_card.full_time
    KLA is a global leader in diversified electronics for the semiconductor manufacturing ecosystem.Virtually every electronic device in the world is produced using our technologies.No laptop, smartpho...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Data Science Engineer

    Data Science Engineer

    VirtualVocationsJamaica, New York, United States
    serp_jobs.job_card.full_time
    A company is looking for a Data Science Engineer to implement data science and machine learning solutions.Key Responsibilities Collaborate with teams to understand business requirements and impro...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    VirtualVocationsStaten Island, New York, United States
    serp_jobs.job_card.full_time
    A company is looking for a Data Engineer - Remote.Key Responsibilities Design, implement, and maintain scalable ETL / ELT pipelines for structured and unstructured data sources Collaborate with cr...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Principal Data Engineer

    Principal Data Engineer

    VirtualVocationsFlushing, New York, United States
    serp_jobs.job_card.full_time
    A company is looking for a Principal Data Engineer, MA or Remote.Key Responsibilities Design, develop, implement, optimize, and maintain data integrations, pipelines, and solutions Collaborate w...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Data Engineer II

    Data Engineer II

    VirtualVocationsNewark, New Jersey, United States
    serp_jobs.job_card.full_time
    A company is looking for a Data Engineer II who will contribute to solution design architecture and data standards implementation. Key Responsibilities Support and maintain operational availabilit...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Data Engineer III

    Data Engineer III

    VirtualVocationsNewark, New Jersey, United States
    serp_jobs.job_card.full_time
    A company is looking for a Data Engineer III to design, develop, and maintain data pipelines and systems.Key Responsibilities Design, develop, and maintain data pipelines and infrastructure using...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Senior Analytics Engineer

    Senior Analytics Engineer

    VirtualVocationsFlushing, New York, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior Analytics Engineer to lead the design and implementation of scalable data models and pipelines. Key Responsibilities Lead complex technical implementations and sh...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    VP Global Head of Data Analytics, Data Science, & AI

    VP Global Head of Data Analytics, Data Science, & AI

    Novartis Group CompaniesEast Hanover, NJ, United States
    serp_jobs.job_card.full_time
    The Strategic Business Partner for US&I Data & Analytics, DSAI Product line drives and ensures that IT global and local (where applicable) demand is captured from business and collaborates with...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day