Talent.com
MCP & Tools Python Developer - Agent Evaluation Infrastructure

MCP & Tools Python Developer - Agent Evaluation Infrastructure

MindriftSC, US
job_description.job_card.variable_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.part_time
  • serp_jobs.filters.remote
  • serp_jobs.filters_job_card.quick_apply
job_description.job_card.job_description

At Mindrift , innovation meets opportunity. We believe in using the power of collective human intelligence to ethically shape the future of AI.

The Mindrift platform, launched and powered by Toloka , connects domain experts with cutting-edge AI projects from innovative tech clients. Our mission is to unlock the potential of GenAI by tapping into real-world expertise from across the globe.

We’re on the hunt for hands-on Python engineers for a new project focused on developing Model Context Protocol (MCP) servers and internal tools for running and evaluating agent behavior. You’ll implement base methods for agent action verification, integrate with internal and client infrastructures, and help fill tooling gaps across the team.

Who we're looking for :

Calling all security researchers, engineers, and penetration testers with a strong foundation in problem-solving, offensive security, and AI-related risk assessment.

We’re looking for someone who can bring a hands-on approach to technical challenges, whether breaking into systems to expose weaknesses or building secure tools and processes. We value contributors with a passion for continuous learning, experimentation, and adaptability.

What you’ll be doing :

  • Developing and maintaining MCP-compatible evaluation servers
  • Implementing logic to check agent actions against scenario definitions
  • Creating or extending tools that writers and QAs use to test agents
  • Working closely with infrastructure engineers to ensure compatibility
  • Occasionally helping with test writing or debug sessions when needed

Although we’re only looking for experts for this current project, contributors with consistent high-quality submissions may receive an invitation for ongoing collaboration across future projects.

Requirements

  • 4+ years of Python development experience , ideally in backend or tools
  • Solid experience building APIs , testing frameworks, or protocol-based interfaces
  • Understanding of Docker, Linux CLI, and HTTP-based communication
  • Ability to integrate new tools into existing infrastructures
  • Familiarity with how LLM agents are prompted, executed, and evaluated
  • Clear documentation and communication skills - you’ll work with QA and writers
  • We also value applicants who have :

  • Experience with Model Context Protocol (MCP) or similar structured agent-server interfaces
  • Knowledge of FastAPI or similar async web frameworks
  • Experience working with LLM logs, scoring functions, or sandbox environments
  • Ability to support dev environments (devcontainers, CI configs, linters)
  • JS experience
  • Benefits

  • Get paid for your expertise, with  rates that can go up to $55 / hour  depending on your skills, experience, and project needs.
  • Take part in a flexible, remote, freelance project that fits around your primary professional or academic commitments.
  • Participate in an advanced AI project and gain valuable experience to enhance your portfolio.
  • Influence how future AI models understand and communicate in your field of expertise.
  • serp_jobs.job_alerts.create_a_job

    Python Developer • SC, US

    Job_description.internal_linking.related_jobs
    • serp_jobs.job_card.promoted
    Non-Destructive Evaluation Technician

    Non-Destructive Evaluation Technician

    Alpek Polyester USAGaston, SC, US
    serp_jobs.job_card.full_time
    We are seeking a motivated individual to join and support our.CA - Columbia Quality Control team.Non-Destructive Evaluation (NDE) Technician. F;motivated by technical challenges and able to u...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    ObGyn

    ObGyn

    CompHealthCamden, South Carolina, US
    serp_jobs.job_card.full_time
    ObGyn physician employment in South Carolina : You will enjoy working in one of South Carolina's most historic areas, with parks, mansions, horse races, shopping, and antiques in this community kno...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Senior Python Developer

    Senior Python Developer

    VirtualVocationsColumbia, South Carolina, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior Python Engineer (Intranet).Key Responsibilities Develop, support, and optimize backend web applications using Python / Django Design system architecture and imple...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Licensed Professional Counselor (LPC) •New office opens in December! •

    Licensed Professional Counselor (LPC) •New office opens in December! •

    LifeStance HealthPelion, SC, US
    serp_jobs.job_card.full_time
    At LifeStance Health, we believe in a truly healthy society where mental and physical healthcare are unified to make lives better. Our mission is to help people lead healthier, more fulfilling lives...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    Platform & Infrastructure Engineer

    Platform & Infrastructure Engineer

    VirtualVocationsColumbia, South Carolina, United States
    serp_jobs.job_card.full_time
    A company is looking for a Platform & Infrastructure Engineer to join their technology team.Key Responsibilities Engineering new microservices and modifying existing services for higher scalabili...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    Licensed Clinical Therapist (LISW-CP / LPC / LMFT) •New office opens in December! •

    Licensed Clinical Therapist (LISW-CP / LPC / LMFT) •New office opens in December! •

    LifeStance HealthPelion, SC, US
    serp_jobs.job_card.full_time
    At LifeStance Health, we believe in a truly healthy society where mental and physical healthcare are unified to make lives better. Our mission is to help people lead healthier, more fulfilling lives...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Principal Observability Engineer

    Principal Observability Engineer

    VirtualVocationsColumbia, South Carolina, United States
    serp_jobs.job_card.full_time
    A company is looking for a Principal Observability Engineer to ensure reliable and scalable systems through expert guidance and data-driven recommendations. Key Responsibilities Design and impleme...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Oracle Integration Cloud Developer

    Oracle Integration Cloud Developer

    VirtualVocationsColumbia, South Carolina, United States
    serp_jobs.job_card.full_time
    A company is looking for an Oracle Integration Cloud OIC Developer.Key Responsibilities Develop and implement integrations using Oracle Cloud Application Development tools Create fast formulas, ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Site Safety Manager

    Site Safety Manager

    Jennings Air and MechanicalBlythewood, SC, US
    serp_jobs.job_card.full_time
    Jennings Air and Mechanical has an immediate opening for a.This role ensures compliance with federal, state, and local regulations, as well as company safety standards, to maintain a safe working e...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    GCP Data Engineer

    GCP Data Engineer

    VirtualVocationsColumbia, South Carolina, United States
    serp_jobs.job_card.full_time
    A company is looking for a GCP Data Engineer to design and implement scalable data pipelines on Google Cloud Platform.Key Responsibilities Build and maintain streaming and batch data pipelines us...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    EHS Coordinator

    EHS Coordinator

    ITACLexington, SC, US
    serp_jobs.job_card.full_time
    ITAC serves Process & Industrial clients with integrated engineering and construction services for complex capital projects. We also offer specialty services including power systems services and...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Cloud ETL Developer

    Cloud ETL Developer

    VirtualVocationsColumbia, South Carolina, United States
    serp_jobs.job_card.full_time
    A company is looking for a Cloud ETL Developer to support federal civilian agencies, particularly in managing and modernizing data warehouse infrastructure. Key Responsibilities Design, develop, a...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Data Infrastructure Engineer

    Data Infrastructure Engineer

    VirtualVocationsColumbia, South Carolina, United States
    serp_jobs.job_card.full_time
    A company is looking for a Software Engineer - Data Infrastructure.Key Responsibilities Identify and implement improvements to system's cost efficiency, reducing data storage and processing costs...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Platform SME

    Platform SME

    VirtualVocationsColumbia, South Carolina, United States
    serp_jobs.job_card.full_time
    A company is looking for a Platform SME.Key Responsibilities Create and maintain frameworks for platform health and performance, including reporting and dashboards Implement upgrades and CI / CD p...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    Platform Engineer

    Platform Engineer

    VirtualVocationsColumbia, South Carolina, United States
    serp_jobs.job_card.full_time
    A company is looking for a Platform Engineer.Key Responsibilities Manage and monitor cloud infrastructure using AWS services and tools Implement and automate infrastructure using Infrastructure ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Entry Level Pest Control Technician - Irmo, SC

    Entry Level Pest Control Technician - Irmo, SC

    Anticimex CarolinasIrmo, SC, US
    serp_jobs.job_card.full_time
    Competitive Compensation – Impressive Benefits – Potential for Growth – Work / Life Balance.Now hiring in Columbia, Lexington, Blythewood, Irmo, Batesburg-Leesville, and Eastover ar...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Principal LLM Engineer

    Principal LLM Engineer

    VirtualVocationsColumbia, South Carolina, United States
    serp_jobs.job_card.full_time
    A company is looking for a Principal Large Language Model Engineer.Key Responsibilities Design and implement high-performance, scalable LLM services using Python and Cloud technologies Collabora...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Senior Python Software Engineer

    Senior Python Software Engineer

    VirtualVocationsColumbia, South Carolina, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior Python Software Engineer with Networks.Key Responsibilities Lead and direct technical initiatives within the team Develop and implement new features and optimiz...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30