Talent.com
AI Agent Software Engineer - Agent Performance Engineering

AI Agent Software Engineer - Agent Performance Engineering

Assembled Inc.San Francisco, CA, United States
job_description.job_card.variable_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

About Assembled

Assembled builds the infrastructure that underpins exceptional customer support, empowering companies like CashApp, Etsy, and Robinhood to deliver faster, better service at scale. With solutions for workforce management, BPO collaboration, and AI-powered issue resolution, Assembled simplifies the complexities of modern support operations by uniting in-house, outsourced, and AI-powered agents in a single operating system. Backed by $70M in funding from NEA, Emergence Capital, and Stripe, and driven by a team of experts passionate about problem-solving, we’re at the forefront of support operations technology.

The Team

Our Agent Intelligence team is focused on maximizing AI agent performance and driving volume automation across voice, chat, and email channels. This team is vital for our vision of creating the ultimate omnichannel AI customer support agent and represents one of the fastest growing areas both inside our company and across the industry.

We're currently one of the largest companies deploying AI agents in production at massive scale, working with enterprise clients like Canva, Etsy, and Ramp. The engineering challenges are significant and largely unsolved : building sophisticated evaluation systems, automating knowledge generation, optimizing AI agent accuracy, and creating the infrastructure needed to continuously improve agent intelligence at scale.

Your Impact

As part of the Agent Performance Engineering team, you'll be working on the core systems that make our AI agents smarter, more accurate, and more capable of handling complex customer interactions. You'll be building the evaluation frameworks, knowledge automation systems, and intelligence optimization tools that directly impact our ability to automate customer support at enterprise scale.

Responsibilities

Build foundational evaluation infrastructure : Develop comprehensive evaluation systems from the ground up, including golden dataset creation, automated benchmarking, and model comparison tools. You'll help create the frameworks that enable us to measure and optimize AI agent performance across all communication channels.

Automate knowledge generation : Design and implement systems that automatically create synthetic guides, documentation, and metadata to improve agent knowledge bases. You'll work on cutting-edge approaches to knowledge extraction and augmentation.

Optimize AI agent accuracy : Enhance our retrieval systems, implement advanced prompt optimization techniques, and build tools that continuously improve agent responses through automated evaluation and refinement.

Develop intelligence infrastructure : Architect systems that enable rapid model upgrades, A / B testing of different AI approaches, and scalable evaluation pipelines that support enterprise deployment.

Drive volume automation : Focus on the north star goal of maximizing automated resolutions across voice, chat, and email by building the intelligence systems that make it possible.

About You

You might be a good fit if you :

Have 5+ years of experience in software engineering as an individual contributor

Have experience with AI evaluation systems, data pipelines, or AI model optimization

Are passionate about building systems that measure and improve AI performance

Have worked with retrieval systems, knowledge bases, or information extraction

Enjoy building tools and infrastructure that enable other engineers and AI systems to perform better

Are highly ambitious and driven, setting high goals for yourself and others

Put customers first, focusing on solving real problems that impact support quality

Enjoy fast-paced environments and can quickly adjust when new insights emerge

Have a bit of a maverick streak that helps you come up with creative solutions

Have made a noticeable impact on small teams and have solid experience in startups or smaller companies

Stay humble and open to feedback, value teamwork, and are always ready to learn and grow

Technologies You'll Work With

Python / Golang for evaluation systems and data processing

LLMs and prompt optimization frameworks

Vector databases and retrieval systems

AI evaluation and benchmarking tools

Data pipeline and automation infrastructure

Our U.S. benefits

Generous medical, dental, and vision benefits

Paid company holidays, sick time, and unlimited time off

Monthly credits to spend on each : professional development, general wellness, Assembled customers, and commuting

Paid parental leave

Hybrid work model with catered lunches everyday (M-F), snacks, and beverages in our SF & NY offices

401(k) plan enrollment

#J-18808-Ljbffr

serp_jobs.job_alerts.create_a_job

Software Engineer Ai • San Francisco, CA, United States

Job_description.internal_linking.related_jobs
  • serp_jobs.job_card.promoted
Principal Engineer, AI

Principal Engineer, AI

VirtualVocationsSan Jose, California, United States
serp_jobs.job_card.full_time
A company is looking for a Principal Engineer, AI Agents.Key Responsibilities Architect foundational AI strategy and drive capabilities for agentic AI and advanced analytics Design scalable AI-d...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Senior AI / ML Engineer

Senior AI / ML Engineer

VirtualVocationsHayward, California, United States
serp_jobs.job_card.full_time
A company is looking for a Staff Software Engineer - AI / ML, GenAI.Key Responsibilities Design, build, and deploy AI / ML models and solutions using Python and other scripting languages Develop and...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Software Engineer - AI Agent Infrastructure (Healthcare)

Software Engineer - AI Agent Infrastructure (Healthcare)

Honey HealthHayward, CA, US
serp_jobs.job_card.full_time
Honey Health is the all-in-one AI back office for primary and specialty care.Our AI agents autonomously handle core back-office jobs, such as aggregating patient data, processing orders and prescri...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
AI-Native Engineer

AI-Native Engineer

VirtualVocationsHayward, California, United States
serp_jobs.job_card.full_time
A company is looking for an AI-Native Engineer (Backend / Full-stack).Key Responsibilities Develop and scale the web app and Word add-in for contract negotiation automation Integrate LLMs and desi...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Principal Product Manager - Agentic AI

Principal Product Manager - Agentic AI

Five9San Ramon, CA, US
serp_jobs.job_card.full_time
Join us in bringing joy to customer experience.Five9 is a leading provider of cloud contact center software, bringing the power of cloud innovation to customers worldwide.Living our values everyday...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Senior / Staff Software Engineer - AI Agent Infrastructure (Healthcare)

Senior / Staff Software Engineer - AI Agent Infrastructure (Healthcare)

Honey HealthHayward, CA, US
serp_jobs.job_card.full_time
Honey Health is the all-in-one AI back office for primary and specialty care.Our AI agents autonomously handle core back-office jobs, such as aggregating patients data, processing orders and prescr...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Software Engineer, Enterprise AI

Software Engineer, Enterprise AI

Scale AI, Inc.San Francisco, CA, United States
serp_jobs.job_card.full_time
Scale GP (Scale Generative AI Platform) is an enterprise-grade Generative AI platform that provides APIs for knowledge retrieval, inference, evaluation, and more. We are looking for a strong enginee...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
Full-Stack AI Engineer

Full-Stack AI Engineer

VirtualVocationsHayward, California, United States
serp_jobs.job_card.full_time
A company is looking for a Full-Stack AI Engineer.Key Responsibilities Prototyping, building, and launching AI experiences for large retailers and enterprises Partnering with PM, sales, and clie...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
Staff AI Engineer

Staff AI Engineer

VirtualVocationsHayward, California, United States
serp_jobs.job_card.full_time
A company is looking for a Staff AI Engineer to develop advanced AI-powered mental health tools.Key Responsibilities Design, train, fine-tune, and evaluate machine learning and large language mod...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
AI Software Engineer

AI Software Engineer

VirtualVocationsFremont, California, United States
serp_jobs.job_card.full_time
A company is looking for an AI Software Engineer to lead the development of AI and ML solutions.Key Responsibilities Contribute to prototype efforts and deliver production-ready features with hig...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
  • serp_jobs.job_card.new
Principal Engineer, AI Architecture

Principal Engineer, AI Architecture

VirtualVocationsHayward, California, United States
serp_jobs.job_card.full_time
A company is looking for a Principal Engineer, AI Agents.Key Responsibilities Architect foundational AI strategy and capabilities for agentic AI and advanced analytics Design scalable AI-driven ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
  • serp_jobs.job_card.promoted
AI Product Engineer

AI Product Engineer

VirtualVocationsFremont, California, United States
serp_jobs.job_card.full_time
A company is looking for an AI Product Engineer (LLM-first Full-Stack).Key Responsibilities Design and ship end-to-end product features across frontend, backend, and AI services Utilize AI assis...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
AI Architect

AI Architect

VirtualVocationsFremont, California, United States
serp_jobs.job_card.full_time
A company is looking for an AI Architect to lead artificial intelligence and machine learning practices focused on industrial applications. Key Responsibilities Design and oversee the implementati...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Senior Software Engineer, AI Systems

Senior Software Engineer, AI Systems

VirtualVocationsFremont, California, United States
serp_jobs.job_card.full_time
A company is looking for a Senior Software Engineer, AI Systems - vLLM and MLPerf.Key Responsibilities Design and implement efficient inference systems for generative AI models Define benchmarki...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
AI Engineer Lead

AI Engineer Lead

VirtualVocationsConcord, California, United States
serp_jobs.job_card.full_time
A company is looking for a Lead or Principal AI Engineer.Key Responsibilities Lead the design, architecture, and execution of AI platforms for autonomous decision-making and intelligent automatio...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Senior / Staff Applied AI Engineer, Agents

Senior / Staff Applied AI Engineer, Agents

Scale AI, Inc.San Francisco, CA, United States
serp_jobs.job_card.full_time
At Scale, our mission is to accelerate the development of AI applications.For 8 years, Scale has been the leading AI data foundry, helping fuel the most exciting advancements in AI, including : gene...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
AI Engineer

AI Engineer

VirtualVocationsSan Jose, California, United States
serp_jobs.job_card.full_time
A company is looking for a Lead AI Engineer to develop and deploy machine learning models that impact the automotive industry. Key Responsibilities Develop and deploy multiple AI models into produ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
AI Automation Engineer

AI Automation Engineer

VirtualVocationsConcord, California, United States
serp_jobs.job_card.full_time
A company is looking for an AI & Automation Engineer to join their IT & Security Enterprise Applications team.Key Responsibilities Implement AI-powered solutions and integrate AI with enterprise ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
AI Infrastructure Engineer, Agents

AI Infrastructure Engineer, Agents

Scale AI, Inc.San Francisco, CA, United States
serp_jobs.job_card.full_time
As a Software Engineer on the ML Infrastructure team, you will design and build the platform for our agent sandboxing platform : the secure, high-performance code execution layer powering our agenti...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Senior AI Engineer

Senior AI Engineer

VirtualVocationsFremont, California, United States
serp_jobs.job_card.full_time
A company is looking for a Senior AI Agent Engineer (Go).Key Responsibilities Design and develop AI agents using Go programming language Collaborate with cross-functional teams to integrate AI s...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30