Talent.com
Backend AI Platform Engineer

Backend AI Platform Engineer

FreshworksBellevue, WA, US
job_description.job_card.30_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

Job Description

Job Description

Company Description

Organizations everywhere struggle under the crushing costs and complexities of “solutions” that promise to simplify their lives. To create a better experience for their customers and employees. To help them grow. Software is a choice that can make or break a business. Create better or worse experiences. Propel or throttle growth. Business software has become a blocker instead of ways to get work done.

There’s another option. Freshworks. With a fresh vision for how the world works.

At Freshworks, we build uncomplicated service software that delivers exceptional customer and employee experiences. Our enterprise-grade solutions are powerful, yet easy to use, and quick to deliver results. Our people-first approach to AI eliminates friction, making employees more effective and organizations more productive. Over 72,000 companies, including Bridgestone, New Balance, Nucor, S&P Global, and Sony Music, trust Freshworks’ customer experience (CX) and employee experience (EX) software to fuel customer loyalty and service efficiency. And, over 4,500 Freshworks employees make this possible, all around the world.

Fresh vision. Real impact. Come build it with us.

Job Description

We are seeking a Backend AI Platform Engineer to design and build core backend services that power our Agentic AI Platform, enabling reasoning-driven agents, multi-agent orchestration, dialog management, and outcome-based workflows.

You will work closely with the Principal AI Agentic Architect to implement high-performance APIs, orchestration runtimes, agent lifecycle management, and integration with frameworks like LangChain, LangGraph, and LangSmith. This role is hands-on and ideal for someone passionate about building robust, scalable backend systems in a fast-paced, startup-like environment.

Key Responsibilities :

Platform Backend Development

  • Experience building agent runtime systems, orchestration layers, or reasoning engines.
  • Implement agent runtime orchestration services for reasoning, planning, and tool invocation (integrating LangChain / LangGraph).
  • Develop APIs and SDKs for building, deploying, and managing agent workflows and tools.
  • Build stateful dialog management and memory services to support multi-turn, context-aware agents.
  • Implement multi-agent communication (A2A) protocols and shared context for collaborative agent behavior.

System Architecture & Scalability

  • Work with the Architect to build cloud-native, event-driven backend services using microservices or service mesh architecture.
  • Design task scheduling and workflow orchestration (e.g., Temporal / Airflow) for agent planning and long-running operations.
  • Develop real-time message buses (Kafka / Pub-Sub) for agent communication and event propagation.
  • Optimize LLM orchestration performance and cost efficiency with caching, batching, and token usage monitoring.
  • Integrations & Data Services

  • Implement integrations with enterprise systems, APIs, and knowledge sources (REST, GraphQL, gRPC).
  • Work with vector DBs (e.g., ElasticSearch, Pinecone, Weaviate, FAISS) and RAG pipelines for knowledge-augmented reasoning agents.
  • Support metadata and telemetry pipelines for LangSmith-based evaluation and observability.
  • Security, Compliance & Governance

  • Build secure multi-tenant backend services with RBAC, API authentication, and tenant isolation.
  • Ensure agent action auditability and reproducibility for compliance and governance.
  • Collaborate on implementing platform guardrails (rate limiting, content filtering, safe tool usage).
  • Testing, Observability & Reliability

  • Write automated test suites (unit, integration, load testing) for backend services.
  • Implement logging, tracing, and metrics (OpenTelemetry, Prometheus, Grafana) for full observability.
  • Participate in on-call rotations and improve platform resiliency and fault tolerance.
  • Please note : This is a hybrid role that will be based in San Mateo, CA or Bellevue, WA and requires an in-office presence three days per week (Tuesday - Thursday).

    Qualifications

    Required Qualifications :

  • 7+ years of backend engineering experience, with at least 2+ years in AI / ML platform development.
  • Strong programming skills in Java and Python
  • Hands-on experience with LangChain, LangGraph, LangSmith LLM / agent frameworks
  • Expertise in distributed systems, event-driven architectures, and microservices
  • Solid experience with cloud platforms (AWS), Kubernetes, and IaC (Terraform / Helm)
  • Familiarity with databases (PostgreSQL, Redis, MongoDB) and vector databases (ElasticSearch, Pinecone, FAISS, Weaviate)
  • Understanding of workflow orchestration (Temporal / Airflow) and messaging systems (Kafka, RabbitMQ)
  • Knowledge of AI / LLM (OpenAI, Anthropic, Azure OpenAI, etc.) and prompt / tool orchestration
  • Preferred Qualifications :

  • Exposure to conversation orchestration, dialog state tracking, and AI-driven planning systems
  • Familiarity with enterprise security standards (RBAC, SSO / OAuth2, data encryption)
  • Prior experience in startup or high-growth environments building SaaS platforms
  • Contributions to open-source AI agentic frameworks or backend libraries
  • Additional Information

    The annual base salary range for this position is $238,000 - $342,000.

    Compensation is based on a variety of factors including but not limited to location, experience, job-related skills, and level. Bonus / equity may be available.

    Freshworks offers multiple options for dental, medical, vision, disability and life insurances. Equity + ESPP, flexible PTO, flexible spending, commuter benefits and wellness benefits are also offered. Freshworks also offers adoption and parental leave benefits.

    At Freshworks, we are creating a global workplace that enables everyone to find their true potential, purpose, and passion irrespective of their background, gender, race, sexual orientation, religion and ethnicity. We are committed to providing equal opportunity for all and believe that diversity in the workplace creates a more vibrant, richer work environment that advances the goals of our employees, communities and the business.

    serp_jobs.job_alerts.create_a_job

    Ai Platform Engineer • Bellevue, WA, US

    Job_description.internal_linking.related_jobs
    • serp_jobs.job_card.promoted
    Content Designer (AI engineer)

    Content Designer (AI engineer)

    AquentRedmond, WA, US
    serp_jobs.job_card.full_time
    Are you fascinated by the AI transformation that is well under way? Are you eager to bring your writing skills to help create unprecedented AI-powered experiences for people across the globe? Are y...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    AI Engineer

    AI Engineer

    Armada SystemsBellevue, Washington, United States, 98005
    serp_jobs.job_card.full_time
    Armada is an edge computing startup that provides computing infrastructure to remote areas where connectivity and cloud infrastructure is limited, as well as areas where data needs to be processed ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    Senior Software Engineer - Audience Intelligence Job at ZipRecruiter in Seattle

    Senior Software Engineer - Audience Intelligence Job at ZipRecruiter in Seattle

    MediabistroSeattle, WA, United States
    serp_jobs.job_card.full_time
    StubHub is on a mission to redefine the live event experience on a global scale.Whether someone is looking to attend their first event or their hundredth, we\'re here to delight them all the way fr...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    Backend Data & Snowflake Engineer

    Backend Data & Snowflake Engineer

    3MD Inc.Redmond, WA, US
    serp_jobs.job_card.full_time
    Additionally, eligible hourly / non-exempt and exempt employees accrue up to 112 hours of PTO based on years of service and may annually take up to 8 hours of paid volunteer time.Additional paid sick...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    Applied Machine Learning Scientist II (AI / ML)

    Applied Machine Learning Scientist II (AI / ML)

    Blue OriginSeattle, WA, United States
    serp_jobs.job_card.permanent
    Applications will be accepted on an ongoing basis until the requisition is closed.At Blue Origin, we envision millions of people living and working in space for the benefit of Earth.We're working t...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    Founding AI Frontend Developer

    Founding AI Frontend Developer

    Naptha AISeattle, WA, US
    serp_jobs.job_card.full_time
    Founding AI Frontend Developer | naptha.We are seeking a talented frontend developer to join our team as a founding member, focusing on rapidly developing and deploying dynamic user interfaces for ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    Apple Inc. is hiring : Software Engineer - Visual Intelligence in Seattle

    Apple Inc. is hiring : Software Engineer - Visual Intelligence in Seattle

    MediabistroSeattle, WA, United States
    serp_jobs.job_card.full_time
    Seattle, Washington, United States Software and Services.We are looking for a software engineer to work on building the next generation of features for Visual Intelligence, including CV / ML, sensor ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    AI Product Manager

    AI Product Manager

    Aditi ConsultingRedmond, WA, US
    serp_jobs.job_card.full_time
    Summary : As a Principal Product Manager, you will define and execute the AI product strategy for technology that supports Elevate, with a focus on Nonprofit Customers. You will partner closely with ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    AI Automation Engineer III

    AI Automation Engineer III

    hackeroneSeattle, Washington, United States
    serp_jobs.job_card.full_time
    HackerOne is a global leader in offensive security solutions.Our HackerOne Platform combines AI with the ingenuity of the largest community of security researchers to find and fix security, privacy...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Data Engineer / Data Architect

    Data Engineer / Data Architect

    AiritosIssaquah, WA, US
    serp_jobs.job_card.full_time
    Data Architects define standards and design the flow of data throughout both the enterprise and the external ecosystem (customers, channels, etc. They work closely with users, systems designers, and...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    Senior Software Engineer - Audience Intelligence Seattle, Washington, United States

    Senior Software Engineer - Audience Intelligence Seattle, Washington, United States

    StubHub, Inc.Seattle, WA, United States
    serp_jobs.job_card.full_time
    Seattle, Washington, United States.StubHub is on a mission to redefine the live event experience on a global scale.Whether someone is looking to attend their first event or their hundredth, we’re h...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    Database Architect

    Database Architect

    Compunnel Inc.Redmond, WA, US
    serp_jobs.job_card.full_time
    IT experience, including more than 5 years specializing in Azure Database Migration, effectively led, managed, and governed technical teams. Understanding customer DB SQL server landscape.Configurin...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    AI Engineer

    AI Engineer

    ArmadaBellevue, WA, US
    serp_jobs.job_card.full_time
    Armada is an edge computing startup that provides computing infrastructure to remote areas where connectivity and cloud infrastructure is limited, as well as areas where data needs to be processed ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Frontend AI UI Engineer

    Frontend AI UI Engineer

    FreshworksBellevue, WA, US
    serp_jobs.job_card.full_time
    Organizations everywhere struggle under the crushing costs and complexities of “solutions” that promise to simplify their lives. To create a better experience for their customers and emp...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    AI engineer

    AI engineer

    Inflection.ioSeattle, WA, US
    serp_jobs.job_card.full_time
    AI Engineer – Agentic Systems & Marketing Workflow Automation.We empower marketers by leveraging the latest in large language models (LLMs) and AI agentic systems to optimize, automate, a...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Machine Learning Engineer, AWS Neuron Apps, AWS Neuron

    Machine Learning Engineer, AWS Neuron Apps, AWS Neuron

    AmazonSeattle, WA, United States
    serp_jobs.job_card.full_time
    AWS Neuron is the complete software stack for the AWS Inferentia and Trainium cloud-scale machine.Trn1 and Inf1 servers that use them. This role is for a software engineer in the Machine Learning Ap...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    Application Developer with AI experience

    Application Developer with AI experience

    ValiantIQ INCBOTHELL, Washington, USA
    serp_jobs.job_card.full_time
    M"> <...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.new
    ZipRecruiter is hiring : Senior Software Engineer - Audience Intelligence in Seat

    ZipRecruiter is hiring : Senior Software Engineer - Audience Intelligence in Seat

    MediabistroSeattle, WA, United States
    serp_jobs.job_card.full_time
    StubHub is on a mission to redefine the live event experience on a global scale.Whether someone is looking to attend their first event or their hundredth, we\'re here to delight them all the way fr...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours