Talent.com
AI Infrastructure Engineer

AI Infrastructure Engineer

StackAISan Francisco, CA, United States
job_description.job_card.variable_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

About the Role

We’re hiring an AI Infrastructure Engineer to shape and scale the backend systems that power our AI platform. As a Series A company, your work will be foundational, enabling safe, efficient, and reliable AI workflows from end to end.

What You’ll Do

Design and implement scalable backend architectures for AI workloads (inference, orchestration, monitoring).

Own distributed job orchestration with Temporal and related systems.

Improve data pipeline performance by designing smarter caching strategies (e.g., file deduplication, hot / cold storage, Redis caching layers) to reduce redundant compute and API calls.

Build observability, monitoring, retries, and fault tolerance into all workflows.

Manage infrastructure reliability, incident response, and performance.

Develop tooling and platform infrastructure to support rapid growth.

Partner with ML engineers to bring models to production at scale.

What We’re Looking For

4+ years of backend engineering (Python is a must).

Strong background in distributed systems, job orchestration, and task queues.

Deep knowledge of concurrency, parallelism, and multithreading—including async / await, event loops, thread pools, synchronization primitives, deadlocks, and race conditions—is a must. You should know how to design systems that maximize throughput without sacrificing correctness or safety.

Hands-on experience with Temporal, Redis, Airflow, Celery, RabbitMQ (or similar).

Experience with LLM serving and routing fundamentals (rate limiting, streaming, load balancing, budgets).

Comfortable with containers & orchestration : Docker, Kubernetes.

Familiarity with cloud platforms (AWS / GCP) and IaC (Terraform).

Experience with multiple storage systems : S3, Postgres, MongoDB, Redis, and Elasticsearch.

Track record scaling systems in startups or fast-paced environments.

Understanding of deploying, monitoring, and optimizing AI / ML systems in production with strong CI / CD practices.

Why You’ll Love Working Here

Play a foundational role at a fast-growing Series A startup that is shaping the future of AI in enterprise workflows.

Collaborate across Product, ML, and Platform teams, being the bridge between AI logic and scalable execution.

Build infrastructure that enables real value for large enterprises : low-code, secure, and scalable AI workflows.

Join a company that’s scaling thoughtfully and values developer experience.

#J-18808-Ljbffr

serp_jobs.job_alerts.create_a_job

Infrastructure Engineer • San Francisco, CA, United States

Job_description.internal_linking.related_jobs
  • serp_jobs.job_card.promoted
Senior Infrastructure Engineer

Senior Infrastructure Engineer

Ariat InternationalSan Leandro, CA, US
serp_jobs.job_card.full_time
We are looking for a seasoned Senior Infrastructure Engineer to join our IT team and contribute to the design, deployment, and management of enterprise infrastructure systems.This role is critical ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Software Engineer - AI Agent Infrastructure (Healthcare) (Sunnyvale)

Software Engineer - AI Agent Infrastructure (Healthcare) (Sunnyvale)

Honey HealthSunnyvale, CA, US
serp_jobs.job_card.full_time +1
Honey Health is the all-in-one AI back office for primary and specialty care.Our AI agents autonomously handle core back-office jobs, such as aggregating patient data, processing orders and prescri...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Software Engineer - AI Agent Infrastructure (Healthcare) (Fremont)

Software Engineer - AI Agent Infrastructure (Healthcare) (Fremont)

Honey HealthFremont, CA, US
serp_jobs.job_card.full_time +1
Honey Health is the all-in-one AI back office for primary and specialty care.Our AI agents autonomously handle core back-office jobs, such as aggregating patient data, processing orders and prescri...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Software Engineer, Data Infrastructure - Research

Software Engineer, Data Infrastructure - Research

OpenAISan Francisco, CA, United States
serp_jobs.job_card.full_time
The Workload team is responsible for designing and running OpenAI’s LLM training and inference infrastructure that powers frontier models at massive scale. Our systems unify how researchers train an...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Software Engineer - AI Agent Infrastructure (Healthcare) (San Jose)

Software Engineer - AI Agent Infrastructure (Healthcare) (San Jose)

Honey HealthSan Jose, CA, US
serp_jobs.job_card.full_time +1
Honey Health is the all-in-one AI back office for primary and specialty care.Our AI agents autonomously handle core back-office jobs, such as aggregating patient data, processing orders and prescri...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Infra / Platform Engineer

Infra / Platform Engineer

Approach VentureBerkeley, CA, US
serp_jobs.job_card.full_time
Infrastructure Engineer – Build Data Platforms & Internal Tools for Robotics!.An early-stage robotics startup is creating the foundation for general-purpose robotics by developing the inf...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
AI QA & Infrastructure Engineer

AI QA & Infrastructure Engineer

AidalySan Francisco, CA, US
serp_jobs.job_card.full_time
At Aidaly, we believe family caregivers are the future of healthcare and the backbone of a thriving economy.In-home care is the fastest-growing part of healthcare, but demand is outpacing supply.We...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Software Engineer - AI Agent Infrastructure (Healthcare)

Software Engineer - AI Agent Infrastructure (Healthcare)

Honey HealthSan Jose, CA, US
serp_jobs.job_card.full_time
Honey Health is the all-in-one AI back office for primary and specialty care.Our AI agents autonomously handle core back-office jobs, such as aggregating patient data, processing orders and prescri...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Backend Infrastructure Engineer (San Francisco)

Backend Infrastructure Engineer (San Francisco)

Strategic Employment Partners (SEP)San Francisco, CA, US
serp_jobs.job_card.full_time +1
Join a stealth-mode startup on a mission to redefine how people shop online.Our client is building a hyper-personalized, AI-powered shopping experience backed by some of the most successful names i...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Software Engineer - AI Agent Infrastructure (Healthcare) (Hayward)

Software Engineer - AI Agent Infrastructure (Healthcare) (Hayward)

Honey HealthHayward, CA, US
serp_jobs.job_card.full_time +1
Honey Health is the all-in-one AI back office for primary and specialty care.Our AI agents autonomously handle core back-office jobs, such as aggregating patient data, processing orders and prescri...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Distinguished AI Engineer (Agentic AI Platform Infrastructure)

Distinguished AI Engineer (Agentic AI Platform Infrastructure)

Capital OneSan Francisco, CA, United States
serp_jobs.job_card.part_time
You love to build systems, take pride in the quality of your work, and also share our passion to do the right thing.You want to work on problems that will help change banking for good.Passion for s...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
AI Infrastructure Engineer

AI Infrastructure Engineer

SpellbrushSan Francisco, CA, US
serp_jobs.job_card.full_time
Spellbrush, the world’s leading generative AI studio behind.AI Infrastructure Engineer to join us in building out end-to-end ML infrastructure to run our models on all platforms.Design, imple...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
ML Infrastructure Engineer

ML Infrastructure Engineer

PhizenixMenlo Park, CA, US
serp_jobs.job_card.full_time +1
Menlo Park, CA | On-Site | Full-Time / Direct Hire.Looking for ML Infra experts (Bay Area preferred) with deep experience in CUDA, GPU optimization, VLLMs, and LLM inference—pure language focus...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
Senior Infrastructure Engineer (San Leandro)

Senior Infrastructure Engineer (San Leandro)

Ariat InternationalSan Leandro, CA, US
serp_jobs.job_card.full_time +1
We are looking for a seasoned Senior Infrastructure Engineer to join our IT team and contribute to the design, deployment, and management of enterprise infrastructure systems.This role is critical ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Senior / Staff Software Engineer - AI Agent Infrastructure (Healthcare) (Fremont)

Senior / Staff Software Engineer - AI Agent Infrastructure (Healthcare) (Fremont)

Honey HealthFremont, CA, US
serp_jobs.job_card.full_time +1
Honey Health is the all-in-one AI back office for primary and specialty care.Our AI agents autonomously handle core back-office jobs, such as aggregating patients data, processing orders and prescr...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
  • serp_jobs.job_card.promoted
Senior Infrastructure Engineer

Senior Infrastructure Engineer

PRAGMATIKESan Francisco, CA, US
serp_jobs.job_card.full_time
Cambridge, MA (Eastern Time / UTC -4).We are hiring at Pragmatike to expand our team and drive the growth of our internal projects. Our focus is on developing cutting-edge solutions in Cloud Computi...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
ML Infrastructure Engineer

ML Infrastructure Engineer

Symbolica AISan Francisco, CA, US
serp_jobs.job_card.full_time
Symbolica is an AI research lab pioneering the application of category theory to enable logical reasoning in machines.We're a well-resourced, nimble team of experts on a mission to bridge the g...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
  • serp_jobs.job_card.promoted
AI Infrastructure Engineer

AI Infrastructure Engineer

LanceDBSan Francisco, CA, United States
serp_jobs.job_card.full_time
From hyper-scalable vector search to advanced retrieval for RAG, from streaming training data to interactive exploration of large-scale AI datasets, LanceDB is the best foundation for your AI appli...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days