Talent.com
Principal Engineer - HPC, AI Infrastructure

Principal Engineer - HPC, AI Infrastructure

CiscoSan Jose, CA, United States
job_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

This position requires a hybrid working schedule in the San Jose or Milpitas office.

Meet the Team

We are an innovation team on a mission to transform how enterprises harness AI. Operating with the agility of a startup and the focus of an incubator, we're building a tight-knit group of AI and infrastructure experts driven by bold ideas and a shared goal : to rethink systems from the ground up and deliver breakthrough solutions that redefine what's possible - faster, leaner, and smarter.

We thrive in a fast-paced, experimentation-rich environment where new technologies aren't just welcome - they're expected. Here, you'll work side-by-side with seasoned engineers, architects, and thinkers to craft the kind of iconic products that can reshape industries and unlock entirely new models of operation for the enterprise.

If you're energized by the challenge of solving hard problems, love working at the edge of what's possible, and want to help shape the future of AI infrastructure - we'd love to meet you.

Impact

As High-performance AI compute engineer , you will be instrumental in defining and delivering the next generation of enterprise-grade AI infrastructure. As a principal engineer within our GPU and CUDA Runtime team, you will play a critical role in shaping the future of high-performance compute infrastructure. Your contributions will directly influence the performance, reliability, and scalability of large-scale GPU-accelerated workloads, powering mission-critical applications across AI / ML, scientific computing, and real-time simulation.

You will be responsible for developing low-level components that bridge user space and kernel space, optimizing memory and data transfer paths, and enabling cutting-edge interconnect technologies like NVLink and RDMA. Your work will ensure that systems efficiently utilize GPU hardware to its full potential, minimizing latency, maximizing throughput, and improving developer experience at scale.

This role offers the opportunity to impact both open and proprietary systems, working at the intersection of device driver innovation, runtime system design, and platform integration.

KEY RESPONSIBILITIES

  • Design, develop, and maintain device drivers and runtime components for GPU and network components of the systems.
  • Working with kernel and platform components to build efficient memory management paths using pinned memory, peer-to-peer transfers, and unified memory.
  • Optimize data movement using high-speed interconnects such as RDMA, InfiniBand, NVLink, and PCIe, with a focus on reducing latency and increasing bandwidth.
  • Implement and fine-tune GPU memory copy paths with awareness of NUMA topologies and hardware coherency.
  • Develop instrumentation and telemetry collection mechanisms to monitor GPU and memory performance without impacting runtime workloads.
  • Contribute to internal tools and libraries for GPU system introspection, profiling, and debugging.
  • Provide technical mentorship and peer reviews, and guide junior engineers on best practices for low-level GPU development.
  • Stay current with evolving GPU architectures, memory technologies, and industry standards.

Minimum Qualifications :

  • 10+ years of experience in systems programming, ideally with 5+ years focused on CUDA / GPU driver and runtime internals.
  • Minimum of 5+ years of experience with kernel-space development, ideally in Linux kernel modules, device drivers, or GPU runtime libraries (e.g., CUDA, ROCm, or OpenCL runtimes).
  • Experience working with NVIDIA GPU architecture, CUDA toolchains, and performance tools (Nsight, CUPTI, etc.).
  • Experience optimizing for NVLink, PCIe, Unified Memory (UM), and NUMA architectures.
  • Strong grasp of RDMA, InfiniBand, and GPUDirect technologies and their using in frameworks like UCX.
  • Minimum of 8+ years of experience programming within C / C++ with low-level systems proficiency (memory management, synchronization, cache coherence).
  • Bachelor' degree in STEM related field
  • Preferred Qualifications

  • Deep understanding of HPC workloads, performance bottlenecks, and compute / memory tradeoffs.
  • Expertise in zero-copy memory access, pinned memory, peer-to-peer memory copy, and device memory lifetimes.
  • Strong understanding of multi-threaded and asynchronous programming models.
  • Familiarity with python and AI framework like pytorch.
  • Familiarity with assembly or PTX / SASS for debugging or optimizing CUDA kernels.
  • Familiarity with NVMe storage offloads, IOAT / DPDK, or other DMA-based acceleration methods.
  • Familiarity with Valgrind, cuda-memcheck, gdb, and profiling with Nsight Compute / Systems.
  • Proficiency with perf, ftrace, eBPF, and other Linux tracing tools.
  • PhD is a plus, especially with research in GPU systems, compilers, or HPC.
  • serp_jobs.job_alerts.create_a_job

    Principal Engineer Ai • San Jose, CA, United States

    Job_description.internal_linking.related_jobs
    • serp_jobs.job_card.promoted
    Principal Engineer, AI

    Principal Engineer, AI

    VirtualVocationsHayward, California, United States
    serp_jobs.job_card.full_time
    A company is looking for a Principal Engineer, AI Agents.Key Responsibilities Architect foundational AI strategy and drive capabilities for agentic AI and advanced analytics Design scalable AI-d...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Principal AI Engineer

    Principal AI Engineer

    SynopsysMountain View, CA, United States
    serp_jobs.job_card.full_time
    You are a passionate and driven individual with a degree in Computer Science, Computer Engineering, or Electrical Engineering. With a strong foundation in Artificial Intelligence algorithms and expe...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Principal Solutions Engineer

    Principal Solutions Engineer

    VirtualVocationsHayward, California, United States
    serp_jobs.job_card.full_time
    A company is looking for a Principal Solution Engineer to join their solutions team as a trusted technical advisor for customers throughout the sales cycle. Key Responsibilities Lead technical dis...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    Principal Network Architect

    Principal Network Architect

    TEKsystemsSanta Clara, CA, United States
    serp_jobs.job_card.full_time
    This is a hands-on network engineering position focused on the architecture, design, development and deployment of ultra-high-speed, resilient, and scalable DC AI Clusters and Interconnects for GPU...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    Platform & Infrastructure Engineer

    Platform & Infrastructure Engineer

    VirtualVocationsHayward, California, United States
    serp_jobs.job_card.full_time
    A company is looking for a Platform & Infrastructure Engineer to join their technology team.Key Responsibilities Engineering new microservices and modifying existing services for higher scalabili...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Senior Principal Engineer

    Senior Principal Engineer

    VirtualVocationsOakland, California, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior Principal Engineer who will define the architectural vision and lead technical execution across the engineering organization. Key Responsibilities Define and evol...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    AI Engineer Lead

    AI Engineer Lead

    VirtualVocationsHayward, California, United States
    serp_jobs.job_card.full_time
    A company is looking for a Lead or Principal AI Engineer.Key Responsibilities Lead the design, architecture, and execution of AI platforms for autonomous decision-making and intelligent automatio...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Technology Architect, Principal

    Technology Architect, Principal

    Pacific Gas and Electric CompanyOakland, CA, United States
    serp_jobs.job_card.full_time
    Job Category : Information Technology.Business Unit : Information Technology.PG&E's Information Technology (IT) organization is a unified organization comprised of various departments which collabora...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    Principal Engineer - HPC, AI Infrastructure

    Principal Engineer - HPC, AI Infrastructure

    Cisco Systems, Inc.San Jose, CA, United States
    serp_jobs.job_card.full_time
    This position requires a hybrid working schedule in the San Jose or Milpitas office.We are an innovation team on a mission to transform how enterprises harness AI. Operating with the agility of a s...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    Licensed Principal Engineer - Data Centers

    Licensed Principal Engineer - Data Centers

    VirtualVocationsSanta Clara, California, United States
    serp_jobs.job_card.full_time
    A company is looking for an Associate Principal Engineer - Data Centers.Key Responsibilities Lead delivery of complex projects for specific offerings, verticals, and clients Develop best-in-clas...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    Principal AI Security Architect

    Principal AI Security Architect

    VirtualVocationsHayward, California, United States
    serp_jobs.job_card.full_time
    A company is looking for a Principal AI Security Architect.Key Responsibilities Define the Secure Development Life Cycle (SDLC) for AI products Assist architecture and R&D teams in creating secu...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    AI Infrastructure Engineer, Model Serving Platform

    AI Infrastructure Engineer, Model Serving Platform

    Scale AI, Inc.San Francisco, CA, United States
    serp_jobs.job_card.full_time
    As a Software Engineer on the ML Infrastructure team, you will design and build platforms for scalable, reliable, and efficient serving of LLMs. Our platform powers cutting-edge research and product...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Principal Software Engineer, Perception Systems

    Principal Software Engineer, Perception Systems

    WaymoSan Francisco, CA, United States
    serp_jobs.job_card.full_time
    Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver.Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on buildin...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    Principal AI Infrastructure Abstraction Engineer

    Principal AI Infrastructure Abstraction Engineer

    Cisco Systems, Inc.San Jose, CA, United States
    serp_jobs.job_card.full_time
    This position requires a hybrid working schedule in the San Jose or Milpitas office.We are an innovation team on a mission to transform how enterprises harness AI. Operating with the agility of a s...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    AI Infrastructure Engineer, ML Data Platform

    AI Infrastructure Engineer, ML Data Platform

    Scale AI, Inc.San Francisco, CA, United States
    serp_jobs.job_card.full_time
    Scale's AI Infrastructure team supports both R&D and applied Generative AI initiatives, driving breakthroughs in areas of post-training research such as AI safety, agents, and evaluating state-of-t...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Principal Engineer, AI Architecture

    Principal Engineer, AI Architecture

    VirtualVocationsOakland, California, United States
    serp_jobs.job_card.full_time
    A company is looking for a Principal Engineer, AI Agents.Key Responsibilities Architect foundational AI strategy and capabilities for agentic AI and advanced analytics Design scalable AI-driven ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Principal Engineer, Infrastructure

    Principal Engineer, Infrastructure

    VirtualVocationsHayward, California, United States
    serp_jobs.job_card.full_time
    A company is looking for a Principal Engineer, Infrastructure.Key Responsibilities Lead the strategy and execution for infrastructure, test automation, and release automation for the cloud analyt...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    AI Infrastructure Engineer, Agents

    AI Infrastructure Engineer, Agents

    Scale AI, Inc.San Francisco, CA, United States
    serp_jobs.job_card.full_time
    As a Software Engineer on the ML Infrastructure team, you will design and build the platform for our agent sandboxing platform : the secure, high-performance code execution layer powering our agenti...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Principal Azure Architect

    Principal Azure Architect

    VirtualVocationsFremont, California, United States
    serp_jobs.job_card.full_time
    A company is looking for a Principal Architect.Key Responsibilities Lead architecture and design reviews for Azure and call center environments Own and evolve the architecture blueprint, includi...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    Platform & Infrastructure Engineer

    Platform & Infrastructure Engineer

    MindsdbSan Francisco, CA, US
    serp_jobs.job_card.full_time
    Job description ABOUT USMindsDB is a fast-growing AI startup headquartered in San Francisco, California.MindsDB is an AI Analytics solution that connects to diverse data sources and applications th...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day