Talent.com
serp_jobs.error_messages.no_longer_accepting
Manager, System Software - Triton Inference Server

Manager, System Software - Triton Inference Server

NVIDIAOregon, IL, US
job_description.job_card.1_day_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

Overview

NVIDIA is searching for a passionate Software Engineering Manager to lead the Triton Inference Server team. Triton is cutting-edge, open source inference software that powers AI deployment across cloud, data center, edge, and embedded devices—supporting models from TensorRT, TensorFlow, PyTorch, ONNX, and more. Join us to shape the future of scalable, production-ready AI solutions used by innovators around the globe.

What You Will Be Doing

  • Guide, mentor, and develop an inclusive and collaborative engineering team focused on delivering robust model serving solutions.
  • Drive planning, prioritization, and execution for projects that improve Triton's scalability, performance, and reliability in non-generative AI deployments.
  • Foster partnerships with Product and Program Management to create feature roadmaps, manage cross-team dependencies, and balance project resources for both cloud and on-premises platforms.
  • Collaborate with internal collaborators and external customers to understand use cases and convert their needs into product features.
  • Promote engineering excellence through modern, agile development practices and a culture of quality and accountability.

Qualifications

  • Master's or PhD, or equivalent experience, in Computer Science, Computer Engineering, or a related field.
  • Eight or more years of overall hands-on software development experience in customer-facing environments.
  • At least three years building, mentoring, and leading software engineering teams delivering production-grade solutions.
  • Deep background in scalable serving architectures, with direct experience building cloud-native inference APIs, REST / gRPC / protobuf-based services, or similar technologies.
  • Advanced C / C++ and Python development skills, demonstrating clean, object-oriented design, as well as proficiency in debugging, performance optimization, and testing.
  • Track record of contributing to or leading large open-source projects—using GitHub for code reviews, bug tracking, and release management.
  • Strong knowledge of agile methodologies and tools such as JIRA and Linear.
  • Ability to communicate technical topics with clarity and empathy to colleagues, partners, and diverse audiences.
  • Ways To Stand Out

  • Experience working within distributed, global teams.
  • Practical knowledge of machine learning model deployment with frameworks such as TensorRT, TRT-LLM, PyTorch, ONNX, Python, or similar platforms.
  • Understanding of CPU and GPU architectures.
  • Skills in GPU programming (e.g., CUDA or OpenCL).
  • Compensation & Benefits

    Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 224,000 USD - 356,500 USD. You will also be eligible for equity and benefits.

    Additional Information

    Applications for this job will be accepted at least until September 23, 2025. NVIDIA is committed to fostering a diverse work environment and is proud to be an equal opportunity employer. We do not discriminate on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

    Identifiers

    JR2003888

    J-18808-Ljbffr

    serp_jobs.job_alerts.create_a_job

    Software Inference • Oregon, IL, US

    Job_description.internal_linking.related_jobs
    Manager- IT Enterprise Analytics

    Manager- IT Enterprise Analytics

    Midland States BankRockford, Illinois, United States, 61101
    serp_jobs.job_card.full_time
    Manager- IT Enterprise Analytics.At Midland, we’re proud to be a little different.You can see it in our bright orange signs-but there’s more to it than that. With our heartfelt and personalized appr...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Travel Nurse RN - Operating Room - $2,326 to $2,475 per week in Sterling, IL

    Travel Nurse RN - Operating Room - $2,326 to $2,475 per week in Sterling, IL

    TravelNurseSourceSterling, IL, US
    serp_jobs.job_card.full_time
    TravelNurseSource is working with Fusion Medical Staffing to find a qualified OR RN in Sterling, Illinois, 61081!.Facility in Sterling, Illinois. Fusion Medical Staffing is seeking a skilled Operati...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Military Intelligence

    Military Intelligence

    NavyDixon, IL, United States
    serp_jobs.job_card.full_time
    ABOUT Effective, secure communication in the cyber domain is essential to the everyday operations of military intelligence in America’s Navy. Information Professionals who oversee the seamless opera...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Software Engineer, iOS Core Product - Rockford, USA

    Software Engineer, iOS Core Product - Rockford, USA

    SpeechifyRockford, IL, US
    serp_jobs.job_card.full_time
    The mission of Speechify is to make sure that reading is never a barrier to learning.Over 50 million people use Speechify's text-to-speech products to turn whatever they're reading – ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Territory Manager-Rockford, ILL

    Territory Manager-Rockford, ILL

    Butler Recruitment GroupDavis Junction, IL, US
    serp_jobs.job_card.full_time
    This sales position will provide various types of industrial hardware directly to customers within a defined geographic territory through cold-calling and prospecting activities.Essential Duties an...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    Travel Nurse RN - OR - Operating Room

    Travel Nurse RN - OR - Operating Room

    GetMed Staffing, Inc.Sterling, IL, US
    serp_jobs.job_card.full_time
    RN OR - Operating Room for a travel nursing job in Sterling, Illinois.Job Description & Requirements.GetMed Staffing is searching for a strong OR RN to assist our traveler-friendly client.A min...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Manager- IT Enterprise Analytics

    Manager- IT Enterprise Analytics

    Midland States Bank CareersRockford, IL, United States
    serp_jobs.job_card.full_time
    Any additional information you require for this job can be found in the below text Make sure to read thoroughly, then apply. Manager- IT Enterprise Analytics.At Midland, we’re proud to be a little d...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    Systems Security Supervisor (Low Voltage) (Rockford)

    Systems Security Supervisor (Low Voltage) (Rockford)

    First Midwest GroupRockford, IL, US
    serp_jobs.job_card.part_time
    This is an on-site position located in Rockford, IL.First Midwest Group is seeking a Building Systems Manager with strong management and technical skills to oversee a wide range of technology syste...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Store Manager In Training

    Store Manager In Training

    CVS HealthLoves Park, IL, US
    serp_jobs.job_card.full_time
    At CVS Health, we're building a world of health around every consumer and surrounding ourselves with dedicated colleagues who are passionate about transforming health care.As the nation's leading h...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Travel Nurse RN - Operating Room - $2,614 per week in Sterling, IL

    Travel Nurse RN - Operating Room - $2,614 per week in Sterling, IL

    TravelNurseSourceSterling, IL, US
    serp_jobs.job_card.full_time
    TravelNurseSource is working with Triage Staffing to find a qualified OR RN in Sterling, Illinois, 62353!.Shift Details : 8H Days (12 : 00 AM-12 : 00 PM). Length : 13 WEEKS 13 weeks.Apply for...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    Server

    Server

    Pizza HutFreeport, Illinois, United States
    serp_jobs.job_card.full_time
    SERVER WITH FULL BENEFITS 30+ HOURS PER WEEK.Long term & short-term disability insurance.Being a server at Pizza Hut is about making hungry people happy - with tips! It's about being independent an...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    Systems Technician

    Systems Technician

    SupplyCoreRockford, IL, US
    serp_jobs.job_card.permanent
    SupplyCore is a Certified Small Business federal contractor to the Department of Defense (DoD) and General Services Administration (GSA). We prioritize supporting our Military, allies, and Governmen...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Travel EEG Technologist

    Travel EEG Technologist

    Lucid Staffing SolutionsSterling, IL, US
    serp_jobs.job_card.full_time
    Lucid Staffing Solutions is seeking a travel EEG Technologist for a travel job in Sterling, Illinois.Job Description & Requirements. EEG Tech ready to make a meaningful impact while enjoying top...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    Systems and Compliance Manager

    Systems and Compliance Manager

    Galapagos Rockford Charter SchoolRockford, IL, US
    serp_jobs.job_card.full_time
    Systems And Compliance Manager.Galapagos Charter School prepares scholars for success in college and beyond through a rigorous academic program, a joyful learning environment, and a strong focus on...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Sr. Manager EHS

    Sr. Manager EHS

    PCI Pharma ServicesRockford, IL, US
    serp_jobs.job_card.full_time
    Bridge to thousands of biopharma companies and their patients.Our investment is in People who make an impact, drive progress and create a better tomorrow. Our strategy includes building teams across...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    Server

    Server

    LongHorn SteakhouseRockford, IL, US
    serp_jobs.job_card.full_time
    Legendary food and service begins with legendary people.We believe in earning the loyalty of our Team Members with our strong, diverse culture, well-done benefits and growth opportunities.It takes ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    IT Professional

    IT Professional

    NavyRockford, IL, United States
    serp_jobs.job_card.full_time
    ABOUT Effective, secure communication in the cyber domain is essential to the everyday operations of military intelligence in America’s Navy. Information Professionals who oversee the seamless opera...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Clinical Services Manager - Naperville, IL (Field Based)

    Clinical Services Manager - Naperville, IL (Field Based)

    Insulet CorporationRockford, IL, US
    serp_jobs.job_card.full_time
    Are you ready to take your career to the next level by joining a global medical device market leader in diabetes care? At Insulet Corporation, we are transforming lives with innovative products tha...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    Server

    Server

    Olive GardenRockford, IL, US
    serp_jobs.job_card.full_time
    Our Winning Family Starts With You! .Check out these great benefits!.Flexible schedules to help you balance other life commitments (school, childcare, family care, etc. Paid Sick Leave (1 hour for e...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Information Systems Technician

    Information Systems Technician

    NavyWinnebago County, IL, United States
    serp_jobs.job_card.full_time
    ABOUT Effective, secure communication in the cyber domain is essential to the everyday operations of military intelligence in America’s Navy. Information Professionals who oversee the seamless opera...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days