Search jobs > Santa Clara, CA > Senior software engineer

Senior Software Engineer, Deep Learning Inference Workflows

NVIDIA
Santa Clara, CA, US
Full-time

We are now looking for a Senior Software Engineer for Deep Learning Inference Workflows! Would you like to make a big impact in Deep Learning by helping build a state-of-the-art inference framework for accelerating Deep Learning models, especially Large Language Models, on NVIDIA GPUs?

We are now welcoming exceptional software engineers to apply to Senior Engineering positions in the Deep Learning software team.

What you’ll be doing :

Develop components of TensorRT, NVIDIA’s SDK for high-performance deep learning inference.

Use C++ and Python to build graph parsers, optimizers, and tools for effective deployment of trained deep learning models.

Collaborate with teams of deep learning experts, GPU architects and DevOps engineers across diverse teams.

What we need to see :

A Bachelor's, Master's, PhD or equivalent experience in Computer Science, Computer Engineering, Electrical Engineering or related field.

6+ years of software development experience.

Strong experience with C++11 / C++14.

Strong grasp of Machine Learning concepts, especially Natural Language Processing.

Excellent communication skills, and an aptitude for collaboration and teamwork.

Ways to stand out from the crowd :

Experience developing System Software.

Proficiency in Python as well as Background in GPU kernel programming using CUDA or OpenCL.

Experience in software performance benchmarking, profiling, and optimizations.

Background in compiler development

Experience in working with TensorRT, PyTorch, TensorFlow, ONNX Runtime or other ML frameworks.

NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us.

If you're creative, autonomous and love a challenge, we want to hear from you. Come, join our TensorRT Workflows team and help build the real-time, cost-effective computing platform driving our success in this exciting and quickly growing field.

The base salary range is 180,000 USD - 339,250 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and . NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

30+ days ago
Related jobs
Promoted
Google
Mountain View, California

ML/AI algorithms and tools, deep learning or natural language processing. Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. As a software engineer, you will work on a specific projec...

Promoted
TikTok
San Jose, California

Utilize cutting-edge deep learning and machine learning technologies to enhance and personalize the Lemon8 user experience. Welcome to the team, where our team of Machine Learning Engineers is dedicated to delivering personalized experiences to over 10 million monthly users worldwide. Bachelor's deg...

Promoted
Match Group, Inc.
Palo Alto, California

Apply state-of-the-art machine learning techniques, including deep learning, reinforcement learning, causal inference, and optimization, to enhance our foundational recommendation models. Collaborate with other machine learning engineers, backend software engineers, and product managers to integrate...

Promoted
TikTok
San Jose, California

Strong software programming capabilities, exhibits good code design and coding style. Deep understanding of data structure, algorithm design and analysis, networking, data security and highly scalable systems design. ...

Promoted
Apple Inc.
Cupertino, California

Senior Software Engineer - Core Networking. Apple is looking for a talented and energetic software engineer for the Core Networking team to lead and participate in the architecture and development of next generation networking technologies. BS/MS/PhD in Computer Science, Electrical Engineering, or e...

Promoted
TikTok
San Jose, California

Good grasp of software engineering and how to build a system in scalable and extensive manner. The TikTok LIVE - Foundation - Governance Engineering team is a global team responsible for ensuring the quality of live streaming content. Work closely with product manager, data scientist, UI designer, a...

Promoted
Nuro
Mountain View, California

This includes, but is not limited to, model training pipelines, onboard inference & optimizations, data & feature pipelines, reinforcement learning (RL) infrastructure and overall developer productivity & best practices. Collaborate closely with machine learning domain experts and engine...

Promoted
Gatik
Mountain View, California

We are seeking backend engineers for our software team to build our fleet management platform. Collaborate with the frontend and infrastructure engineers for successful implementation of product features. Design, develop, test, deploy, maintain and improve software. ...

Promoted
Google Inc.
Sunnyvale, California

Senior Software Engineer, Front End, Google Cloud Business Platforms. Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. As a software engineer, you will work on a specific project cr...

Motion Recruitment
California, United States

Proficient in streamlining development workflows with a keen interest in Site Reliability Engineering (SRE) practices and platform engineering. This role is great for someone who has a strong foundation in Google Cloud Platform (GCP) cloud infrastructure and enjoys working closely with engineering a...