Search jobs > San Francisco, CA > Senior software engineer

Senior Software Engineer - ML Inference and Performance

AI Fund
San Francisco, California, US
Full-time

Are you passionate about advancing the frontiers of artificial intelligence? We are looking for a Senior Software Engineer to join our dynamic team.

This role is ideal for someone who thrives in a fast-paced startup environment and is eager to make significant contributions to the exciting field of machine learning.

If you are a backend engineer with machine learning exposure, who now wants to make that their focus, we look forward to your application.

Check below to see if you have what is needed for this opportunity, and if so, make an application asap.

Key Responsibilities :

  • Scaling, refining, and fine-tuning the performance of our ML models and its infrastructure.
  • Deep dive into underlying codebases of Pytorch, Transformers, CUDA, and other libraries to debug ML performance issues.
  • Optimize and scale machine learning models, particularly large language models.
  • Collaborate with a diverse team to design and implement innovative solutions.

Must Haves :

  • 3-10 years of experience with one or more general purpose programming languages, including but not limited to Python, Ruby, or Go.
  • Deep understanding of software engineering principles and a proven track record of developing and deploying AI / ML inference solutions.
  • Strong familiarity with ML libraries, especially PyTorch.
  • Demonstrated interest and experience in machine learning and large language models.
  • Deep understanding of GPU Architecture.
  • Familiarity with Docker and Kubernetes.

Bonus Points :

  • Proficiency in enhancing the performance of software systems, particularly in the context of LLMs.
  • Familiar with LLM optimization techniques (quantization, speculative decoding, continuous batching, etc.).
  • Experience with CUDA or similar technologies is highly advantageous.

What We Offer :

  • Competitive compensation package (Unlimited PTO, 401k, covered healthcare premiums, remote-first culture).
  • A unique opportunity to be part of a rapidly growing startup in one of the most exciting engineering fields of our era.
  • An inclusive and supportive work culture that fosters learning and growth.
  • Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.

Apply Now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.

At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.

J-18808-Ljbffr

1 day ago
Related jobs
Promoted
Tenjin
San Francisco, California

Full Time] Senior Software Engineer, Reporting and Data Warehousing at Tenjin (United States). Senior Software Engineer, Reporting and Data Warehousing. We're looking for a Senior Software Engineer with experience building low-latency, distributed data processing pipelines. You can explain complex t...

Promoted
Wherobots
San Francisco, California

As a frontend software engineer, you will build and expand on the foundation of our web application, and own the design and development of new features and user experiences in our TypeScript/Next. As a frontend software engineer, you will build and expand on the foundation of our web application, an...

Promoted
The Learning Experience #393
San Francisco, California

Streamline and automate the TRM machine learning lifecycle, focusing on deploying, monitoring, and maintaining ML models to ensure their efficient and reliable performance in production environments. As a Senior Software Engineer on the Data Platform team, you will be responsible for executing missi...

Promoted
ZEAL
San Francisco, California
Remote

Senior Software Engineer - Remote (backend, node. All our engineers here at Zeal are full-stack engineers, but we have a position available on the back-end leaning side (70/30) where you'd be working on our tax engine and API. Our easy-to-use payroll API and all-inclusive tax engine provide accessib...

Promoted
Scale AI, Inc.
San Francisco, California

With our recent Series F round, we're accelerating the abundance of frontier data to pave the road to Artificial General Intelligence (AGI), and building upon our prior model evaluation work with enterprise customers and governments, to deepen our capabilities and offerings for both public and priva...

Promoted
San Francisco Health Plan
San Francisco, California

As a Senior Software Engineer at SFHP, you will be part of a creative, innovative, and mission-driven software engineering team which plays a central role in building and delivering system integrations, applications, and automated processes. You will also be involved in designing and architecting so...

Promoted
Redolent Infotech Pvt. Ltd.
San Mateo, California

Contribute to software development guidelines and standards and promote their adoption within the engineering team. Profound understanding of software architecture (SOLID, KISS, BDUF), microservices architecture, software design patterns, data structures, and algorithms. Create and maintain the arch...

Promoted
Numero
San Francisco, California

We’re looking for engineers who have at least 6 years of professional software engineering experience and for whom the following values and concepts resonate:. Full Time] Senior Software Engineer, Backend at Numero (United States). Senior Software Engineer, Backend. We don’t need candidates to be ab...

Promoted
Adobe
San Francisco, California

We give everyone—from emerging artists to global brands—everything they need to design and deliver exceptional digital experiences! We’re passionate about empowering people to create beautiful and powerful images, videos, and apps, and transform how companies interact with customers across every scr...

Salesforce
San Francisco, California

By applying to the Full-Stack Software Engineer - Application Development posting, recruiters and hiring managers across the organization hiring Software Engineers will review your resume. And, we empower you to be a Trailblazer, too - driving your performance and career growth, charting new paths, ...