Talent.com
ML Frameworks Software Development Engineer - vLLM
ML Frameworks Software Development Engineer - vLLMAdvanced Micro Devices, Inc. • Austin, TX, US
ML Frameworks Software Development Engineer - vLLM

ML Frameworks Software Development Engineer - vLLM

Advanced Micro Devices, Inc. • Austin, TX, US
job_description.job_card.variable_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

Overview

We care deeply about transforming lives with AMD technology to enrich our industry, our communities, and the world. Our mission is to build great products that accelerate next-generation computing experiences - the building blocks for the data center, artificial intelligence, PCs, gaming and embedded. Underpinning our mission is the AMD culture. We push the limits of innovation to solve the world's most important challenges. We strive for execution excellence while being direct, humble, collaborative, and inclusive of diverse perspectives.

THE ROLE

We are looking for an AI Software development engineer who is passionate about building and optimizing deep learning applications and machine learning frameworks. Be a part of an AMD development team and the open-source community to design, develop, test and deploy improvements to make us the best platform for generative artificial intelligence and deep neural networks. Incredibly talented industry specialists.

THE PERSON

The ideal candidate has strong technical and analytical skills in high performance C++. Able to communicate effectively and work optimally with different teams across AMD. Experience in tensor libraries or machine learning execution engines is a plus.

KEY RESPONSIBILITIES

  • Optimize key deep learning models on AMD GPUs
  • Develop and finetune inference and serving engines for large language models
  • Collaborate with AMD's architecture specialists to improve future products
  • Collaborate with operator libraries team to analyze and optimize training and inference for deep learning
  • Work in a distributed computing setting to optimize for both scale-up (multi-accelerator) and scale-out (multi-node) systems
  • Optimize the entire deep learning pipeline including graph compiler integration
  • Participate in new ASIC and hardware bring ups
  • Apply your knowledge of software engineering best practices

PREFERRED EXPERIENCE

  • Ability to work independently, define project goals and scope, and lead your own development effort
  • Deep Learning experience or knowledge - Natural Language Processing, Vision, Audio, Recommendation systems
  • Programming in High-Performance Domain-Specific Languages for GPU or ML ASIC Computing (HIP, CUDA, OpenCL, Triton, KNYFE, Mojo)
  • Using debuggers (LLDB, GDB) and profilers on heterogeneous hardware
  • PyTorch or TensorFlow
  • Familiarity with ML Graph Compilers (Glow, FX, XLA) is a plus
  • Knowledge of the lower levels of typical ML workflows from MLIR to LLVM all the way down to assembly language(s) is a plus
  • ACADEMIC CREDENTIALS

  • Master's or PhD in Computer Science, Computer Engineering or related fields
  • Benefits offered are described : AMD benefits at a glance. AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and / or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants' needs under the respective laws throughout all stages of the recruitment and selection process.

    J-18808-Ljbffr

    serp_jobs.job_alerts.create_a_job

    Software Engineer • Austin, TX, US

    Job_description.internal_linking.related_jobs
    Observability Pipeline Engineer - Hybrid

    Observability Pipeline Engineer - Hybrid

    Charles Schwab • Leander, TX, US
    serp_jobs.job_card.full_time
    At Schwab, you’re empowered to make an impact on your career.Here, innovative thought meets creative problem solving, helping us “challenge the status quo” and transform the finance industry togeth...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    QA / QC Coordinator

    QA / QC Coordinator

    POLK MECHANICAL COMPANY LLC • Buda, TX, US
    serp_jobs.job_card.full_time
    Polk Mechanical is Hiring a QA / QC Coordinator.The QA / QC Coordinator is a vital part of our project delivery team, ensuring that all work performed meets contract requirements and high-quality stand...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    PLM Teamcenter Software Engineer, Enterprise Technology Services

    PLM Teamcenter Software Engineer, Enterprise Technology Services

    Apple Inc. • Austin, TX, US
    serp_jobs.job_card.full_time
    PLM Teamcenter Software Engineer, Enterprise Technology Services.Austin, Texas, United States Software and Services.Apple is a place where extraordinary people gather to do their best work.Together...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Lead Software Engineer

    Lead Software Engineer

    Visa • Austin, TX, United States
    serp_jobs.job_card.temporary
    Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more t...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Staff ML Systems Engineer

    Staff ML Systems Engineer

    General Motors • Austin, TX, US
    serp_jobs.job_card.full_time
    This role is categorized as hybrid.This means the successful candidate is expected to report to offices in Austin, TX, Mountain View, CA or the Greater Seattle Area three times per week, at minimum...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Backend Developer (AI & LLM focus)

    Backend Developer (AI & LLM focus)

    HR Global • Austin, Texas, United States
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Our client is looking for a Senior Backend Developer to architect and build the next generation of their services.This role is ideal for an engineer who is not only proficient in traditional backen...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days
    Software Engineer, Platform - Round Rock, USA

    Software Engineer, Platform - Round Rock, USA

    Speechify • Round Rock, TX, US
    serp_jobs.job_card.full_time
    The mission of Speechify is to make sure that reading is never a barrier to learning.Over 50 million people use Speechify's text-to-speech products to turn whatever they're reading – ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    ML / LLM Operations Engineer

    ML / LLM Operations Engineer

    Evolent • Austin, TX, US
    serp_jobs.job_card.full_time
    Evolve your career by joining Evolent Health as an ML / LLM Operations Engineer.In this role you will monitor, evaluate, and ensure compliance for LLMs in healthcare settings, working across data sci...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_hours • serp_jobs.job_card.promoted • serp_jobs.job_card.new
    CMM Programmer, Tool & Die

    CMM Programmer, Tool & Die

    SpaceX • Bastrop, TX, US
    serp_jobs.job_card.permanent
    SpaceX was founded under the belief that a future where humanity is out exploring the stars is fundamentally more exciting than one where we are not. Today SpaceX is actively developing the technolo...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Senior DevOps Engineer (Ansible and Linux) - Hybrid

    Senior DevOps Engineer (Ansible and Linux) - Hybrid

    Charles Schwab • San Marcos, TX, US
    serp_jobs.job_card.full_time
    At Schwab, you’re empowered to make an impact on your career.Here, innovative thought meets creative problem solving, helping us “challenge the status quo” and transform the finance industry togeth...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_less • serp_jobs.job_card.promoted • serp_jobs.job_card.new
    Sr. Software Development Engineer, Annapurna Labs

    Sr. Software Development Engineer, Annapurna Labs

    ZipRecruiter • Austin, TX, US
    serp_jobs.job_card.full_time
    In this role, you will be responsible for leading a technical team critical in providing compute sanitization to the Neuron ML accelerators fleet. You will work closely with the hardware and softwar...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Modeling and Simulation Engineer

    Modeling and Simulation Engineer

    Cedarparktexasedc • Cedar Park, TX, US
    serp_jobs.job_card.permanent
    Career Opportunities with Firefly Aerospace.Come be a part of the 21 st Century Space Race!.Share with friends or Subscribe!. Current job opportunities are posted here as they become available.Subsc...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Sr. Embedded Software Engineer, Customer Hardware (Starlink)

    Sr. Embedded Software Engineer, Customer Hardware (Starlink)

    SPACE EXPLORATION TECHNOLOGIES CORP • Bastrop, TX, US
    serp_jobs.job_card.permanent
    Embedded Software Engineer, Customer Hardware (Starlink).SpaceX was founded under the belief that a future where humanity is out exploring the stars is fundamentally more exciting than one where we...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    MLOps Engineer

    MLOps Engineer

    Elios Talent • Austin, TX, US
    serp_jobs.job_card.full_time
    We are seeking an MLOps Engineer to design, implement, and maintain machine learning infrastructure at scale.You will build robust deployment pipelines, automate retraining workflows, and create to...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Software Developer

    Software Developer

    National Instruments • Round Rock, TX, US
    serp_jobs.job_card.full_time
    Job Category : Software Engineering.If you are a Software Developer, looking for an opportunity to grow, Emerson has an exciting opportunity for you! The position will be based in our offices in Rou...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Lead Specialist Inbound Leads (Strong English Fluency Required)

    Lead Specialist Inbound Leads (Strong English Fluency Required)

    CENTRAL TEXAS CLIMATE CONTROL INC • Leander, TX, US
    serp_jobs.job_card.full_time
    Are you a motivated communicator who thrives on results and loves turning leads into booked appointments or closed deals? Join one of the fastest-growing HVAC teams in Central Texas and help homeow...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Pediatric and Adolescent Gynecologist - Optum Tri-State - Yorktown Heights, NY

    Pediatric and Adolescent Gynecologist - Optum Tri-State - Yorktown Heights, NY

    Optum • Leander, TX, US
    serp_jobs.job_card.full_time
    Optum NY, (formerly Optum Tri-State NY) is seeking a Pediatric & Adolescent Gynecologist to join our team in Yorktown Heights, NY. Optum is a clinician-led care organization that is changing the...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Software Developer, Leander, TX

    Software Developer, Leander, TX

    Arkaitsolutions • Leander, TX, US
    serp_jobs.job_card.full_time
    Job Title : Software Developer / Analyst.Analyze, design, and develop software applications using various software languages and tools. Recommend software upgrades for customers' existing programs and ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted