Talent.com
Staff Software Development Engineer (LLM) (Sunnyvale)

Staff Software Development Engineer (LLM) (Sunnyvale)

FortinetSunnyvale, CA, United States
job_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

Job Responsibilities :

  • Architect and implement functions to monitor and filter LLM requests / responses in real time, preventing prompt injection attacks and unauthorized data leakage.
  • Build a highly scalable pipeline capable of handling high-volume LLM traffic with low latency, including optimizing databases and caching for quick threat detection and response.
  • Develop monitoring, logging, and alerting systems to detect anomalies in LLM usage (e.g. suspicious spikes indicating denial-of-service attacks or unusual prompt patterns indicating misuse).
  • Collaborate with teams to translate security requirements into platform features. Mentor junior engineers on secure backend development and best practices in an Agile environment.
  • Ensure the timely delivery of high-quality software features while adhering to project schedules.
  • Communicate effectively across teams, with both technical and non-technical stakeholders, in both verbal and written forms.

Job requirements :

  • Hands-on experience with deploying or integrating large language models or other AI / ML systems (e.g. implementing model inference pipelines, fine-tuning models, or working with LLM APIs and prompt handling). Strong understanding of how prompts and context are managed in LLM applications.
  • Solid knowledge of application security principles and experience building secure systems. Familiarity with AI-specific threats (prompt injection, data poisoning, output manipulation) and a keen interest in staying ahead of new generative AI attack vectors.
  • Proven experience designing microservices architectures and using containerization (Docker) and orchestration (Kubernetes). Comfortable with cloud platforms (AWS, GCP, or Azure) and designing observable, resilient services in a production environment.
  • Ability to design clean, efficient, and secure APIs. Strong understanding of network protocols, data caching, and performance optimization.
  • Knowledge of data protection and privacy best practices - able to design systems that handle sensitive data responsibly and comply with regulations. Understanding of responsible AI principles (ethics, bias, transparency) and how they relate to secure AI system design.
  • Familiarity with emerging AI security guidelines such as OWASP's Top 10 for LLMs / Generative AI Security (e.g. knowledge of prompt injection, insecure output handling, data poisoning risks) and experience implementing related mitigations.
  • Experience with retrieval-augmented generation (RAG) architectures, vector databases / embedding stores, or streaming data pipelines for ML - especially as they relate to monitoring and securing LLM workflows (helps in addressing vector embedding attack vulnerabilities).
  • Understanding of responsible AI and techniques for detecting AI-generated misinformation or hallucinations. Experience building or integrating content filtering, policy enforcement, or fact-checking systems in AI applications is a plus.
  • Strong programming and debugging skills, particularly in Python and C / C++.
  • Familiarity with Frameworks like PyTorch or TensorFlow for model integration; libraries such as Hugging Face Transformers or LangChain for LLM and prompt management; LLM APIs (OpenAI, etc.) and vector databases is beneficial.
  • The US base salary range for this full-time position is $196,500-$219,300. Fortinet offers employees a variety of benefits, including medical, dental, vision, life and disability insurance, 401(k), 11 paid holidays, vacation time, and sick time as well as a comprehensive leave program.

    Wage ranges are based on various factors including the labor market, job type, and job level. Exact salary offers will be determined by factors such as the candidate's subject knowledge, skill level, qualifications, experience, and geographic location.

    All roles are eligible to participate in the Fortinet equity program, Bonus eligibility is reviewed at time of hire and annually at the Company's discretion.

    Why Join Us :

    We encourage candidates from all backgrounds and identities to apply. We offer a supportive work environment and a competitive Total Rewards package to support you with your overall health and financial well-being. Embark on a challenging, enjoyable, and rewarding career journey with Fortinet. Join us in bringing solutions that make a meaningful and lasting impact to our 660,000+ customers around the globe.

    serp_jobs.job_alerts.create_a_job

    Staff Software Engineer • Sunnyvale, CA, United States

    Job_description.internal_linking.related_jobs
    • serp_jobs.job_card.promoted
    Senior Staff Software Engineer, ML Engineering, Perception

    Senior Staff Software Engineer, ML Engineering, Perception

    WaymoMountain View, CA, United States
    serp_jobs.job_card.full_time
    Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver.Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on buildin...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Staff Software Engineer

    Staff Software Engineer

    SuperDialSan Mateo County, CA, US
    serp_jobs.job_card.full_time
    SuperDial is seeking a Staff Software Engineer to build and scale the backend systems that power large language model (LLM) applications in healthcare. This role is ideal for an engineer who thrives...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Staff Software Engineer (San Mateo County)

    Staff Software Engineer (San Mateo County)

    SuperDialSan Mateo County, CA, US
    serp_jobs.job_card.part_time
    SuperDial is seeking a Staff Software Engineer to build and scale the backend systems that power large language model (LLM) applications in healthcare. This role is ideal for an engineer who thrives...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    Staff Software Engineer (Sunnyvale)

    Staff Software Engineer (Sunnyvale)

    FortinetSunnyvale, CA, United States
    serp_jobs.job_card.full_time
    Join Fortinet, a cybersecurity pioneer with over two decades of excellence, as we continue to shape the future of cybersecurity and redefine the intersection of networking and security.At Fortinet,...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    Staff Software Development Engineer

    Staff Software Development Engineer

    FortinetSunnyvale, CA, United States
    serp_jobs.job_card.full_time
    We are seeking a highly experienced and technically proficient Staff Software Development Engineer to join our team.The ideal candidate will possess a strong background in networking technologies a...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    Staff Software Engineer

    Staff Software Engineer

    SupermicroSan Jose, CA, United States
    serp_jobs.job_card.full_time
    Supermicro is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop / Big Data, Hyperscale, HPC and IoT / Embedded customers...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Staff Software Engineer

    Staff Software Engineer

    VirtualVocationsFremont, California, United States
    serp_jobs.job_card.full_time
    A company is looking for a Staff Software Engineer to design and build applications and workflow automation for critical business and engineering processes. Key Responsibilities Translate high-lev...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    Senior Staff Software Engineer

    Senior Staff Software Engineer

    Second RenaissanceSan Francisco, CA, United States
    serp_jobs.job_card.full_time
    As a Senior Staff Software Optimization Engineer you will collaborate with a specialized team to drive C++ system optimizations for enhancing LLM model inference and training performance.You will p...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    Staff Software Engineer, ML Frameworks & Efficiency

    Staff Software Engineer, ML Frameworks & Efficiency

    WaymoMountain View, CA, United States
    serp_jobs.job_card.full_time
    Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver.Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on buildin...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Staff Software Engineer - Developer Experience

    Staff Software Engineer - Developer Experience

    Scale AI, Inc.San Francisco, CA, United States
    serp_jobs.job_card.full_time
    Scale is looking for an experienced Software Engineer to help shape the developer experience.The ideal candidate is someone who can design and develop automation frameworks and efficient workflows ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Staff Software Engineer, Evaluation Applications

    Staff Software Engineer, Evaluation Applications

    WaymoMountain View, CA, United States
    serp_jobs.job_card.full_time
    Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver.Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on buildin...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Staff Mobile Software Engineer

    Staff Mobile Software Engineer

    VirtualVocationsFremont, California, United States
    serp_jobs.job_card.full_time
    A company is looking for a Staff Mobile Software Engineer.Key Responsibilities : Write high-quality, production-ready code in C#, XAML, and. NET MAUI Own and complete user stories end-to-end, from...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    Staff Software Engineer, ML Frameworks & Efficiency (Mountain View)

    Staff Software Engineer, ML Frameworks & Efficiency (Mountain View)

    WaymoMountain View, CA, United States
    serp_jobs.job_card.full_time
    Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver.Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on buildin...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    Staff Engineer, IAM

    Staff Engineer, IAM

    VirtualVocationsOakland, California, United States
    serp_jobs.job_card.full_time
    A company is looking for a Staff Engineer, IAM Control Plane.Key Responsibilities Design and build next-generation IAM primitives for secure user access Develop user-facing permission models and...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    Staff Software Engineer - Growth Platform

    Staff Software Engineer - Growth Platform

    WaymoSan Francisco, CA, United States
    serp_jobs.job_card.full_time
    Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver.Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on buildin...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    Staff Software Engineer

    Staff Software Engineer

    PsiQuantumPalo Alto, CA, United States
    serp_jobs.job_card.full_time
    Quantum computing holds the promise of humanity's mastery over the natural world, but only if we can build a.PsiQuantum is on a mission to build the first real, useful quantum computers, capable of...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Software Development Engineer II

    Software Development Engineer II

    VirtualVocationsHayward, California, United States
    serp_jobs.job_card.full_time
    A company is looking for a Software Development Engineer II, API.Key Responsibilities Collaborate with the team to identify and scope tasks Design systems and ensure timely delivery of quality s...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Senior Staff Software Engineer - TLM

    Senior Staff Software Engineer - TLM

    WaymoSan Francisco, CA, United States
    serp_jobs.job_card.full_time +1
    Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver.Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on buildin...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days