Summary :
Would you like to play a part in shipping groundbreaking technology for large-scale systems, natural language, and artificial intelligence?
Join the Siri ML Systems Evaluation Engineering (MLSEE) team at Apple! We interact with various engineering teams to identify issues and test requirements, drive the quality of Siri features, and create frameworks that support evaluation and qualification.
You will work with the people who craft the intelligent assistant that helps millions of people get things done just by asking!As a senior manager, you will play a critical role in driving the evaluation methods of various platforms and product areas for Siri.
You will drive coverage and fidelity of testing and evaluation for pre-ship hill climbing and readiness for a wide range of AIML products, including Apple Intelligence features.
You will be crafting new and leveraging existing methodologies and frameworks to validate the end-to-end quality of new features.
Working alongside SW and ML engineering product teams as a critical partner, you will utilize a suite of available libraries and frameworks - test automation, LLM-based evaluators, and failure analysis tools - and drive requirements for improving those.
You will be responsible for benchmarking performance for new features / platforms and driving improvement recommendations.
Key Qualifications : Description :
Description :
We are seeking an expert senior engineering manager to lead Siri's intelligent services and platforms (iPhone, HomePod, CarPlay, Apple Watch, iPad, MacBook) evaluation and qualification.
You will be responsible for partnerships with product engineering that will drive the test and evaluation strategy, frameworks, performance testing framework, and solutions that can scale.
You will work alongside SW and ML engineering product teams as a critical partner. You will need to drive efficiency through the adoption of LLMs for testing and evaluation, including evaluators, auto-triage of issues, and auto-error-attribution.
This role will collaborate with Siri Engineering teams, create a quality strategy in partnership with the product roadmap, work on client integration and performance automation frameworks, analyze results, and reach consensus as we assess the impact of changes, new features, and overall readiness for each release.
This is a fast-paced role with high visibility, impact, and influence in building one of the most advanced AI systems in the industry.
Additional Requirements :
Senior Manager- Fire Protection Engineering - Las Vegas, NV
A leading engineering firm specializing in fire protection services is seeking a dynamic and experienced Senior Manager to lead their Las Vegas office's operations. Mid to senior-level experience in fire protection engineering. Oversee and participate in technical fire protection engineering pro...
Senior Product Manager, Lead Ads
We're looking for an experienced Product Manager to build highly scalable machine learning products that determine what ads billions of TikTok users see and engage with. TikTok's Lead Ads team is part of the TikTok Monetization Product organization and is responsible for building lead generation sol...
Senior Product Manager, Information Security
Working with internal business experts, internal / external consultants, and owners of products throughout the Live Nation ecosystem to define and prioritize the implementation of a world class information security product portfolio. Working with engineering, software, business leads and QA organiza...
Senior Global Product Marketing Manager, SMB Ecommerce & Core Ads
Experience doing product deep-dives proactively through data analysis and customer insights to identify product gaps, and working with product teams to drive product improvements. This role will act as "COO" of the SMB e-commerce solutions, and lead a broad set of efforts including determi...
Senior Product Manager, GTM Customer Data Enablement Platform
Define and drive product roadmaps enabling multiple personas (marketers, sales agents, partners, experts, product managers, developers, and end customers). Lead the end-to-end product development process, collaborating with engineering, design, data science, and other stakeholders. With approximatel...
Connected Physical Products - Electrical Engineer - Senior Manager
They design, develop and manage activities for a specific product or group of products from product definition and planning through production, release, and end of life. Product Management's involvement lasts throughout all stages of a product's lifecycle including modifications, upgrades, maintenan...
Senior Product Content Strategy Manager
Job Description Join our dynamic team as a Senior Product Content Strategy Manager, where you will be instrumental in driving our high level content strategies that enhance our technology, products and brand, while driving engagement, to deliver measurable business results. ESSENTIAL DUTIES AND RESP...
TikTok eCommerce Senior Product Manager - Creator & Affiliate Products
The mission of creator and affiliate product team is to design and build products that help creators to promote merchandise to TikTok users. Complete ownership of product feature development, from initial requirement management to post-live analysis, drive the best product efficiency and experience....
Senior Product Operations Manager
We are looking for a driven Senior Product Operations Manager who will be part of a global Product Operations team within our cross-discipline Product Organisation. You will support Product Ops Leadership in developing strategic direction for Product Operations that connects the role of the team to ...
Senior PR Manager - Product PR
You bring passion and dedication to your job and there's no telling what you could accomplish!We are currently seeking a Senior Manager, Public Relations to join our Product PR team. In this role, the Senior PR Manager will help drive planning and execute product PR launches and programs, pitch and ...