Summary :
Would you like to play a part in shipping groundbreaking technology for large-scale systems, natural language, and artificial intelligence?
Join the Siri ML Systems Evaluation Engineering (MLSEE) team at Apple! We interact with various engineering teams to identify issues and test requirements, drive the quality of Siri features, and create frameworks that support evaluation and qualification.
You will work with the people who craft the intelligent assistant that helps millions of people get things done just by asking!As a senior manager, you will play a critical role in driving the evaluation methods of various platforms and product areas for Siri.
You will drive coverage and fidelity of testing and evaluation for pre-ship hill climbing and readiness for a wide range of AIML products, including Apple Intelligence features.
You will be crafting new and leveraging existing methodologies and frameworks to validate the end-to-end quality of new features.
Working alongside SW and ML engineering product teams as a critical partner, you will utilize a suite of available libraries and frameworks - test automation, LLM-based evaluators, and failure analysis tools - and drive requirements for improving those.
You will be responsible for benchmarking performance for new features / platforms and driving improvement recommendations.
Key Qualifications : Description :
Description :
We are seeking an expert senior engineering manager to lead Siri's intelligent services and platforms (iPhone, HomePod, CarPlay, Apple Watch, iPad, MacBook) evaluation and qualification.
You will be responsible for partnerships with product engineering that will drive the test and evaluation strategy, frameworks, performance testing framework, and solutions that can scale.
You will work alongside SW and ML engineering product teams as a critical partner. You will need to drive efficiency through the adoption of LLMs for testing and evaluation, including evaluators, auto-triage of issues, and auto-error-attribution.
This role will collaborate with Siri Engineering teams, create a quality strategy in partnership with the product roadmap, work on client integration and performance automation frameworks, analyze results, and reach consensus as we assess the impact of changes, new features, and overall readiness for each release.
This is a fast-paced role with high visibility, impact, and influence in building one of the most advanced AI systems in the industry.
Additional Requirements :
Senior Product Manager Trading
A company is looking for a Senior Product Manager, Trading for relocation to HK/SG. Key Responsibilities:Create and maintain the team's roadmap, milestones, and dependencies with strategic priorities in mindInterview and interact with customers to build empathy, ensuring that their needs are metPerf...
Senior Product Manager (Web)
Creative Product / Project Manager. Work with product and business stakeholders to define features and manage from concept to design to development. Bachelors degree with 4-7 years product or project management experience managing digital projects with consumer facing experiences (ecommerce and mobi...
Senior Manager Systems Engineering - COE
A company is looking for a Senior Manager, Systems Engineering - COE in the USA. ...
Senior Product Manager
As a Product Manager, you will collaborate with Engineering and User Experience leadership to lead cross-functional development teams. Work cross-functionally with engineering, UX, and data leaders to design & develop usable, desirable, and highly functional products. Leverage product data, mark...
Senior Staff Product Manager Developer Ecosystem
Key Responsibilities:Support the VP of Product in hiring, leading, and developing Product ManagersDefine and drive the company's vision and strategy for the GraphOS developer ecosystemOwn and evolve the user experience across various product surfaces and touchpointsRequired Qualifications:Experience...
Senior Product Manager, Borg
The world is always changing, so we need Product Managers who are continuously adapting and excited to work on products that affect millions of people every day. Work across product, user experience, and engineering teams to build, design, implement, and maintain compute products that schedule and p...
Senior Product Manager, Reliability and Sustainability
Senior Product Manager, Reliability and Sustainability. Positively influence sales, engineering, and customers to ensure success of your product. C3 AI product efforts in AI-based asset performance management and energy efficiency use cases. You will leverage your prior operations, sustainability, a...
Software Engineer, ML Product Evaluation Engineering
Does the opportunity to play a part in building groundbreaking technology for large-scale systems, natural language and artificial intelligence excite you? Do you want to expand the experience of Siri and other AIML products to new products that will help millions get things done, across the globe? ...
Senior Product Manager, Monetization
Director of Product for Monetization and will be responsible to support various products in the monetization product portfolio, including several ML products such as traffic shaping and QPS management algorithms. Product Manager to work on our Real Time Bidding and Machine Learning products in the m...
Senior Product Manager, Tech Strategic Platforms
Capability to write product guides/simple documentation for users, demo products, and create detailed user stories/Jira tickets with UX wireframes. With approximately 100 million customers worldwide using products such as TurboTax, Credit Karma, QuickBooks, and Mailchimp, we believe that everyone sh...