Search jobs > Mountain View, CA > Principal data scientist

Principal Data Scientist, Gemini Core Modeling and Evaluations

Google
Mountain View, California, US
Full-time

Minimum qualifications :

  • Bachelor's degree in Machine Learning, Data Science, Information Management, Computer Science, or other Engineering discipline, or equivalent practical experience.
  • 15 years of experience in data science or other quantitative fields such as : statistics, machine learning, software engineering, or ML engineering.
  • Experience working on algorithmic products, production machine learning systems, and defining model evaluation metrics.
  • Experience in using data insights to drive product excellence.

Remember to check your CV before applying Also, ensure you read through all the requirements related to this role.

Preferred qualifications :

  • Experience developing high-growth technology products and services.
  • Ability to influence without direct authority, working on and with technical and cross-functional or highly matrixed teams who do not report into this role.
  • Ability to turn ambiguous problem spaces into clear solutions, and comfortable with new technology and thinking outside the box to develop and implement short- and long-term creative solutions.
  • Ability to work well cross-functionally, and manage organizational complexities and competing priorities.
  • Excellent project / product management and technical architecture skills, and the ability to deliver projects on time.
  • Excellent strategic thinking, data science, and analytical skills.

About the job

As a Principal Data Scientist, you will be a deeply technical and strategic data science leader for Gemini Core Modeling and Evaluations.

You (along with a small team of data scientists) will be responsible for defining the model evaluation criteria, influencing the supervised fine tuning data and evaluation prompt sets, identifying valuable signals for reinforcement learning human feedback, and improving human rater efficiencies.

Responsibilities

Develop deep product and user analytics that will help to drive quality and design directions, such as identifying signals that are predictive of user engagement or analyzing Gemini use cases (e.

g., coding, fact finding, or creativity and summarization). Develop insights around trends and drive model improvements that help achieve goals.

  • Drive forward the science of measuring Gemini, ensuring that our quality, factuality, and safety model evaluation metrics are indicative of the end-user experience, and help guide launch decisions for Gemini.
  • Manage experimentation and comparative evaluation, including the science, methodologies, tools, and measurement approaches to accelerate Gemini experimentation and innovation.
  • Guide the model's human evaluation process, including analyzing rater performance, influencing rater templates, updating training, and evolving our approach to ensure precise and accurate evaluations.

J-18808-Ljbffr

20 days ago
Related jobs
Promoted
LinkedIn
Sunnyvale, California

LinkedIn’s Data Science team leverages big data to empower business decisions and deliver data-driven insights, metrics, and tools in order to drive member engagement, business growth, and monetization efforts. Pay Transparency Policy Statement As a federal contractor, LinkedIn follows the Pay Trans...

Promoted
ADAPT Technology
Mountain View, California

The Role: Principal Engineer/Researcher – AI and Data Platforms. In this role, you will lead research initiatives, collaborate with top academic and industry experts, and develop innovative data solutions that will drive future mobility. Lead discussions and provide technical expertise in multiple d...

Promoted
TikTok
Mountain View, California

Apply your expertise in quantitative analysis, data mining, and the presentation of data to see beyond the numbers and understand how our customers interact with our ads products. Apply technical expertise with quantitative analysis, experimentation, data mining, and the presentation of data to deve...

Promoted
Lifeattinder
Palo Alto, California

Senior Data Scientist (Product Analytics). Please double check you have the right level of experience and qualifications by reading the full overview of this opportunity below. Mentorship through our MentorMatch program, access to 6,000+ online courses through Udemy, and an annual $3,000 stipend for...

Promoted
TikTok
San Jose, California

As a Data Scientist on TikTok's Trust & Safety team, you will be instrumental in ensuring that TikTok remains a safe, trustworthy, and risk-free environment to create and enjoy content across all of our apps while protecting our brand. Experience with statistical analysis and data modeling techn...

Promoted
Rippling
Atherton, California

The successful candidate will drive the development of AI algorithms and models, focusing on enhancing our platform's core capabilities through intelligent orchestration and optimization of work rhythms. Lead data-driven analysis and modeling efforts to derive insights that significantly boost team ...

Promoted
Machinify, Inc.
Palo Alto, California

Hardworking and supportive colleagues, and a leadership team that understands the importance of recruiting and retaining top talent. We are seeking a Principal Data Scientist | ML. Provide high level technical direction & guidance to a team of Senior and Staff Data Scientists, enabling them to d...

Promoted
Karkidi
Cupertino, California

Experience collecting and analyzing crowd-sourced data, language data, image data, and/or multi-modal data. Proficiency in data science, machine learning, and analytics: Including statistical data analysis and A/B testing. History driving projects of varying sizes and scopes - some will take months ...

Promoted
Zscaler
San Jose, California

The Zscaler Zero Trust Exchange is the company’s cloud-native platform that protects thousands of customers from cyberattacks and data loss by securely connecting users, devices, and applications in any location. As a Principal Data Scientist, you will have the opportunity to work on multiple fundam...

Walmart
Sunnyvale, California

Build data pipelines from multiple external and internal sources and extract data insights using data exploration and visualization techniques. The ideal candidate would have knowledge of accessibility best practices and join us as we continue to create accessible products and services following Wal...