About the Team
OpenAI's Human Data Team creates custom data solutions driving groundbreaking research. Our work enhances and evaluates our flagship models and products like ChatGPT, GPT-4, and Sora, and contributes to safety initiatives through collaboration with our Preparedness and Safety Systems teams.
We work with AI trainers to gather specialized data for training and evaluating our models across modalities such as video, audio, text, and tool actions.
Our goal is to develop scalable methods, tools, and platforms to generate and evaluate high-quality data from both synthetic sources and human experts in various fields, including mathematics, sciences, creative writing, programming, art, and safety.
We leverage OpenAI models to improve and streamline our data collection and quality processes.
About the Role
In this role, you will work side by side with research teams to iteratively design and evaluate new methods for collecting high quality human data.
You’ll use your knowledge of human cognition and data quality to co-design experiments, write instructions and assess the efficacy of our data collections.
In parallel, you’ll partner with engineering and operations to implement changes and iteratively improve how we run human data campaigns.
This role is based in San Francisco, CA. We use a hybrid work model of 3 days in the office per week and offer relocation assistance to new employees.
In this role that’s the first of its kind, you will :
Collaborate closely with researchers to understand, predict, and design tasks and quality rubrics to collect great human data.
Engage with data labelers and vendors to evolve training and feedback mechanisms
Create hiring assessments and brainstorm acquisition strategies for high skill data labelers
Design and conduct experiments to assess the impact of interventions on human data quality
Come up with creative strategies for collecting and assessing high-quality data.
Generate golden datasets and evaluation techniques
Work on multiple projects with tight timelines.
Do whatever needs to be done to make our models better.
You might thrive in this role if you :
Have a background in cognitive science, computational linguistics, human-computer interaction
Enjoy tackling big questions in an ambiguous and fast paced environment
Love being at the intersection of research and operational execution
AI Research Scientist
You'll collaborate with a talented team of data scientists, engineers, and domain experts to tackle complex challenges and deliver impactful solutions. Architect scalable and robust machine learning pipelines for deployment in production environments, ensuring reliability, efficiency, and mainta...
Advanced Senior AI Research Scientist
Collaborate with academia partners to stay on the cutting edge of AI, especially Gen AI technologies, provide through leadership on AI trend, AI use case innovation trend, new AI opportunities, or foreseeable limitation, risks, and concerns. As an Advanced Senior AI Research Scientist, you formulate...
Research Scientist, Human-AI Interaction
OpenAI's Human Data Team creates custom data solutions driving groundbreaking research. We work with AI trainers to gather specialized data for training and evaluating our models across modalities such as video, audio, text, and tool actions. In this role, you will work side by side with research te...
Advanced AI Research Scientist Associate Manager
Collaborate with academia partners to stay on the cutting edge of AI, especially Gen AI technologies, provide through leadership on AI trend, AI use case innovation trend, new AI opportunities, or foreseeable limitation, risks, and concerns. As an Advanced AI Research Scientist, you formulate real-w...
Founding Applied AI Research Scientist
Our team is hiring a Founding Applied AI Research Scientist who has experience tackling challenges at the intersection of document understanding, multimodal learning, and cutting-edge AI research. Model Pretraining and Fine-tuning: Experience with pretraining large models and fine-tuning them for do...
Artificial Intelligence Research Scientist (Gen AI - Multimodal Learning)
As an AI Research Scientist, you will have the opportunity to work with the AI Team on cutting-edge generative AI technologies for improving the content/video descriptors as well as our software offerings for generative AI-based content. We are currently looking for a full-time research scientist fo...
AI Research Scientist
As an AI Research Scientist at Autodesk Research, you will be doing fundamental and applied research that will help our customers imagine, design, and make a better world. We are a team of scientists, researchers, engineers, and designers working together on projects that range from learning-based d...
Research Scientist, Health AI
We work at the intersection of AI safety research and healthcare applications, aiming to create trustworthy AI models that can assist medical professionals and improve patient outcomes. As a Research Scientist, you will contribute to the development of safe and effective AI models for healthcare app...
AI Research Scientist (The Innovation Alchemist)
Are you passionate about advancing the field of artificial intelligence and working on groundbreaking research that pushes the boundaries of what’s possible? Do you thrive on solving complex challenges and developing new AI techniques that can revolutionize industries? If you’re excited about the op...
Senior AI Research Scientist
As a Senior AI Research Scientist, you'll lead groundbreaking research projects in artificial intelligence, pushing the boundaries of what's possible and driving innovation in AI technologies. If you're a seasoned AI researcher with a passion for pushing the boundaries of AI, we want you on our team...