Human-Aware Interaction and Learning Research Scientist - Perception

Toyota Research Institute
Los Altos, California, US
Full-time

At Toyota Research Institute (TRI), we’re on a mission to improve the quality of human life. We’re developing new tools and capabilities to amplify the human experience.

To lead this transformative shift in mobility, we’ve built a world-class team in Human-Centered AI, Human Interactive Driving, Energy and Materials, Machine Learning, and Robotics.

Be one of the first applicants, read the complete overview of the role below, then send your application for consideration.

Our Human-Aware Interaction and Learning team is looking for Research Scientists with experience in robotic perception and computer vision, as part of a bigger team that explores human-robot interaction on the road.

We are aiming to make progress on a key challenge to unlock the full potential of artificial intelligence in a human world : how do we make machines more safely and effectively interact with humans to augment their capabilities?

As a Research Scientist , you will work with a multidisciplinary team proposing, conducting, and transferring innovative research in various aspects of robotic perception toward human-centric applications in driving, including high-performance driving.

You will build prototypes that test your ideas in the real world and publish them at top academic venues. You will help to transfer and ship our most successful algorithms and models toward real-world advanced assistance systems, touching millions of lives.

Responsibilities

  • Conduct ambitious research in perception for robotic systems that solve open problems of high practical value and validate it in real-world benchmarks and systems.
  • Implement state of the art perception algorithms and research to run in real-time as a part of a high performance system including planning and control.
  • Push the boundaries of knowledge and the state of the art in Human-Machine Interaction and Shared Control in robotics and driving contexts.
  • Partner with a multidisciplinary team including other research scientists and engineers across the Human Interactive Driving team, TRI, Toyota, and our university partners.
  • Stay up to date on the state-of-the-art in computer vision and robotic perception.
  • Present results in verbal and written communications, internally, at top international venues, and via open-source contributions to the community.
  • Lead collaborations with our external research partners (e.g., MIT, Stanford, UMich) and mentor research interns.

Qualifications

Bachelor’s or Master’s degree in a quantitative field (e.g. Computer Science, Mathematics, Physics, Engineering, Chemistry).

Ph.D. or deep expertise in one key area (Computer Vision, Robotics) or related fields.

Proficient in scientific Python, Unix, and robotic frameworks (e.g. ROS2.0), as well as common DL frameworks (preferably PyTorch).

Experience with distributed learning (especially on AWS) is a plus.

  • Proficient in practical computer vision for robotic systems, including experience with geometric computer vision such as camera calibration, optimization and filtering / smoothing framework, key point, and descriptor extraction.
  • Consistent track record of publishing at high-impact conferences / journals (CVPR, CoRL, RSS, ICRA, ICCV, ECCV, PAMI, IJCV, etc.

centered around computer vision and perception.

  • You can identify, propose, and lead new research projects, working in collaboration with other researchers and engineers to complete it from initial idea to working solution.
  • You are passionate about developing and applying human-centric artificial intelligence for societal good.
  • You are a reliable team-player. You like to think big and go deeper. You care about openness and delivering with integrity.

Please add a link to Google Scholar and include a full list of publications when submitting your CV to this position.

J-18808-Ljbffr

17 days ago
Related jobs
Promoted
Walmart
Sunnyvale, California

AI scientists and machine learning engineers dedicated to solving sophisticated and high-impact problems that power Walmart's transportation network end-to-end from vendors to stores. We leverage advanced algorithms in operations research, deep reinforcement learning, economics (market design), and ...

Promoted
TikTok
San Jose, California

The algorithm team is responsible for developing state-of-the-art computer vision, NLP and multimodality models and algorithms to protect our platform and users from the content and behaviors that violate community guidelines and related regulations. TikTok's global headquarters are in Los Angeles a...

Nuro
Mountain View, California

In this role, you will work closely with the software vertical teams to understand their pain points and explore novel and advanced machine learning methods to solve practical real-world challenging problems. To name a few, using self-supervised learning to learn robust representations, exploring te...

ByteDance
San Jose, California

With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content. About the team:Our team at ByteDa...

NVIDIA
Santa Clara, California

We are now looking for a Research Scientist, Video GenAI and Embodied AI!. NVIDIA is searching for a world-class researcher in video foundation model and embodied AI to join our research team. You will be conducting original research for video GenAI and Embodied, including world models, visual-langu...

PayPal
San Jose, California

We are proud to have a diverse workforce reflective of the merchants, consumers, and communities that we serve, and we continue to take tangible actions to cultivate inclusivity and belonging at PayPal. Actual Compensation is based on various factors including but not limited to work location, and r...

Gilead Sciences, Inc.
Foster City, California

In-depth understanding and application of GMP principles, concepts, practices and standards in the US and internationally. Must be able to develop and improve complex concepts, techniques, and standards and new applications based on quality principles and theories. Responsibilities include managing ...

Apple
Cupertino, California

We are looking for exceptional senior research scientist/engineer experienced in design and development of training, adapting and deploying large scale ML models with a focus on natural language understanding, generation, speech and/or multimodal generation. Machine Learning and its application to N...

TikTok
San Jose, California

The algorithm team is responsible for developing state-of-the-art computer vision, NLP and multimodality models and algorithms to protect our platform and users from the content and behaviors that violate community guidelines and related regulations. TikTok's global headquarters are in Los Angeles a...

ByteDance
San Jose, California

At least three years of relevant industry or research experience- Good knowledge of theoretical and empirical research in addressing research problems- Solid knowledge and experience with at least one popular deep learning framework (, PyTorch, TensorFlow) and familiarity with deep neural network ar...