公开(公告)号：US20240377829A1

公开(公告)日：2024-11-14

申请号：US18501887

申请日：2023-11-03

Applicant: Samsung Electronics Co., Ltd.

Inventor： Yilin Shen ,  Kaiwen Zhou ,  Hongxia Jin

IPC: G05D1/02 ,  G06F40/40 ,  G06T7/70 ,  G06V20/50

Abstract: A method includes determining a specified object to locate within a surrounding environment. The method also includes causing a robot to capture an image and a depth map of the surrounding environment. The method further includes using a scene understanding model, predicting one or more rooms and one or more objects captured in the image. The method also includes updating a second map of the surrounding environment based on the predicted rooms, the predicted objects, the depth map, and a location of the robot. The method further includes determining a likelihood of the specified object being in a candidate room and a likelihood of the specified object being near a candidate object using a pre-trained large language model. The method also includes causing the robot to move to a next location for the robot to search for the specified object, based on the likelihoods and the second map.