SYSTEM AND METHOD FOR ENABLING ROBOT TO PERCEIVE AND DETECT SOCIALLY INTERACTING GROUPS

    公开(公告)号:US20210406594A1

    公开(公告)日:2021-12-30

    申请号:US17138224

    申请日:2020-12-30

    IPC分类号: G06K9/62 G06T7/00 G06K9/66

    摘要: This disclosure relates to system and method for enabling a robot to perceive and detect socially interacting groups. Various known systems have limited accuracy due to prevalent rule-driven methods. In case of few data-driven learning methods, they lack datasets with varied conditions of light, occlusion, and backgrounds. The disclosed method and system detect the formation of a social group of people, or, f-formation in real-time in a given scene. The system also detects outliers in the process, i.e., people who are visible but not part of the interacting group. This plays a key role in correct f-formation detection in a real-life crowded environment. Additionally, when a collocated robot plans to join the group it has to detect a pose for itself along with detecting the formation. Thus, the system provides the approach angle for the robot, which can help it to determine the final pose in a socially acceptable manner.

    ROBOTIC TASK PLANNING FOR COMPLEX TASK INSTRUCTIONS IN NATURAL LANGUAGE

    公开(公告)号:US20210232121A1

    公开(公告)日:2021-07-29

    申请号:US17007391

    申请日:2020-08-31

    IPC分类号: G05B19/4155 B25J9/16

    摘要: This disclosure provides systems and methods for robotic task planning when a complex task instruction is provided in natural language. Conventionally robotic task planning relies on a single task or multiple independent or serialized tasks in the task instruction. Alternatively, constraints on space of linguistic variations, ambiguity and complexity of the language may be imposed. In the present disclosure, firstly dependencies between multiple tasks are identified. The tasks are then ordered such that a dependent task is always scheduled for planning after a task it is dependent upon. Moreover, repeated tasks are masked. Thus, resolving task dependencies and ordering dependencies, a complex instruction with multiple interdependent tasks in natural language facilitates generation of a viable task execution plan. Systems and methods of the present disclosure finds application in human-robot interactions.