Adapting object handover from robot to human using perceptual affordances

    公开(公告)号:US09751212B1

    公开(公告)日:2017-09-05

    申请号:US15147901

    申请日:2016-05-05

    IPC分类号: G05B19/18 B25J9/16 G06N3/00

    摘要: This disclosure describes, according to some implementations, a system and method for adapting object handover from robot to human using perceptual affordances. In an example method, upon receiving sensor data describing surroundings and/or operational state of a robot unit from a sensor, the method calculates a probability of a perceptual classification based on the sensor data. The perceptual classification may be one or more of an environment classification, an object classification, a human action classification, or an electro-mechanical state classification. The method further calculates an affordance of the probability of the perceptual classifier using a preference model, determines a handover action based on the affordance, executes the handover action, and updates the preference model based on feedback.

    Object detection and localized extremity guidance

    公开(公告)号:US09613505B2

    公开(公告)日:2017-04-04

    申请号:US14658138

    申请日:2015-03-13

    IPC分类号: G08B6/00

    CPC分类号: G08B6/00

    摘要: Technology for localized guidance of a body part of a user to specific objects within a physical environment using a vibration interface is described. An example system may include a vibration interface wearable on an extremity by a user. The vibration interface includes a plurality of motors. The system includes sensor(s) coupled to the vibrotactile system and a sensing system coupled to the sensor(s) and the vibration interface. The sensing system is configured to analyze a physical environment in which the user is located for a tangible object using the sensor(s), to generate a trajectory for navigating the extremity of the user to the tangible object based on a relative position of the extremity of the user bearing the vibration interface to a position of the tangible object within the physical environment, and to guide the extremity of the user along the trajectory by vibrating the vibration interface.

    Robot motion replanning based on user motion
    4.
    发明授权
    Robot motion replanning based on user motion 有权
    基于用户运动的机器人运动重新设计

    公开(公告)号:US09452530B2

    公开(公告)日:2016-09-27

    申请号:US14485491

    申请日:2014-09-12

    摘要: The disclosure includes a system and method for determining a robot path based on user motion by determining a current position of a robot with a processor-based computing device programmed to perform the determining, receiving sensor readings on positions, directions, and velocities of a visually-impaired user and other users, generating a model of the motions of the visually-impaired user and the other users, the model including a user path for the visually-impaired user and a robot path for the robot, generating a collision prediction map to predict collisions between at least one of the robot, the visually-impaired user, and the other users, determining whether there is a risk of collision for either the visually-impaired user or the robot, and responsive to the risk of collision, updating at least one of the user path and the robot path.

    摘要翻译: 本公开包括一种用于基于用户运动来确定机器人路径的系统和方法,其通过基于处理器的计算设备来确定机器人的当前位置,所述基于处理器的计算设备被编程为执行确定,在视觉上接收位置,方向和速度上的传感器读数 用户和其他用户,产生视觉受损用户和其他用户的运动模型,该模型包括用于视觉障碍用户的用户路径和机器人的机器人路径,生成碰撞预测图, 预测机器人,视力受损用户和其他用户中的至少一个之间的碰撞,确定视觉受损用户或机器人是否存在碰撞的风险,并且响应于碰撞的风险,在 至少一个用户路径和机器人路径。

    Person detection and pose estimation system
    6.
    发明授权
    Person detection and pose estimation system 有权
    人员检测和姿态估计系统

    公开(公告)号:US09141852B1

    公开(公告)日:2015-09-22

    申请号:US14012194

    申请日:2013-08-28

    IPC分类号: G06K9/00

    摘要: A system for detecting a person and estimating pose information comprises a processor and a memory storing instructions causing the system to: retrieve depth data from a sensor, the depth data describing distance information associated with one or more objects detected by the sensor; cluster the depth data to determine two or more candidate leg clusters, each candidate leg cluster including a portion of the depth data that may represent a human leg detected by the sensor; identify a candidate leg cluster pair including two candidate leg clusters within a certain distance between each other; determine whether there is a connectivity between the two candidate leg clusters included in the candidate leg cluster pair; and responsive to determining that there is a connectivity between the two candidate leg clusters, determine that the candidate leg cluster pair is qualified to be a leg cluster pair representing a person.

    摘要翻译: 一种用于检测人和估计姿势信息的系统包括处理器和存储器,存储指令,使得系统:从传感器检索深度数据,深度数据描述与由传感器检测到的一个或多个对象相关联的距离信息; 聚类深度数据以确定两个或更多候选腿簇,每个候选腿簇包括可以表示由传感器检测到的人腿的深度数据的一部分; 在彼此之间的一定距离内识别包括两个候选腿簇的候选腿簇对; 确定在候选腿群集对中包括的两个候选腿群之间是否存在连通性; 并且响应于确定所述两个候选腿群之间存在连接性,确定所述候选腿簇对被限定为代表人的腿簇对。

    Three dimensional heads-up display unit including visual context for voice commands

    公开(公告)号:US10140770B2

    公开(公告)日:2018-11-27

    申请号:US15080394

    申请日:2016-03-24

    发明人: Emrah Akin Sisbot

    摘要: The disclosure includes a system and method for wireless data sharing between a mobile client device and a three-dimensional heads-up display unit. A system may include a three-dimensional heads-up display unit (“3D HUD”) installed in a vehicle. The system may include a memory storing instructions that, when executed, cause the system to: establish a peer-to-peer video stream between a mobile client device and the vehicle; generate live video data for providing a video stream for causing a screen of the mobile client device to display visual content of the 3D HUD that includes substantially live images depicting what the driver of the vehicle sees when looking at the 3D HUD; and stream the live video data to the mobile client device to cause the screen of the mobile client device to display the video stream that depicts what the driver of the vehicle sees when looking at the 3D HUD.

    Three dimensional graphical overlays for a three dimensional heads-up display unit of a vehicle

    公开(公告)号:US10068377B2

    公开(公告)日:2018-09-04

    申请号:US15080412

    申请日:2016-03-24

    发明人: Emrah Akin Sisbot

    摘要: The disclosure includes a system and method for wireless data sharing between a mobile client device and a three-dimensional heads-up display unit. A system may include a three-dimensional heads-up display unit (“3D HUD”) installed in a vehicle. The system may include a memory storing instructions that, when executed, cause the system to: establish a peer-to-peer video stream between a mobile client device and the vehicle; generate live video data for providing a video stream for causing a screen of the mobile client device to display visual content of the 3D HUD that includes substantially live images depicting what the driver of the vehicle sees when looking at the 3D HUD; and stream the live video data to the mobile client device to cause the screen of the mobile client device to display the video stream that depicts what the driver of the vehicle sees when looking at the 3D HUD.

    Method of Ground Adjustment for In-Vehicle Augmented Reality Systems

    公开(公告)号:US20180061129A1

    公开(公告)日:2018-03-01

    申请号:US15250908

    申请日:2016-08-29

    发明人: Emrah Akin Sisbot

    摘要: The disclosure includes implementations for providing ground adjustment for an in-vehicle augmented reality system. A system may include a three-dimensional heads-up display unit (“3D HUD”) installed in a vehicle. The system may include a memory storing instructions that, when executed, cause the system to: determine a plurality of elevation values for a plurality of points on a road surface, where each elevation value is associated with a point from the plurality of points and describes the elevation of that point; identify a graphic for display on the 3D HUD, where the graphic is associated with at least one point from the plurality of points; determine which location of the 3D HUD is associated with the at least one point associated with the graphic; and display the graphic at the location of the 3D HUD so that the graphic superposes the point when viewed by a driver.

    ROBOT COMMUNICATION OF INTENT AND FUNCTIONING
    10.
    发明申请
    ROBOT COMMUNICATION OF INTENT AND FUNCTIONING 有权
    机器人通信的功能和功能

    公开(公告)号:US20160279793A1

    公开(公告)日:2016-09-29

    申请号:US14667413

    申请日:2015-03-24

    发明人: Emrah Akin Sisbot

    IPC分类号: B25J9/16

    摘要: The disclosure includes a method and a robot for projecting the one or more graphics on the surface of a user environment. The method may include determining robot velocity data describing one or more of an angular velocity and a linear velocity of the robot. The method may include determining graphical data describing one or more graphics for projection on the surface of a user environment based on the angular velocity and the linear velocity of the robot. The one or more graphics may include one or more arrows describing a past behavior of the robot and a pending behavior of the robot. The method may include projecting the one or more graphics on the surface of the user environment so that a user present in the user environment with the robot may have access to information describing the past and pending behavior of the robot.

    摘要翻译: 本公开包括用于在用户环境的表面上投影一个或多个图形的方法和机器人。 该方法可以包括确定描述机器人的角速度和线速度中的一个或多个的机器人速度数据。 该方法可以包括基于角速度和机器人的线速度确定描述用于在用户环境的表面上投影的一个或多个图形的图形数据。 一个或多个图形可以包括描述机器人的过去行为的一个或多个箭头和机器人的待决行为。 该方法可以包括在用户环境的表面上投影一个或多个图形,使得在机器人中呈现在用户环境中的用户可以访问描述机器人的过去和未决行为的信息。