ROBOT INTERACTION WITH OBJECTS BASED ON SEMANTIC INFORMATION ASSOCIATED WITH EMBEDDING SPACES

    公开(公告)号:WO2019126323A1

    公开(公告)日:2019-06-27

    申请号:PCT/US2018/066501

    申请日:2018-12-19

    Abstract: Techniques described herein relate to using reduced-dimensionality embeddings generated from robot sensor data to identify predetermined semantic labels that guide robot interaction with objects. In various implementations, obtaining, from one or more sensors of a robot, sensor data that includes data indicative of an object observed in an environment in which the robot operates. The sensor data may be processed utilizing a first trained machine learning model to generate a first embedded feature vector that maps the data indicative of the object to an embedding space. Nearest neighbor(s) of the first embedded feature vector may be identified in the embedding space. Semantic label(s) may be identified based on the nearest neighbor(s). A given grasp option may be selected from enumerated grasp options previously associated with the semantic label(s). The robot may be operated to interact with the object based on the pose and using the given grasp option.

    SELECTING ACTIONS TO BE PERFORMED BY A ROBOTIC AGENT
    3.
    发明申请
    SELECTING ACTIONS TO BE PERFORMED BY A ROBOTIC AGENT 审中-公开
    机器人执行的选择动作

    公开(公告)号:WO2018071724A1

    公开(公告)日:2018-04-19

    申请号:PCT/US2017/056415

    申请日:2017-10-12

    Applicant: GOOGLE LLC

    CPC classification number: B25J9/163 B25J9/1664

    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for a system configured to plan actions to be performed by a robotic agent interacting with an environment to accomplish an objective by determining an optimized trajectory of state - action pairs for accomplishing the objective. The system maintains a current optimized trajectory and a current trust region radius, and optimizes a localized objective within the current trust region radius of the current optimized trajectory to determine a candidate updated optimized trajectory. The system determines whether the candidate updated optimized trajectory improves over the current optimized trajectory. In response to determining that the candidate updated optimized trajectory improves over the current optimized trajectory, the system updates the current optimized trajectory to the candidate updated optimized trajectory and updates the current trust region radius.

    Abstract translation: 包括编码在计算机存储介质上的计算机程序的方法,系统和装置,用于被配置为规划由机器人代理执行的动作的系统,该机器人代理与环境进行交互以通过确定 优化国家行动对的轨迹来完成目标。 系统维持当前优化轨迹和当前信任区域半径,并优化当前优化轨迹的当前信任区域半径内的局部化目标,以确定候选更新优化轨迹。 系统确定候选更新的优化轨迹是否改善当前优化的轨迹。 响应于确定候选更新的优化轨迹改善超过当前优化轨迹,系统将当前优化轨迹更新为候选更新优化轨迹并更新当前信任区半径。

    VERFAHREN UND VORRICHTUNG ZUM FESTLEGEN EINES BEWEGUNGSABLAUFS FÜR EINEN ROBOTER
    4.
    发明申请
    VERFAHREN UND VORRICHTUNG ZUM FESTLEGEN EINES BEWEGUNGSABLAUFS FÜR EINEN ROBOTER 审中-公开
    用于确定机器人的运动流的方法和设备

    公开(公告)号:WO2017186601A1

    公开(公告)日:2017-11-02

    申请号:PCT/EP2017/059570

    申请日:2017-04-21

    Inventor: HADDADIN, Sami

    Abstract: Die vorliegende Erfindung betrifft ein Verfahren und eine Vorrichtung zur Festlegung eines Bewegungsablaufs für einen mehrachsigen Manipulator (M) eines Robotersystems, der mehrere, unterschiedliche Drehachsen bildende Glieder (G) und ein Endglied für ein Zusammenwirken mit einem Effektor (E) aufweist, wobei der Effektor (E) in einem Arbeitsraum (R) zumindest eine beliebige Operation durchführen soll, und wobei das Endglied des Manipulators (M) zur Durchführung der zumindest einen beliebigen Operation in eine beliebige Soll- Pose (x i ) in Bezug auf den Arbeitsraum (R) überführt werden soll, wobei der Manipulator (M) in mehreren Schritten (S i ;S j ) unter Annäherung des Endglieds an die Soll-Pose (x i ) bewegt und für jeden Schritt (S i ;S j ) zumindest ein definiertes Impedanzmuster (K x ) und/oder Admittanzmuster in Bezug auf zumindest eine Achse (A A ;A G ;A E ;A R ) festgelegt wird, die die Achse (A A ;A G ;A E ;A R ) eines mit dem Manipulator (M) verknüpften Koordinatensystems (C A ;C G ;C E ;C R ) bildet.

    Abstract translation:

    本发明涉及一种方法和用于确定导航中使用的运动序列的装置R具有用于导航用途为r的多个旋转成形构件(G)和一个端部构件的不同的轴的机器人系统的多轴操纵器(M) 具有相互作用,在一个工作空间中的执行器(e)中,其中所述效应(E)(R)的至少任何操作携带导航用途听到,且其中所述操纵器(M)用于执行导航的使用端构件引导所述至少一个任意的操作在一 应当传递相对于工作空间(R)的任何期望姿态(x i,i),其中操纵器(M)以几个步骤(S i, S j )通过参考最终项和每个步骤(S )移动到目标姿态(x i 小号<子>Ĵ)为至少一个所定义的阻抗图案(K <子> X )和/或Admittanzmuster相对于至少一个轴线(一<子>一,一个<子 > 定义轴(A ; A ; 子>;一个<子>电子,一个 - [R )pften坐标系(C <子>一 C <子“G ; C E ; C R )。

    AUTOMATED COLLECTION AND LABELING OF OBJECT DATA
    6.
    发明申请
    AUTOMATED COLLECTION AND LABELING OF OBJECT DATA 审中-公开
    自动收集和标签对象数据

    公开(公告)号:WO2016164326A1

    公开(公告)日:2016-10-13

    申请号:PCT/US2016/025959

    申请日:2016-04-05

    Abstract: Data about a physical object in a real-world environment is automatically collected and labeled. A mechanical device is used to maneuver the object into different poses within a three-dimensional workspace in the real-world environment. While the object is in each different pose an image of the object is input from one or more sensors and data specifying the pose is input from the mechanical device. The image of the object input from each of the sensors for each different pose is labeled with the data specifying the pose and with information identifying the object. A database for the object that includes these labeled images can be generated. The labeled images can also be used to train a detector and classifier to detect and recognize the object when it is in an environment that is similar to the real-world environment.

    Abstract translation: 关于现实环境中的物理对象的数据将自动收集和标记。 机械装置用于在现实环境中的三维工作空间内将物体调动成不同的姿势。 当物体处于每个不同姿态时,从一个或多个传感器输入物体的图像,并且从机械装置输入指定姿势的数据。 从每个不同姿势的每个传感器输入的对象的图像用指定姿势的数据和识别对象的信息标记。 可以生成包含这些标记图像的对象的数据库。 标记的图像也可用于训练检测器和分类器,以在物体处于类似于真实世界环境的环境中时检测和识别物体。

    SUBMERSIBLE ROBOTICALLY OPERABLE VEHICLE SYSTEM FOR INFRASTRUCTURE MAINTENANCE AND INSPECTION
    8.
    发明申请
    SUBMERSIBLE ROBOTICALLY OPERABLE VEHICLE SYSTEM FOR INFRASTRUCTURE MAINTENANCE AND INSPECTION 审中-公开
    用于基础设施维护和检查的不可操作的机动车辆系统

    公开(公告)号:WO2012112835A1

    公开(公告)日:2012-08-23

    申请号:PCT/US2012/025557

    申请日:2012-02-17

    Abstract: A configurable robotic apparatus and system is remotely operable in difficult, hazardous, subterranean, or submerged environs. The apparatus merges diverse disciplines to effect inspecting, cleaning, treating, repairing or otherwise maintaining a wide variety of materials and conditions. Deployment environments include power, municipal water and wastewater plants, surface and submerged infrastructures (pipes, lines, conduits), and like industrial applications. Extensible and articulating modules, configurable through standardized and interchangeable connectors, provide unique flexibility, scalability and versatility to accommodate a wide range of shapes, surfaces, and obstacles. In-module intelligence and instrumentation eliminates the need for constant manual control through autonomous operation capable of simultaneous optimization and synchronization of multiple work processes, but manual override and remote control is provided to overcome unanticipated limitations. Benefits include improved efficiency, cost, and safety over prior art. High-performance, one-pass operation reduces facility downtime while incorporating environmentally responsible debris recovery.

    Abstract translation: 可配置的机器人设备和系统可在难度大的,危险的,地下的或潜水的环境中远程操作。 该设备融合了不同的学科,以进行检查,清洁,处理,修理或以其他方式维护各种材料和条件。 部署环境包括电力,市政供水和废水处理厂,地面和水下基础设施(管道,管道,管道)以及工业应用。 可扩展和铰接模块可通过标准化和可互换的连接器配置,提供独特的灵活性,可扩展性和多功能性,以适应各种形状,表面和障碍物。 模块内智能和仪表消除了通过自主操作进行恒定手动控制的需要,能够同时优化和同步多个工作过程,但提供手动超控和远程控制以克服意外的局限性。 优点包括提高现有技术的效率,成本和安全性。 高性能,一次性操作可减少设备停机时间,同时结合对环境负责的碎片回收。

    CONTROLLED MATERIAL REMOVAL RATE (CMRR) AND SELF-TUNING FORCE CONTROL IN ROBOTIC MACHINING PROCESS
    10.
    发明申请
    CONTROLLED MATERIAL REMOVAL RATE (CMRR) AND SELF-TUNING FORCE CONTROL IN ROBOTIC MACHINING PROCESS 审中-公开
    机器人加工过程中的受控材料去除率(CMRR)和自整定力控制

    公开(公告)号:WO2008033250A3

    公开(公告)日:2008-05-29

    申请号:PCT/US2007019443

    申请日:2007-09-06

    Abstract: A method and apparatus for a robotic machining process that gives a controlled removal rate of material from a workpiece when an object, tool or workpiece, held by a robot is brought into contact with a stationary object, workpiece or tool. A signal indicative of the force applied by the held object t the stationary object is used to control the rate at which the robot moves the held object in relation to the stationary object. Associated with the robot is a controller that has tunable proportional and integral gains. The controller determines a command for the feed rate of the tool when the tool engages the workpiece. In response to that command, the proportional and integral gains are tuned to obtain a cutting force to be applied to the workpiece when the tool engages the workpiece that is substantially the same as a desired cutting force.

    Abstract translation: 一种用于机器人加工过程的方法和装置,当由机器人保持的物体,工具或工件与固定物体,工件或工具接触时,从工件给出受控的材料去除速率。 指示由被保持物体施加到静止物体的力的信号被用于控制机器人相对于静止物体移动被保持物体的速率。 与机器人相关的是一个具有可调比例和积分增益的控制器。 控制器在工具接合工件时确定刀具进给速率的命令。 响应于该指令,调节比例增益和积分增益以获得当工具接合工件时施加到工件上的切削力,其与所需的切削力基本相同。

Patent Agency Ranking