Combined analog and digital architecture for handling sensory input data

    公开(公告)号:US12124651B2

    公开(公告)日:2024-10-22

    申请号:US18114453

    申请日:2023-02-27

    IPC分类号: G06F3/041 G06F17/14 H03M3/00

    摘要: A system includes a robot having contact surfaces and a sensor array having a spatially distributed touch sensors disposed on the contact surfaces. Each touch sensor has an identifier and outputs an analog signal at a set of frequencies associated with the identifier The sensor array outputs a combined analog signal representative of a combination of the analog signals outputted by the touch sensors. The system includes an analog-to-digital converter that generates a digital signal in a time domain based on the combined analog signal. The system includes one or more processing units that transforms the digital signal from the time domain to a frequency domain and detects locations of touch within the sensor array based on frequencies observed the frequency domain and the identifiers of the touch sensors.

    SYSTEMS, DEVICES, AND METHODS FOR OPERATING A ROBOTIC SYSTEM

    公开(公告)号:US20240253243A1

    公开(公告)日:2024-08-01

    申请号:US18425547

    申请日:2024-01-29

    发明人: Suzanne Gildert

    IPC分类号: B25J13/00

    CPC分类号: B25J13/003

    摘要: A robotic system includes a robot, and an interface to a large language model (LLM). The robot operates in an environment that includes a human. In an example method of operation of the robotic system, the robot initiates a task. After initiating the task, the robot detects that the human is waiting for the robot to complete the task. The interface sends a query to the LLM. The query includes a natural language statement describing a context in the natural language for the query. The interface receives a response from the LLM in reply to the query. The response includes a natural language statement describing material related to the context and suitable for an interim interaction that can be initiated by the robot with the human. The robot initiates the interim interaction with the human. The interim interaction may be initiated autonomously by the robot, and may include a diversion.

    SYSTEMS, DEVICES, AND METHODS FOR OPERATING A ROBOTIC SYSTEM

    公开(公告)号:US20240253221A1

    公开(公告)日:2024-08-01

    申请号:US18425557

    申请日:2024-01-29

    发明人: Suzanne Gildert

    IPC分类号: B25J9/16

    摘要: A robotic system includes a robot, an object recognition subsystem, an interface to a large language model (LLM), and a system controller. The robot operates in an environment that includes a first and a second object. In an example method of operation of the robotic system, the object recognition subsystem assigns a first label to the first object. The interface sends a query, including the first label, to the LLM. The interface receives a response from the LLM, the response in reply to the query and including a second label. The object recognition subsystem assigns the second label to the second object. In some implementations, the object recognition subsystem includes sensors and a sensor data processor. The sensors scan the environment to generate sensor data, and the sensor data processor detects the presence of the first and the second object based at least in part on the sensor data.

    ROBOT SYSTEMS, METHODS, CONTROL MODULES, AND COMPUTER PROGRAM PRODUCTS THAT LEVERAGE LARGE LANGUAGE MODELS

    公开(公告)号:US20240253216A1

    公开(公告)日:2024-08-01

    申请号:US18424551

    申请日:2024-01-26

    IPC分类号: B25J9/16 B25J19/02

    摘要: Robot control systems, methods, control modules and computer program products that leverage one or more large language model(s) (LLMs) in order to achieve at least some degree of autonomy are described. Robot control parameters, environment details, and/or instructions may advantageously be specified in natural language (NL) and communicated with the LLM via an NL prompt or query. The NL query may include a request for one or more work objectives from the LLM, such as “What can I do here?”, thereby establishing a form of agency by which the robot system may identify activities to perform without operator intervention. The LLM may also be queried to convert each work objective into a task plan providing a sequence of steps that the robot system may execute to complete the work objective. Optionally, the robot system may communicate with an operator to determine whether or not to execute a task plan.

    Systems, Devices, and Methods for Multi-Purpose Robots

    公开(公告)号:US20240246231A1

    公开(公告)日:2024-07-25

    申请号:US18616040

    申请日:2024-03-25

    IPC分类号: B25J9/16

    CPC分类号: B25J9/1661

    摘要: Systems, devices, and methods for training and operating (semi-)autonomous robots to complete multiple different work objectives are described. A robot control system stores a library of reusable work primitives each corresponding to a respective basic sub-task or sub-action that the robot is operative to autonomously perform. A work objective is analyzed to determine a sequence (i.e., a combination and/or permutation) of reusable work primitives that, when executed by the robot, will complete the work objective. The robot executes the sequence of reusable work primitives to complete the work objective. The reusable work primitives may include one or more reusable grasp primitives that enable(s) a robot's end effector to grasp objects. Simulated instances of real physical robots may be trained in simulated environments to develop control instructions that, once uploaded to the real physical robots, enable such real physical robots to autonomously perform reusable work primitives.

    MULTI-PURPOSE ROBOTS AND COMPUTER PROGRAM PRODUCTS, AND METHODS FOR OPERATING THE SAME

    公开(公告)号:US20230381957A1

    公开(公告)日:2023-11-30

    申请号:US18231888

    申请日:2023-08-09

    IPC分类号: B25J9/16 B25J11/00

    摘要: Robots, systems, methods, and computer program products for training and operating (semi-)autonomous robots to complete work objectives are described. A robot accesses a library of reusable work primitives from a catalog of libraries of reusable work primitives, each reusable work primitive corresponding to a respective basic sub-action that the robot is trained to autonomously perform. A work objective is analyzed to determine a sequence of reusable work primitives that complete the work objective, and the robot executes the sequence to complete the work objective. A robot can be deployed with access to an appropriate library of reusable work primitives, based on expectations for the robot. The robot is trained to perform reusable work primitives in multiple libraries, by generating control instructions which cause the robot to perform each reusable work primitive. Training is performed by real-world robots performing reusable work primitives, or simulated robot instances performing the reusable work primitives.