Machine-learnable robotic control plans

    公开(公告)号:US12128563B2

    公开(公告)日:2024-10-29

    申请号:US17398537

    申请日:2021-08-10

    IPC分类号: B25J9/16 G06N20/00

    摘要: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for using learnable robotic control plans. One of the methods comprises obtaining a learnable robotic control plan comprising data defining a state machine that includes a plurality of states and a plurality of transitions between states, wherein: one or more states are learnable states, and each learnable state comprises data defining (i) one or more learnable parameters of the learnable state and (ii) a machine learning procedure for automatically learning a respective value for each learnable parameter of the learnable state; and processing the learnable robotic control plan to generate a specific robotic control plan, comprising: obtaining data characterizing a robotic execution environment; and for each learnable state, executing, using the obtained data, the respective machine learning procedures defined by the learnable state to generate a respective value for each learnable parameter of the learnable state.

    Equipment specific motion plan generation for robotic skill adaptation

    公开(公告)号:US12115670B2

    公开(公告)日:2024-10-15

    申请号:US17551706

    申请日:2021-12-15

    IPC分类号: B25J9/16

    CPC分类号: B25J9/1664

    摘要: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for using equipment-specific sample generators to automatically adapt a skill for execution in an operating environment. One of the methods includes obtaining a skill to be executed in an operating environment having one or more robots, wherein the skill defines a sequence of subtasks to be performed by the one or more robots in the working environment. A planning process is performed to generate a motion plan for the one or more robots, including obtaining, from an equipment-specific sample generator, a plurality of equipment-specific samples for a subtask of the skill, generating, from the plurality of equipment-specific samples, a plurality of candidate motion plans, and selecting, from the plurality of candidate motion plans, a motion plan for the one or more robots to perform the skill in the operating environment.

    TRACING EVENTS FOR A REAL-TIME ROBOTICS CONTROL SYSTEM

    公开(公告)号:US20240220390A1

    公开(公告)日:2024-07-04

    申请号:US18538406

    申请日:2023-12-13

    IPC分类号: G06F11/34

    CPC分类号: G06F11/3476 G06F11/3495

    摘要: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating event logs for trace events. The method includes receiving data representing a trigger for generating event entries of a real-time robotics control system. Each real-time thread corresponds to a non-real-time thread, and is communicatively coupled to a data structure allocated in a memory unit for the real-time thread to store event entries. Each real-time thread stores event entries into a corresponding data structure that is allocated for the real-time thread. The event entries are generated when the real-time thread is executed during real time. The stored event entries are provided to a non-real-time thread that corresponds to the real-time thread from a corresponding data structure. Each non-real-time thread processes the event entries to generate an event log for the corresponding real-time thread. The event log represents trace events occurred during operation of the real-time thread.

    ONLINE SPEED OVERRIDE OF A TRAJECTORY
    4.
    发明公开

    公开(公告)号:US20240219927A1

    公开(公告)日:2024-07-04

    申请号:US18534461

    申请日:2023-12-08

    IPC分类号: G05D1/65 G05D1/646

    摘要: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for overriding an original motion of a robot along a trajectory. The method includes initiating, by a real-time robotics control system, execution of an input trajectory for a robot at a default speed, wherein the input trajectory is a time-parameterized trajectory and specifies a path in an operating environment; before completing execution of the input trajectory, receiving a user input specifying a value of an online speed override factor; in response, generating a phase-parameterized version of the input trajectory using a phase variable; computing, on each real-time control cycle, a target velocity and a target acceleration of the phase-parameterized version of the input trajectory based on the online speed override factor; and causing the robot to transition to the target velocity and the target acceleration while traversing the path in the operating environment.

    ROBOT PLANNING FOR GAPS
    5.
    发明公开

    公开(公告)号:US20240217099A1

    公开(公告)日:2024-07-04

    申请号:US18390358

    申请日:2023-12-20

    发明人: Tim Niemueller

    IPC分类号: B25J9/16

    CPC分类号: B25J9/1661 B25J9/1671

    摘要: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for robot planning. One of the methods includes maintaining a library of pre-generated candidate actions that represent respective robot capabilities; receiving an initial task plan for performing a particular task, wherein the initial task plan includes a sequence of two or more actions that comprises a first action followed by a second action; processing the initial task plan to determine that the first effect of the first action does not result in satisfaction of the second precondition of the second action; selecting one or more selected pre-generated candidate actions from the library of pre-generated candidate actions; and modifying the initial task plan to include the one or more selected pre-generated candidate actions as the intermediate actions to generate a final task plan to be executed by the one or more particular robots when performing the particular task.

    Systems and methods for high dynamic range image reconstruction

    公开(公告)号:US12020455B2

    公开(公告)日:2024-06-25

    申请号:US17198094

    申请日:2021-03-10

    IPC分类号: G06T7/80 H04N9/64

    摘要: Systems and method for expanding a dynamic range associated with an image are disclosed. The method includes capturing an image of a scene via an imaging device using a single exposure. The image of the scene includes a plurality of polarization images corresponding to different angles of polarization, and each of the polarization images comprise a plurality of color channels. The method further includes determining a criterion for each of the plurality of color channels; selecting one color channel of the plurality of color channels based on determining of the criterion; generating a reconstructed image irradiance for the one color channel based on pixels in two or more of the plurality of polarization images obtained for the one color channel; and outputting a reconstructed image with the reconstructed image irradiance.

    TRAINING AUTOENCODERS FOR GENERATING LATENT REPRESENTATIONS

    公开(公告)号:US20240096077A1

    公开(公告)日:2024-03-21

    申请号:US17945918

    申请日:2022-09-15

    摘要: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for training an autoencoder. One of the methods includes receiving a pair of images, wherein a first image of the pair represents a first state of a working environment at a first time step earlier than that of a second image of the pair. A first and a second latent representation is generated respectively for the first and the second image by the autoencoder; A predicted reward for an action executed in the first state is generated by a reward prediction neural network. A predicted next latent representation for the first state and the action is generated by a dynamics prediction neural network. An overall loss is determined based on the predicted reward, the predicted next latent representation, and the second latent representation. Model parameters of the autoencoder are updated to reduce the overall loss.