TRAINING ACTION SELECTION NEURAL NETWORKS USING AUXILIARY TASKS OF CONTROLLING OBSERVATION EMBEDDINGS

    公开(公告)号:US20230290133A1

    公开(公告)日:2023-09-14

    申请号:US18016746

    申请日:2021-07-27

    IPC分类号: G06V10/82 G06V10/70

    CPC分类号: G06V10/82 G06V10/87

    摘要: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for selecting actions to be performed by an agent interacting with an environment to accomplish a goal. In one aspect, a method comprises: obtaining an observation characterizing a state of the environment, processing the observation using an embedding model to generate a lower-dimensional embedding of the observation, determining an auxiliary task reward based on a value of a particular dimension of the embedding, determining an overall reward based at least in part on the auxiliary task reward, and determining an update to values of multiple parameters of an action selection neural network based on the overall reward using a reinforcement learning technique.

    ELECTRONIC DEVICE, INFORMATION PROCESSING APPARATUS, METHOD FOR INFERENCE, AND PROGRAM FOR INFERENCE

    公开(公告)号:US20230267752A1

    公开(公告)日:2023-08-24

    申请号:US18004175

    申请日:2021-07-01

    IPC分类号: G06V20/59 G06V10/70

    CPC分类号: G06V20/597 G06V10/70

    摘要: An electronic device 10 includes an imaging unit 11, a gaze-line detector 12, and a controller 14. The imaging unit 11 is configured to create at least one image corresponding to a view by image capturing. The gaze-line detector is configured to detect a gaze line of a subject, the gaze line being directed to the view. The controller 14 is configured to serve as a first inference unit 15 and a second inference unit 16. The first inference unit 15 is capable of inferring a gaze-line prediction map based on the at least one image. The second inference unit 16 is capable of inferring biological information regarding an alertness level of the subject based on the gaze-line prediction map and the gaze line of the subject.

    WARRANTY PROCESSING SYSTEM FOR ROLL-OUT CARTS
    120.
    发明公开

    公开(公告)号:US20230259951A1

    公开(公告)日:2023-08-17

    申请号:US18109204

    申请日:2023-02-13

    IPC分类号: G06Q30/012 G06V10/70

    CPC分类号: G06Q30/012 G06V10/70

    摘要: A roll-out cart warranty processing system includes a mobile device app and a server. The mobile device app prompts a resident to take at least one image of the roll-out cart, particularly any damaged portion(s) of the roll-out cart. The mobile device app then uploads the at least one image to a server. The server analyzes the at least one image to determine whether the roll-out cart is covered by warranty. The server also analyzes the at least one image to determine whether any identifiable damage would be covered by warranty.