Generating digital avatar
    2.
    发明授权

    公开(公告)号:US11544886B2

    公开(公告)日:2023-01-03

    申请号:US17124381

    申请日:2020-12-16

    摘要: In one embodiment, a method includes, by one or more computing systems: receiving one or more non-video inputs, where the one or more non-video inputs include at least one of a text input, an audio input, or an expression input, accessing a K-NN graph including several sets of nodes, where each set of nodes corresponds to a particular semantic context out of several semantic contexts, determining one or more actions to be performed by a digital avatar based on the one or more identified semantic contexts, generating, in real-time in response to receiving the one or more non-video inputs and based on the determined one or more actions, a video output of the digital avatar including one or more human characteristics corresponding to the one or more identified semantic contexts, and sending, to a client device, instructions to present the video output of the digital avatar.

    ROBOTIC VISION
    3.
    发明申请

    公开(公告)号:US20220371202A1

    公开(公告)日:2022-11-24

    申请号:US17881789

    申请日:2022-08-05

    摘要: A method includes accessing RGB and depth image data representing a scene that includes at least a portion of a robotic limb. Using this data, a computing system may segment the image data to isolate and identify at least a portion of the robotic limb within the scene. The computing system can determine a current pose of the robotic limb within the scene based on the image data, joint data, or a 3D virtual model of the robotic limb. The computing system may then determine a desired goal pose, which may be based on the image data or the 3D virtual model. Based on the determined goal pose, the computing device determines the difference between the current pose and the goal pose of the robotic limb, and using this difference, provides a pose adjustment that for the robotic limb.

    Laterally offset parallax barriers in multi-view display

    公开(公告)号:US11474372B2

    公开(公告)日:2022-10-18

    申请号:US17125693

    申请日:2020-12-17

    发明人: Nigel A. Clarke

    摘要: In one embodiment, an apparatus includes a multi-view display that includes several pixels. The apparatus includes a parallax barrier that overlays the several pixels of the multi-view display. The parallax barrier includes several barrier rows that are arrayed in a first dimension, where each barrier row includes several barriers arrayed in a second dimension. Each of the barriers are separated from adjacent barriers in the barrier row by an aperture. Each barrier row is offset from adjacent barrier rows by a macro offset distance in the second dimension. A portion of each barrier is offset by a micro offset distance in the second dimension, where the micro offset distance is smaller than the macro offset distance.

    Robotic vision
    5.
    发明授权

    公开(公告)号:US11433545B2

    公开(公告)日:2022-09-06

    申请号:US16792009

    申请日:2020-02-14

    摘要: A method includes accessing RGB and depth image data representing a scene that includes at least a portion of a robotic limb. Using this data, a computing system may segment the image data to isolate and identify at least a portion of the robotic limb within the scene. The computing system can determine a current pose of the robotic limb within the scene based on the image data, joint data, or a 3D virtual model of the robotic limb. The computing system may then determine a desired goal pose, which may be based on the image data or the 3D virtual model. Based on the determined goal pose, the computing device determines the difference between the current pose and the goal pose of the robotic limb, and using this difference, provides a pose adjustment that for the robotic limb.

    Systems and Methods for Reconstruction of Dense Depth Maps

    公开(公告)号:US20220230397A1

    公开(公告)日:2022-07-21

    申请号:US17338521

    申请日:2021-06-03

    IPC分类号: G06T19/00 G06T7/55

    摘要: A method by an extended reality (XR) display device includes accessing image data and sparse depth points corresponding to a plurality of image frames to be displayed on one or more displays of the XR display device. The method further includes determining a plurality of sets of feature points for a current image frame of the plurality of image frames, constructing a cost function configured to propagate the sparse depth points corresponding to the current image frame based on the plurality of sets of feature points, and generating a dense depth map corresponding to the current image frame based on an evaluation of the cost function. The method thus includes rendering the current image frame on the one or more displays of the XR display device based on the dense depth map.

    LATERALLY OFFSET PARALLAX BARRIERS IN MULTI-VIEW DISPLAY

    公开(公告)号:US20220026734A1

    公开(公告)日:2022-01-27

    申请号:US17125693

    申请日:2020-12-17

    发明人: Nigel A. Clarke

    IPC分类号: G02B30/32 H04N13/31

    摘要: In one embodiment, an apparatus includes a multi-view display that includes several pixels. The apparatus includes a parallax barrier that overlays the several pixels of the multi-view display. The parallax barrier includes several barrier rows that are arrayed in a first dimension, where each barrier row includes several barriers arrayed in a second dimension. Each of the barriers are separated from adjacent barriers in the barrier row by an aperture. Each barrier row is offset from adjacent barrier rows by a macro offset distance in the second dimension. A portion of each barrier is offset by a micro offset distance in the second dimension, where the micro offset distance is smaller than the macro offset distance.

    Systems and Methods for Live Conversation Using Hearing Devices

    公开(公告)号:US20210392427A1

    公开(公告)日:2021-12-16

    申请号:US17341920

    申请日:2021-06-08

    发明人: Siva Penke

    摘要: In one embodiment, a method includes, by a first electronic device: receiving, from an input sensor of the first electronic device, a predetermined input, where the predetermined input corresponds to a request to wirelessly connect the first electronic device to one or more second electronic devices within a communication range of a transceiver of the first electronic device, wirelessly connecting, using the transceiver of the first electronic device responsive to receiving the predetermined input, to the one or more second electronic devices using a communications profile associated with each of the one or more second electronic devices, where the communications profile includes one or more parameters for verifying to connect the first electronic device and the one or more second electronic devices, and redirecting a live audio communication between the first electronic device and a control device to the one or more second electronic devices.

    DEPTH MAP RE-PROJECTION ON USER ELECTRONIC DEVICES

    公开(公告)号:US20210327153A1

    公开(公告)日:2021-10-21

    申请号:US17363678

    申请日:2021-06-30

    摘要: A method includes rendering, on displays of an extended reality (XR) display device, a first sequence of image frames based on image data received from an external electronic device associated with the XR display device. The method further includes detecting an interruption to the image data received from the external electronic device, and accessing a plurality of feature points from a depth map corresponding to the first sequence of image frames. The plurality of feature points includes movement and position information of one or more objects within the first sequence of image frames. The method further includes performing a re-warping to at least partially re-render the one or more objects based at least in part on the plurality of feature points and spatiotemporal data, and rendering a second sequence of image frames corresponding to the partial re-rendering of the one or more objects.

    GENERATING DIGITAL AVATAR
    10.
    发明申请

    公开(公告)号:US20210201549A1

    公开(公告)日:2021-07-01

    申请号:US17124381

    申请日:2020-12-16

    摘要: In one embodiment, a method includes, by one or more computing systems: receiving one or more non-video inputs, where the one or more non-video inputs include at least one of a text input, an audio input, or an expression input, accessing a K-NN graph including several sets of nodes, where each set of nodes corresponds to a particular semantic context out of several semantic contexts, determining one or more actions to be performed by a digital avatar based on the one or more identified semantic contexts, generating, in real-time in response to receiving the one or more non-video inputs and based on the determined one or more actions, a video output of the digital avatar including one or more human characteristics corresponding to the one or more identified semantic contexts, and sending, to a client device, instructions to present the video output of the digital avatar.