LOW LATENCY FRAME DELIVERY
    1.
    发明公开

    公开(公告)号:US20230206385A1

    公开(公告)日:2023-06-29

    申请号:US18172999

    申请日:2023-02-22

    CPC classification number: G06T1/60 G06T3/0093 G06T5/006 G06T11/00 H04N23/73

    Abstract: Examples are described of marking specified regions of stored image frame buffer data in an image frame buffer. An imaging system can read the specified regions of the image frame buffer to identify whether the marking has been overwritten or not. The imaging system can thus efficiently identify how much of the image frame buffer has been overwritten with data from a new image frame. Based on this, the imaging system can retrieve partial image frame data from the image frame buffer and can process the partial image frame data, for instance to composite the partial image frame data with virtual content and/or to perform distortion compensation. The processed partial image frame data can be uploaded to a display buffer and displayed by a display, either as-is or once more of the frame is captured and processed. The imaging system can also perform auto-exposure using the partial image frame data.

    DYNAMIC CONTENT PRESENTATION FOR EXTENDED REALITY SYSTEMS

    公开(公告)号:US20240168548A1

    公开(公告)日:2024-05-23

    申请号:US18420577

    申请日:2024-01-23

    CPC classification number: G06F3/013 A61B5/163

    Abstract: Systems and techniques are described for extended reality (XR) operations. An XR system displays virtual content using a display according to display settings. The display settings can identify, for instance, a position, orientation, and/or size of the virtual content as displayed. The environment can be viewable using the display as the virtual content is displayed by the display, for example using a see-through display or a pass-through display. The imaging system can determine, based on one or more attributes of one or both eyes of the user of the imaging system, an extent of perception of the virtual content that is displayed using the display by the user. The attributes can identify, for instance, eye position, eye movement, pupil dilation, saccades, fixations, blinking, and/or squinting. The XR system can determine, based on the extent of perception of the virtual content by the user, a modification to the display settings.

    PRIVATE CONTROL INTERFACES FOR EXTENDED REALITY

    公开(公告)号:US20220035508A1

    公开(公告)日:2022-02-03

    申请号:US17385055

    申请日:2021-07-26

    Abstract: Systems, methods, and non-transitory media are provided for generating private control interfaces for extended reality (XR) experiences. An example method can include determining a pose of an XR device within a mapped scene of a physical environment associated with the XR device; detecting a private region in the physical environment and a location of the private region relative to the pose of the XR device, the private region including an area estimated to be within a field of view (FOV) of a user of the XR device and out of a FOV of a person in the physical environment, a recording device in the physical environment, and/or an object in the physical environment; based on the pose of the XR device and the location of the private region, mapping a virtual private control interface to the private region; and rendering the virtual private control interface within the private region.

    TILE-BASED MACHINE LEARNING GRAPHICS PROCESSING

    公开(公告)号:US20240289911A1

    公开(公告)日:2024-08-29

    申请号:US18174502

    申请日:2023-02-24

    CPC classification number: G06T1/20

    Abstract: A graphics processing system including: a graphics processing unit (GPU) renderer configured to render a first set of tiles based on an input frame; a machine learning (ML) graphics processor configured to perform a graphics process based upon at least a first subset of the first set of tiles to generate a second set of tiles; and a first frame generator configured to generate a first output frame based on the second set of tiles.

    METHODS AND APPARATUS FOR DYNAMIC DISTORTION CORRECTION

    公开(公告)号:US20220392109A1

    公开(公告)日:2022-12-08

    申请号:US17341291

    申请日:2021-06-07

    Abstract: The present disclosure relates to methods and devices for data or graphics processing including an apparatus, e.g., a GPU. The apparatus may determine a plurality of viewing positions and a plurality of viewing directions for one or more lenses. The apparatus may also measure an amount of distortion of the one or more lenses for each of the plurality of viewing positions and each of the plurality of viewing directions. Also, the apparatus may adjust pre-distortion data for each of the plurality of viewing positions and each of the plurality of viewing directions. The apparatus may also determine a pre-distortion estimation for each of the plurality of viewing positions and each of the plurality of viewing directions. The apparatus may also generate lens calibration data for all of the plurality of viewing positions and all of the plurality of viewing directions based on the pre-distortion estimation.

    LOW LATENCY FRAME DELIVERY
    6.
    发明公开

    公开(公告)号:US20240289916A1

    公开(公告)日:2024-08-29

    申请号:US18657491

    申请日:2024-05-07

    CPC classification number: G06T1/60 G06T3/18 G06T5/80 G06T11/00 H04N23/73

    Abstract: Examples are described of marking specified regions of stored image frame buffer data in an image frame buffer. An imaging system can read the specified regions of the image frame buffer to identify whether the marking has been overwritten or not. The imaging system can thus efficiently identify how much of the image frame buffer has been overwritten with data from a new image frame. Based on this, the imaging system can retrieve partial image frame data from the image frame buffer and can process the partial image frame data, for instance to composite the partial image frame data with virtual content and/or to perform distortion compensation. The processed partial image frame data can be uploaded to a display buffer and displayed by a display, either as-is or once more of the frame is captured and processed. The imaging system can also perform auto-exposure using the partial image frame data.

    OBFUSCATED CONTROL INTERFACES FOR EXTENDED REALITY

    公开(公告)号:US20220413598A1

    公开(公告)日:2022-12-29

    申请号:US17822729

    申请日:2022-08-26

    Abstract: Systems, methods, and non-transitory media are provided for generating obfuscated control interfaces for extended reality (XR) experiences. An example method can include determining a pose of an XR device within a mapped scene of a physical environment associated with the XR device; rendering a virtual control interface within the mapped scene according to a configuration including a first size, a first position relative to the pose of the XR device, a first ordering of input elements, and/or a first number of input elements; and adjusting the configuration of the virtual control interface based on a privacy characteristic of data associated with the virtual control interface and/or characteristics of the physical environment associated with the XR device, the adjusted configuration including a second size, a second ordering of input elements, a second number of input elements, and/or a second position relative to the pose of the XR device and/or first position.

    COLLABORATIVE TRACKING
    8.
    发明公开

    公开(公告)号:US20240078700A1

    公开(公告)日:2024-03-07

    申请号:US18502983

    申请日:2023-11-06

    Abstract: An imaging system can receive an image of a portion of an environment. The environment can include an object, such as a hand or a display. The imaging device can identify a data stream from an external device, for instance by detecting the data stream in the image or by receiving the data stream wirelessly from the external device. The imaging device can detect a condition based on the image and/or the data stream, for instance by detecting that the object is missing from the image, by detecting that a low resource at the imaging device, and/or by detecting visual media content displayed by a display in the image. Upon detecting the condition, imaging device automatically determines a location of the object (or a portion thereof) using the data stream and/or the image. The imaging device generates and/or outputs content that is based on the location of the object.

    DYNAMIC CONTENT PRESENTATION FOR EXTENDED REALITY SYSTEMS

    公开(公告)号:US20230144091A1

    公开(公告)日:2023-05-11

    申请号:US17454188

    申请日:2021-11-09

    CPC classification number: G06F3/013

    Abstract: Systems and techniques are described for extended reality (XR) operations. An XR system displays virtual content using a display according to display settings. The display settings can identify, for instance, a position, orientation, and/or size of the virtual content as displayed. The environment can be viewable using the display as the virtual content is displayed by the display, for example using a see-through display or a pass-through display. The imaging system can determine, based on one or more attributes of one or both eyes of the user of the imaging system, an extent of perception of the virtual content that is displayed using the display by the user. The attributes can identify, for instance, eye position, eye movement, pupil dilation, saccades, fixations, blinking, and/or squinting. The XR system can determine, based on the extent of perception of the virtual content by the user, a modification to the display settings.

    COLLABORATIVE TRACKING
    10.
    发明申请

    公开(公告)号:US20220405959A1

    公开(公告)日:2022-12-22

    申请号:US17351856

    申请日:2021-06-18

    Abstract: An imaging system can receive an image of a portion of an environment. The environment can include an object, such as a hand or a display. The imaging device can identify a data stream from an external device, for instance by detecting the data stream in the image or by receiving the data stream wirelessly from the external device. The imaging device can detect a condition based on the image and/or the data stream, for instance by detecting that the object is missing from the image, by detecting that a low resource at the imaging device, and/or by detecting visual media content displayed by a display in the image. Upon detecting the condition, imaging device automatically determines a location of the object (or a portion thereof) using the data stream and/or the image. The imaging device generates and/or outputs content that is based on the location of the object.

Patent Agency Ranking