INTERACTIONS BASED ON MIRROR DETECTION AND CONTEXT AWARENESS

    公开(公告)号:WO2023043647A1

    公开(公告)日:2023-03-23

    申请号:PCT/US2022/042684

    申请日:2022-09-07

    Abstract: Various implementations disclosed herein include devices, systems, and methods that present virtual content based on detecting a reflection and determining the context associated with a use of the electronic device in the physical environment. For example, an example process may include obtaining sensor data from one or more sensors of the electronic device in a physical environment that includes one or more objects, detecting a reflected image amongst the one or more objects based on the sensor data, and in accordance with detecting the reflected image, determining a context associated with a use of the electronic device in the physical environment based on the sensor data, and presenting virtual content based on the context, wherein the virtual content is positioned at a three-dimensional (3D) location based on a 3D position of the reflected image.

    OBJECT LOCALIZATION AND INFORMATION ENCODING SYSTEM

    公开(公告)号:WO2023049305A1

    公开(公告)日:2023-03-30

    申请号:PCT/US2022/044461

    申请日:2022-09-22

    Abstract: Fiducial patterns that include sub-patterns of dot-like markers are generated or applied on or in transparent glass or plastic material, for example an optical element such as a cover glass or lens attachment. A camera may capture multiple images through the glass or plastic element that include diffraction patterns caused by the fiducial patterns. The diffraction patterns from multiple images may be processed and analyzed to extract information including but not limited to centroids of the sub-patterns of the fiducial patterns. This information may, for example, be used to estimate location of the fiducial patterns with respect to the camera, and thus to estimate pose of the glass or lens element with respect to the camera. Information such as serial numbers and prescriptions can also be encoded in the fiducial patterns and extracted from the respective diffraction patterns.

    SYSTEMS AND METHODS FOR CREATING, UPDATING, AND SHARING NOVEL FILE STRUCTURES FOR PERSISTENT 3D OBJECT MODEL MARKUP INFORMATION

    公开(公告)号:WO2023049153A1

    公开(公告)日:2023-03-30

    申请号:PCT/US2022/044209

    申请日:2022-09-21

    Abstract: Techniques are disclosed for rendering graphical content, e.g., in an extended reality (XR) environment, that provide for a creator (or recipient) of a 3D object markup file, e.g., a user operating an electronic device configured to be aware of the structure and organization of the 3D object markup file's format, to: create a 3D object markup file; reproduce a 3D object for display, along with its corresponding markup information; toggle the markup information on or off for display; and/or make further updates to such markup information with complete reproduction fidelity and accuracy. Techniques herein also provide for the sharing of 3D object markup files (including any persistent markup information) with other users, e.g., asynchronously or in real-time, allowing for collaboration in the process of marking up virtual 3D objects. The 3D object markup file may also be exported, such that the markups are no longer editable or toggleable for display.

    IDENTIFYING LENS CHARACTERISTICS USING REFLECTIONS

    公开(公告)号:WO2023049066A1

    公开(公告)日:2023-03-30

    申请号:PCT/US2022/043959

    申请日:2022-09-19

    Abstract: Various implementations disclosed herein include devices, systems, and methods that determine a lens characteristic of an attachable lens using reflections. In some implementations, a method can include producing a pattern of light using an arrangement of light sources. Then, reflections are detected in an image obtained via an image sensor, the reflections corresponding to light from each of a plurality of the light sources reflecting from a surface of an attachable lens. In some implementations, a lens characteristic of the attachable lens is determined based on the detected reflections and a 3D spatial relationship between the image sensor and the plurality of the light sources. In some implementations, the lens characteristic is a prescription, and content is provided at the electronic device based on the prescription, where the content is viewable through the attachable lens.

    EYE REFLECTIONS USING IR LIGHT SOURCES ON A TRANSPARENT SUBSTRATE

    公开(公告)号:WO2023049065A1

    公开(公告)日:2023-03-30

    申请号:PCT/US2022/043956

    申请日:2022-09-19

    Abstract: Various implementations disclosed herein include electronic devices, systems, and methods that detect reflections of light produced by a plurality of light sources reflected from an eye. An example electronic device may include a frame, an image sensor, a transparent substrate coupled to the frame, a waveguide coupled to the transparent substrate, and a processor coupled to the plurality of IR light sources. The transparent substrate may include a plurality of infrared (IR) light sources that may be configured in a spatial arrangement within the transparent substrate or on a surface of the transparent substrate. The waveguide may be configured to display a projected image. The processor may be configured to receive sensor data from the image sensor. The sensor data may correspond to a plurality of reflections of light produced by the plurality of IR light sources and reflected from an eye.

    3D SPOTLIGHT
    6.
    发明申请
    3D SPOTLIGHT 审中-公开

    公开(公告)号:WO2023048973A1

    公开(公告)日:2023-03-30

    申请号:PCT/US2022/043174

    申请日:2022-09-12

    Abstract: Various implementations disclosed herein include devices, systems, and methods that provide 3D content that is presented over time (e.g. a video of 3D point-based frames), where the 3D content includes only content of interest, e.g., showing just one particular person, the floor near that person, and objects with which the person is near or interacting. The presented content may be stabilized within the viewers environment, for example, by removing content changes corresponding to movement of the capturing device.

    ALIGNING SCANNED ENVIRONMENTS FOR MULTI-USER COMMUNICATION SESSIONS

    公开(公告)号:WO2023043607A1

    公开(公告)日:2023-03-23

    申请号:PCT/US2022/041952

    申请日:2022-08-30

    Abstract: Various implementations provide a method for determining position data of a first device relative to a three-dimensional (3D) representation during a communication session. For example, a 3D representation is determined by a first device to correspond to a current physical environment of the first device. Then a spatial relationship is determined between the 3D representation and the current physical environment. Then position data is determined to correspond to a position of the first device relative to the 3D representation and based on a location of the first device in the current physical environment and the spatial relationship between the 3D representation and the current physical environment. The position data is then provided during a communication session between the first device and a second device with a view of the 3D representation including a representation of a user of the first device presented to a user of the second device.

    AUDIENCE ENGAGEMENT
    8.
    发明申请
    AUDIENCE ENGAGEMENT 审中-公开

    公开(公告)号:WO2023038781A1

    公开(公告)日:2023-03-16

    申请号:PCT/US2022/041005

    申请日:2022-08-22

    Abstract: Various implementations disclosed herein include devices, systems, and methods for displaying presentation notes at varying positions within a presenter's field of view. In some implementations, a device includes a display, one or more processors, and a memory. A first portion of a media content item corresponding to a presentation is displayed at a first location in a three-dimensional environment. Audience engagement data corresponding to an engagement level of a member of an audience is received. A second portion of the media content item is displayed at a second location in the three-dimensional environment. The second location is selected based on the audience engagement data.

    EYE TRACKING USING COHERENCE-BASED MEASUREMENT

    公开(公告)号:WO2023049088A1

    公开(公告)日:2023-03-30

    申请号:PCT/US2022/044060

    申请日:2022-09-20

    Abstract: Various implementations disclosed herein include devices, systems, and methods that track a state of a user's eye (e.g., position/orientation, gaze direction accommodation, pupil dilation, etc.) using coherence-based measurement (e.g., optical coherence tomography (OCT)). The coherence-based measurement may provide sub-surface information, e.g., depth, cross section, or a volumetric model of the eye, based on reflections/scattering of light (e.g., using relatively long wavelength light to penetrate into the eye tissue).

    CONTENT MANIPULATION VIA A COMPUTER-GENERATED REPRESENTATION OF A TRACKPAD

    公开(公告)号:WO2023049063A1

    公开(公告)日:2023-03-30

    申请号:PCT/US2022/043951

    申请日:2022-09-19

    Abstract: A method includes determining a first gaze position within a content manipulation region based on eye tracking data from an eye tracker. The method includes determining a selection point associated with a physical surface, based on spatial selector data from a spatial selector tracker. The method includes displaying a computer-generated representation of a trackpad on the physical surface, based on the first gaze position and the selection point. In some implementations, a method includes displaying a user interface including a plurality of content manipulation regions, a plurality of affordances respectively associated with the plurality of content manipulation regions, and a computer-generated representation of a trackpad. The method includes detecting, via a spatial selector tracker, an input directed to a first affordance associated with a first content manipulation region. The method includes associating the computer-generated representation of the trackpad with the first content manipulation region, based on the input.

Patent Agency Ranking