公开(公告)号：US11941830B2

公开(公告)日：2024-03-26

申请号：US17496021

申请日：2021-10-07

Applicant: META PLATFORMS TECHNOLOGIES, LLC

Inventor： Niv Kantor ,  Ricardo Garcia ,  Nadav Grossinger ,  Robert Hasbun ,  Nitay Romano

IPC: G06T7/521 ,  G01S17/48

CPC classification number: G06T7/521 ,  G01S17/48 ,  G06T2207/10028

Abstract: In one embodiment, a system includes at least one projector configured to project a plurality of projected patterns, where a projected lighting characteristic of each of the projected patterns varies over a time period in accordance with an associated predetermined temporal lighting-characteristic pattern, a camera configured to capture images of detected patterns during the time period, and one or more processors configured to: determine, for each detected pattern, a detected temporal lighting-characteristic pattern based on variations in a detected lighting characteristic of the detected pattern, identify a detected pattern that corresponds to one of the projected patterns by comparing at least one of the detected temporal lighting-characteristic patterns to at least one of the temporal lighting-characteristic patterns, and compute a depth associated with the detected patterns based on the one or more of the projected patterns, the detected pattern, and a relative position between the camera and the projector.

公开(公告)号：US11962748B2

公开(公告)日：2024-04-16

申请号：US17339559

申请日：2021-06-04

Applicant: META PLATFORMS TECHNOLOGIES, LLC

Inventor： Nitay Romano ,  Nadav Grossinger ,  Yair Alpern ,  Emil Alon

IPC: H04N13/296 ,  G01S7/481 ,  G01S17/46 ,  G01S17/89 ,  G02B27/42 ,  G06F3/01 ,  G06F3/03 ,  H04N13/128 ,  H04N13/207 ,  H04N13/282 ,  H01S5/42

CPC classification number: H04N13/296 ,  G01S7/4815 ,  G01S17/46 ,  G01S17/89 ,  G02B27/4205 ,  G02B27/4255 ,  G06F3/017 ,  G06F3/0304 ,  G06F3/0321 ,  H04N13/128 ,  H04N13/207 ,  H04N13/282 ,  H01S5/423

Abstract: Apparatus for generating a dynamic structured light pattern for optical tracking in three-dimensional space, comprises an array of lasers, such as a VCSEL laser array, to project light in a pattern into a three-dimensional space; and an optical element or elements arranged in cells. The cells are aligned with subsets of the laser array, and each cell individually applies a modulation, in particular an intensity modulation, to light from the laser or lasers of the subset, to provide a distinguishable and separately controllable part of the dynamic structured light pattern. A method of generating a structured light pattern is disclosed, in which light is provided from an array of lasers, and light is individually projected from subsets of the array of lasers to provide differentiated parts of the structured light pattern.

公开(公告)号：US11605191B1

公开(公告)日：2023-03-14

申请号：US17591181

申请日：2022-02-02

Applicant: META PLATFORMS TECHNOLOGIES, LLC

Inventor： Nadav Grossinger ,  Robert Hasbun

IPC: G06T13/20 ,  G06N20/00 ,  G06T19/00 ,  H04R5/033 ,  G02B27/01 ,  G06T13/40 ,  G10L21/10

Abstract: An audio system in a local area providing an audio signal to a headset of a remote user is presented herein. The audio system identifies sounds from a human sound source in the local area, based in part on sounds detected within the local area. The audio system generates an audio signal for presentation to a remote user within a virtual representation of the local area based in part on a location of the remote user within the virtual representation of the local area relative to a virtual representation of the human sound source within the virtual representation of the local area. The audio system provides the audio signal to a headset of the remote user, wherein the headset presents the audio signal as part of the virtual representation of the local area to the remote user.

公开(公告)号：US12008700B1

公开(公告)日：2024-06-11

申请号：US18120808

申请日：2023-03-13

Applicant: Meta Platforms Technologies, LLC

Inventor： Nadav Grossinger ,  Robert Hasbun

IPC: G06T13/20 ,  G02B27/01 ,  G06N20/00 ,  G06T13/40 ,  G06T19/00 ,  G10L21/10 ,  H04R5/033

CPC classification number: G06T13/205 ,  G02B27/0172 ,  G06N20/00 ,  G06T13/40 ,  G06T19/006 ,  G10L21/10 ,  H04R5/033 ,  G10L2021/105

Abstract: An audio system in a local area providing an audio signal to a headset of a remote user is presented herein. The audio system identifies sounds from a human sound source in the local area, based in part on sounds detected within the local area. The audio system generates an audio signal for presentation to a remote user within a virtual representation of the local area based in part on a location of the remote user within the virtual representation of the local area relative to a virtual representation of the human sound source within the virtual representation of the local area. The audio system provides the audio signal to a headset of the remote user, wherein the headset presents the audio signal as part of the virtual representation of the local area to the remote user.

公开(公告)号：US11949213B2

公开(公告)日：2024-04-02

申请号：US17069731

申请日：2020-10-13

Applicant: META PLATFORMS TECHNOLOGIES, LLC

Inventor： Nadav Grossinger ,  Michael Hall ,  Robert Hasbun ,  Jonatan Ginzburg ,  Zihe Gao

IPC: H01S5/42 ,  G01S17/89 ,  G02B27/01 ,  G06T7/521 ,  H04N13/271

CPC classification number: H01S5/423 ,  G01S17/89 ,  G02B27/0172 ,  G06T7/521 ,  H04N13/271

Abstract: A depth camera assembly (DCA) determines depth information for a local area. The DCA includes a camera assembly and at least one illuminator. The DCA may select a subset of the VCSELs to provide illumination at any given time. The illuminator may comprise near-field VCSELs configured to generate a structured light (SL) pattern for depth sensing in the near-field and far-field VCSELs configured to generate a SL pattern for depth sensing in the far-field. The near-field VCSELs may comprise a linear emission region which is shorter than a linear emission region of the far-field VCSELs. The DCA may generate and phase shift a quasi-sinusoidal SL pattern. The DCA may phase shift the quasi-sinusoidal SL pattern by alternating which traces on the illuminator are active.

公开(公告)号：US11592572B2

公开(公告)日：2023-02-28

申请号：US17146289

申请日：2021-01-11

Applicant: Meta Platforms Technologies, LLC

Inventor： Niv Kantor ,  Nadav Grossinger ,  Nitay Romano

IPC: G01S17/89 ,  G01S7/481 ,  H04N5/225

Abstract: In one embodiment, a system includes at least one projector comprising a plurality of light emitters, where the projector is configured to project a projected pattern comprising a plurality of projected features having different locations; a camera configured to capture an image comprising a detected pattern corresponding to a reflection of the projected pattern; and one or more processors configured to: identify at least one detected feature of the detected pattern, wherein the detected feature corresponds to at least one reflection of the projected features; and activate or deactivate one or more of the light emitters based on the detected feature. The light emitters may be activated or deactivated by determining a detected feature measurement based on the detected feature, and activating or deactivating one or more of the light emitters when the detected feature measurement satisfies a threshold feature measurement condition.