公开(公告)号：US11605191B1

公开(公告)日：2023-03-14

申请号：US17591181

申请日：2022-02-02

Applicant: META PLATFORMS TECHNOLOGIES, LLC

Inventor： Nadav Grossinger ,  Robert Hasbun

IPC: G06T13/20 ,  G06N20/00 ,  G06T19/00 ,  H04R5/033 ,  G02B27/01 ,  G06T13/40 ,  G10L21/10

Abstract: An audio system in a local area providing an audio signal to a headset of a remote user is presented herein. The audio system identifies sounds from a human sound source in the local area, based in part on sounds detected within the local area. The audio system generates an audio signal for presentation to a remote user within a virtual representation of the local area based in part on a location of the remote user within the virtual representation of the local area relative to a virtual representation of the human sound source within the virtual representation of the local area. The audio system provides the audio signal to a headset of the remote user, wherein the headset presents the audio signal as part of the virtual representation of the local area to the remote user.

公开(公告)号：US11941830B2

公开(公告)日：2024-03-26

申请号：US17496021

申请日：2021-10-07

Applicant: META PLATFORMS TECHNOLOGIES, LLC

Inventor： Niv Kantor ,  Ricardo Garcia ,  Nadav Grossinger ,  Robert Hasbun ,  Nitay Romano

IPC: G06T7/521 ,  G01S17/48

CPC classification number: G06T7/521 ,  G01S17/48 ,  G06T2207/10028

Abstract: In one embodiment, a system includes at least one projector configured to project a plurality of projected patterns, where a projected lighting characteristic of each of the projected patterns varies over a time period in accordance with an associated predetermined temporal lighting-characteristic pattern, a camera configured to capture images of detected patterns during the time period, and one or more processors configured to: determine, for each detected pattern, a detected temporal lighting-characteristic pattern based on variations in a detected lighting characteristic of the detected pattern, identify a detected pattern that corresponds to one of the projected patterns by comparing at least one of the detected temporal lighting-characteristic patterns to at least one of the temporal lighting-characteristic patterns, and compute a depth associated with the detected patterns based on the one or more of the projected patterns, the detected pattern, and a relative position between the camera and the projector.

公开(公告)号：US12008700B1

公开(公告)日：2024-06-11

申请号：US18120808

申请日：2023-03-13

Applicant: Meta Platforms Technologies, LLC

Inventor： Nadav Grossinger ,  Robert Hasbun

IPC: G06T13/20 ,  G02B27/01 ,  G06N20/00 ,  G06T13/40 ,  G06T19/00 ,  G10L21/10 ,  H04R5/033

CPC classification number: G06T13/205 ,  G02B27/0172 ,  G06N20/00 ,  G06T13/40 ,  G06T19/006 ,  G10L21/10 ,  H04R5/033 ,  G10L2021/105

Abstract: An audio system in a local area providing an audio signal to a headset of a remote user is presented herein. The audio system identifies sounds from a human sound source in the local area, based in part on sounds detected within the local area. The audio system generates an audio signal for presentation to a remote user within a virtual representation of the local area based in part on a location of the remote user within the virtual representation of the local area relative to a virtual representation of the human sound source within the virtual representation of the local area. The audio system provides the audio signal to a headset of the remote user, wherein the headset presents the audio signal as part of the virtual representation of the local area to the remote user.

公开(公告)号：US11949213B2

公开(公告)日：2024-04-02

申请号：US17069731

申请日：2020-10-13

Applicant: META PLATFORMS TECHNOLOGIES, LLC

Inventor： Nadav Grossinger ,  Michael Hall ,  Robert Hasbun ,  Jonatan Ginzburg ,  Zihe Gao

IPC: H01S5/42 ,  G01S17/89 ,  G02B27/01 ,  G06T7/521 ,  H04N13/271

CPC classification number: H01S5/423 ,  G01S17/89 ,  G02B27/0172 ,  G06T7/521 ,  H04N13/271

Abstract: A depth camera assembly (DCA) determines depth information for a local area. The DCA includes a camera assembly and at least one illuminator. The DCA may select a subset of the VCSELs to provide illumination at any given time. The illuminator may comprise near-field VCSELs configured to generate a structured light (SL) pattern for depth sensing in the near-field and far-field VCSELs configured to generate a SL pattern for depth sensing in the far-field. The near-field VCSELs may comprise a linear emission region which is shorter than a linear emission region of the far-field VCSELs. The DCA may generate and phase shift a quasi-sinusoidal SL pattern. The DCA may phase shift the quasi-sinusoidal SL pattern by alternating which traces on the illuminator are active.