公开(公告)号：WO2017106053A1

公开(公告)日：2017-06-22

申请号：PCT/US2016/065985

申请日：2016-12-09

Applicant: OCULUS VR, LLC

Inventor： TRAIL, Nicholas, Daniel

IPC: H04N13/02 ,  H04N13/04

CPC classification number: H04N13/344 ,  G01S17/107 ,  G01S17/89 ,  G02B27/0025 ,  G06F3/011 ,  G06F3/0304 ,  H04N13/254 ,  H04N13/271 ,  H04N13/296

Abstract: An augmented reality (AR) includes a depth camera assembly (DCA) to capture images of various depth zones of scenes of a local area. The DCA can focus on specific ranges in a scene, important aspects, and/or regions of interest. The DCA generates image data of the local area such that the image includes information pertaining to a single depth zone. The captured image is specific to the single depth zone and is representative of objects within the single depth zone. The DCA uses the generated image data for the depth zones to generate augmented or partially- augmented images that include depth information for the objects in the local area.

Abstract translation: 增强现实（AR）包括深度相机组件（DCA）以捕捉局部区域的场景的各种深度区域的图像。 DCA可以专注于场景中的特定范围，重要方面和/或感兴趣区域。 DCA生成局部区域的图像数据，使得图像包括关于单个深度区域的信息。 捕获的图像特定于单个深度区域，并代表单个深度区域内的对象。 DCA使用生成的深度区域图像数据生成包含局部区域内物体深度信息的增强图像或部分增强图像。

公开(公告)号：WO2018038763A1

公开(公告)日：2018-03-01

申请号：PCT/US2017/016551

申请日：2017-02-03

Applicant: OCULUS VR, LLC

Inventor： TRAIL, Nicholas, Daniel ,  DE NARDI, Renzo ,  NEWCOMBE, Richard, A.

IPC: H04N13/02 ,  H04N13/04

Abstract: A depth camera assembly (DCA) captures data describing depth information in a local area. The DCA includes an array detector, a controller, and an illumination source. The array detector includes a detector that is overlaid with a lens array. The detector includes a plurality of pixels, the plurality of pixels are divided into a plurality of different pixel groups. The lens array includes a plurality of lens stacks and each lens stack overlays a different pixel group. The array detector captures one or more composite images of the local area illuminated with the light from the illumination source. The controller determines depth information for objects in the local area using the one or more composite images.

Abstract translation: 深度相机组件（DCA）捕获描述局部区域深度信息的数据。 DCA包括阵列检测器，控制器和照明源。 阵列检测器包括覆盖有透镜阵列的检测器。 检测器包括多个像素，多个像素被分成多个不同的像素组。 透镜阵列包括多个透镜堆叠并且每个透镜堆叠覆盖不同的像素组。 阵列检测器捕获用来自照明源的光照亮的局部区域的一个或多个合成图像。 控制器使用一个或多个合成图像来确定局部区域中的物体的深度信息。

公开(公告)号：WO2017123452A1

公开(公告)日：2017-07-20

申请号：PCT/US2017/012346

申请日：2017-01-05

Applicant: OCULUS VR, LLC

Inventor： TRAIL, Nicholas, Daniel

IPC: G02B27/01 ,  G02B26/06 ,  G06T19/00 ,  H04N13/02

CPC classification number: G01B11/2513 ,  G01C3/08 ,  G01S17/32 ,  G01S17/36 ,  G01S17/46 ,  G01S17/89 ,  G06T7/30 ,  G06T7/35 ,  G06T7/521 ,  G06T7/529 ,  G06T19/006 ,  G06T2207/10016 ,  G06T2207/10028

Abstract: A depth camera assembly (DCA) determines distances between the DCA and objects in a local area within a field of view of the DCA. The DCA includes an illumination source that projects a known spatial pattern modulated with a temporal carrier signal into the local area. An imaging device capture the modulated partem projected into the local area. The imaging device includes a detector that comprises different pixel groups that are each activated to captured light at different times. Hence, different pixel groups capture different phases of the temporally modulated pattern from the local area. The DCA determines times for light from the illumination source to be reflected and captured by the imaging device from the phases captured by the different pixel groups and also determines distances between the DCA and objects in the local area based on deformation of the spatial partem captured by the imaging device.

Abstract translation: 深度相机组件（DCA）确定DCA与DCA视野内局部区域内物体之间的距离。 DCA包括将用时间载波信号调制的已知空间模式投影到局部区域的照明源。 成像设备捕获投影到局部区域的调制部分。 成像设备包括检测器，该检测器包括不同的像素组，每个像素组被激活以在不同的时间捕获光。 因此，不同的像素组捕捉来自局部区域的时间调制图案的不同相位。 DCA根据由不同像素组捕获的相位来确定来自照明源的光线被成像设备反射和捕获的时间，并且还基于捕获的空间部分的变形来确定DCA和局部区域中的对象之间的距离 成像设备。

公开(公告)号：WO2017079172A1

公开(公告)日：2017-05-11

申请号：PCT/US2016/059938

申请日：2016-11-01

Applicant: OCULUS VR, LLC

Inventor： TRAIL, Nicholas, Daniel ,  CAVIN, Robert, Dale

IPC: G02B27/00 ,  G02B27/01 ,  G06F3/01

CPC classification number: G06F3/041 ,  G01B11/2513 ,  G02B27/0093 ,  G02B27/0172 ,  G06K9/00604 ,  G06K9/0061 ,  G06K9/00617 ,  G06K9/2036 ,  G06T7/004 ,  G06T7/70 ,  G06T19/006

Abstract: Disclosed is a system and method for tracking a user's eye using structured light. The structured light system is calibrated by training a model of surface of the user's eye. A structured light emitter projects a structured light pattern (e.g., infrared structured light) onto a portion of the surface of the eye. From the viewpoint of a camera, the illumination pattern appears distorted. Based on the distortion of the illumination pattern in the captured image, the eye tracking system can determine the shape of the portion of the user's eye that the structured light is incident upon. By comparing the determined shape of the portion of the user's eye to the model, the orientation of the eye may be determined. The eye tracking system or elements thereof may be part of a head-mounted display, e.g., as part of a virtual reality system.

Abstract translation: 公开了一种使用结构光来跟踪用户眼睛的系统和方法。 通过训练用户眼睛表面的模型来校准结构化光系统。 结构化光发射器将结构化光图案（例如，红外结构光）投射到眼睛表面的一部分上。 从照相机的角度看，照明模式显得失真。 基于拍摄图像中照明图案的失真，眼睛跟踪系统可以确定结构光入射在用户的眼睛部分的形状。 通过比较用户眼睛的该部分的确定形状与模型，可以确定眼睛的方位。 眼睛跟踪系统或其元件可以是头戴式显示器的一部分，例如作为虚拟现实系统的一部分。

公开(公告)号：WO2018031179A1

公开(公告)日：2018-02-15

申请号：PCT/US2017/041870

申请日：2017-07-13

Applicant: OCULUS VR, LLC

Inventor： TRAIL, Nicholas, Daniel ,  DE NARDI, Renzo ,  NEWCOMBE, Richard, Andrew

IPC: H04N13/02 ,  H04N13/04

Abstract: A depth camera assembly (DCA) that captures data describing depth information in a local area. The DCA includes an imaging device, a controller, and an illumination source. The illumination source includes a plurality of emitters on a single substrate. The imaging device captures one or more images of the local area illuminated with the light from the illumination source. The controller determines depth information for objects in the local area using the one or more images.

Abstract translation: 深度相机组件（DCA），用于捕获描述局部区域深度信息的数据。 DCA包括成像设备，控制器和照明源。 照明源包括在单个衬底上的多个发射器。 成像设备捕获用来自照明源的光照亮的局部区域的一个或多个图像。 控制器使用一个或多个图像来确定局部区域中的物体的深度信息。

公开(公告)号：WO2017079458A1

公开(公告)日：2017-05-11

申请号：PCT/US2016/060364

申请日：2016-11-03

Applicant: OCULUS VR, LLC

Inventor： TRAIL, Nicholas, Daniel ,  FIX, Alexander, Jobe

IPC: G02B27/01 ,  G02B27/22 ,  G03B35/18

CPC classification number: H04N13/344 ,  G06T19/006 ,  H04N13/128 ,  H04N13/239 ,  H04N13/254

Abstract: A an augmented reality (AR) headset includes a depth camera assembly that combines stereo imaging with structured light (SL) to generate depth information for an area of interest. The depth camera assembly includes at least two image capture devices and a SL illuminator and determines an imaging mode based on a signal to noise ratio or spatial variance of images captured by one or more of the cameras. Different imaging modes correspond to different operation of one or more image capture devices and the SL illuminator. The depth camera assembly includes different ranges of signal to noise ratios that each correspond to an imaging mode, and the depth camera assembly configures the image capture devices and the SL illuminator based on an imaging mode associated with a range of signal to noise ratios including the signal to noise ratio of a captured image.

Abstract translation: 增强现实（AR）头戴式耳机包括深度相机组件，其将立体成像与结构光（SL）组合以生成感兴趣区域的深度信息。 深度相机组件包括至少两个图像捕捉设备和SL照明器，并且基于由一个或多个相机捕捉的图像的信噪比或空间变化来确定成像模式。 不同的成像模式对应于一个或多个图像捕获设备和SL照明器的不同操作。 深度相机组件包括不同范围的信噪比，每个信噪比对应于成像模式，并且深度相机组件基于与一定范围的信噪比相关联的成像模式来配置图像捕捉设备和SL照明器，所述信噪比范围包括 捕获图像的信噪比。