公开(公告)号：US11146763B1

公开(公告)日：2021-10-12

申请号：US16659677

申请日：2019-10-22

Applicant: Sagi Katz

Inventor： Sagi Katz

IPC: H04N9/31 ,  G02B27/01 ,  G06F1/16

Abstract: A photo filter (e.g., artistic) light field effect system comprises an eyewear device that includes a frame, a temple connected to a lateral side of the frame, and a depth-capturing camera. Execution of programming by a processor configures the photo filter light field effect system to apply a photo filter selection to: (i) a left raw image or a left processed image to create a left photo filter image, and (ii) a right raw image or a right processed image to create a right photo filter image. The photo filter light field effect system generates, a photo filter light field effect image with an appearance of a spatial rotation or movement, by blending together the left photo filter image and the right photo filter image based on a left image disparity map and a right image disparity map.

公开(公告)号：US20210099685A1

公开(公告)日：2021-04-01

申请号：US16674086

申请日：2019-11-05

Applicant: Sagi Katz

Inventor： Sagi Katz

IPC: H04N13/111 ,  H04N5/262 ,  H04N13/128 ,  G06T19/00 ,  H04N13/332

Abstract: A photo filter (e.g., multi-dimensional) light field effect system includes an eyewear device having a frame, a temple connected to a lateral side of the frame, and a depth-capturing camera. Execution of programming by a processor configures the system to create an image in each of a least two dimensions and create a multi-dimensional light field effect image with an appearance of a spatial rotation or movement and transitional change, by blending together a left photo filter image and a right photo filter image in each dimension and blending the blended images from all dimensions.

公开(公告)号：US09720089B2

公开(公告)日：2017-08-01

申请号：US13356618

申请日：2012-01-23

Applicant: Sagi Katz ,  Avishai Adler ,  Giora Yahav ,  David Cohen ,  Eli Larry ,  Shlomo Felzenshtein

Inventor： Sagi Katz ,  Avishai Adler ,  Giora Yahav ,  David Cohen ,  Eli Larry ,  Shlomo Felzenshtein

IPC: H04N13/02 ,  G01S17/89 ,  G01S17/10 ,  G01S17/87

CPC classification number: G01S17/89 ,  G01S17/10 ,  G01S17/87 ,  H04N13/239

Abstract: A 3D imager comprising two cameras having fixed wide-angle and narrow angle FOVs respectively that overlap to provide an active space for the imager and a controller that determines distances to features in the active space responsive to distances provided by the cameras and a division of the active space into near, intermediate, and far zones.

公开(公告)号：US20160139265A1

公开(公告)日：2016-05-19

申请号：US14610984

申请日：2015-01-30

Applicant: Giora Yahav ,  David Cohen ,  Sagi Katz

Inventor： Giora Yahav ,  David Cohen ,  Sagi Katz

IPC: G01S17/06 ,  G02C11/04 ,  G02C11/00

CPC classification number: G01S17/66 ,  A61B3/113 ,  G01S17/06 ,  G01S17/42 ,  G02B27/0093 ,  G02C11/04 ,  G02C11/10 ,  G06F3/013 ,  G06K9/00604 ,  G06K2009/3291 ,  H04N5/23219

Abstract: An eye movement tracking device that can be mounted to standard eyeglasses as disclosed. The device comprises an illumination source, a time-of-flight (TOF) camera and a processor. The source transmits energy within a frequency band from a location proximate to an eye of a person, such that at least a first portion of the transmitted energy is reflected off a lens of eyewear worn by the person to subsequently reflect off the eye, and such that at least a second portion of the transmitted energy is transmitted through the lens to reflect off objects in the person's environment. The TOF camera detects reflections of at least the first portion of the transmitted energy, and distinguishes them from other energy detected by the TOF camera in said frequency band, based on TOF principles. The processor uses the detected reflections of the first portion of the transmitted energy to determine eye position.

Abstract translation: 如所公开的，可以安装到标准眼镜上的眼睛运动跟踪装置。 该装置包括照明源，飞行时间（TOF）照相机和处理器。 源从位于人眼附近的位置的频带内传送能量，使得所传送的能量的至少第一部分被人的眼镜的镜片反射，以随后反射出眼睛。 透射能量的至少第二部分透过透镜以反射人的环境中的物体。 TOF摄像机根据TOF原理检测至少第一部分发射能量的反射，并将它们与TOF相机在所述频带中检测到的其他能量进行区分。 处理器使用检测到的透射能量的第一部分的反射来确定眼睛位置。

公开(公告)号：US08831289B2

公开(公告)日：2014-09-09

申请号：US13351680

申请日：2012-01-17

Applicant: Sagi Katz ,  Giora Yahav

Inventor： Sagi Katz ,  Giora Yahav

IPC: G06K9/00 ,  G06T7/00

CPC classification number: G06T7/0053 ,  G06T7/507

Abstract: A computing system generates a depth map from at least one image, detects objects in the depth map, and identifies anomalies in the objects from the depth map. Another computing system identifies at least one anomaly in an object in a depth map, and uses the anomaly to identify future occurrences of the object. A system includes a three dimensional (3D) imaging system to generate a depth map from at least one image, an object detector to detect objects within the depth map, and an anomaly detector to detect anomalies in the detected objects, wherein the anomalies are logical gaps and/or logical protrusions in the depth map.

Abstract translation: 计算系统从至少一个图像生成深度图，检测深度图中的对象，并从深度图识别对象中的异常。 另一个计算系统在深度图中识别对象中的至少一个异常，并使用异常来识别对象的未来出现。 系统包括三维（3D）成像系统，用于从至少一个图像生成深度图，对象检测器检测深度图内的对象，以及异常检测器，用于检测检测到的对象中的异常，其中异常是逻辑的 间隙和/或逻辑突起。

公开(公告)号：US08687044B2

公开(公告)日：2014-04-01

申请号：US12698940

申请日：2010-02-02

Applicant: Sagi Katz ,  Avishai Adler ,  Guy Gilboa

Inventor： Sagi Katz ,  Avishai Adler ,  Guy Gilboa

IPC: H04N13/02 ,  G06T17/00 ,  H04N13/00

CPC classification number: H04N13/139 ,  H04N13/128

Abstract: Compatibility between a depth image consumer and a plurality of different depth image producers is provided by receiving a native depth image having unsupported depth camera parameters that are not compatible with a depth image consumer, and converting the native depth image to a virtual depth image having supported virtual depth camera parameters that are compatible with the depth image consumer. This virtual depth image is then output to the depth image consumer.

Abstract translation: 通过接收具有与深度图像消费者不兼容的不支持的深度相机参数的本地深度图像，并且将本机深度图像转换为具有支持的虚拟深度图像，来提供深度图像消费者和多个不同深度图像生成者之间的兼容性 与深度图像消费者兼容的虚拟深度相机参数。 然后将该虚拟深度图像输出到深度图像消费者。

公开(公告)号：US08660362B2

公开(公告)日：2014-02-25

申请号：US13301412

申请日：2011-11-21

Applicant: Sagi Katz ,  Avishai Adler ,  Giora Yahav

Inventor： Sagi Katz ,  Avishai Adler ,  Giora Yahav

IPC: G06K9/48 ,  G06K9/40

CPC classification number: G06K9/00201 ,  G06K9/00375 ,  G06T5/002 ,  G06T2207/10028

Abstract: Systems and methods for increasing the resolution of a depth map by identifying and updating false depth pixels are described. In some embodiments, a depth pixel of the depth map is initially assigned a confidence value based on curvature values and localized contrast information. The curvature values may be generated by applying a Laplacian filter or other edge detection filter to the depth pixel and its neighboring pixels. The localized contrast information may be generated by determining a difference between the maximum and minimum depth values associated with the depth pixel and its neighboring pixels. A false depth pixel may be identified by comparing a confidence value associated with the false depth pixel with a particular threshold. The false depth pixel may be updated by assigning a new depth value based on an extrapolation of depth values associated with neighboring pixel locations.

Abstract translation: 描述通过识别和更新假深度像素来增加深度图的分辨率的系统和方法。 在一些实施例中，深度图的深度像素最初基于曲率值和局部对比度信息被分配置信度值。 可以通过将拉普拉斯滤波器或其他边缘检测滤波器应用于深度像素及其相邻像素来产生曲率值。 可以通过确定与深度像素及其相邻像素相关联的最大和最小深度值之间的差异来生成局部对比度信息。 可以通过将与虚拟深度像素相关联的置信度值与特定阈值进行比较来识别伪深度像素。 可以通过基于与相邻像素位置相关联的深度值的外推来分配新的深度值来更新错误深度像素。

公开(公告)号：US08149210B2

公开(公告)日：2012-04-03

申请号：US12003705

申请日：2007-12-31

Applicant: Zvi Klier ,  Sagi Katz ,  Mattias Marder ,  Giora Yahav

Inventor： Zvi Klier ,  Sagi Katz ,  Mattias Marder ,  Giora Yahav

IPC: G09G5/00

CPC classification number: G06F3/0304 ,  G06F3/011 ,  G06F3/013

Abstract: A system and method for identifying a pointing organ or a pointing device in a field of imaging of a 3-D imaging system and for calculating a line of pointing relative to this organ or device are disclosed. The method and system may be used to enable a user to communicate with computer programs, such as computer games, 3-D design programs and the like. The method and system may further employ a trigger-like mechanism to identify a movement of a user that may be interpreted as trigger activation.

Abstract translation: 公开了一种用于识别3-D成像系统的成像领域中的指示器官或指示装置并且用于计算相对于该器官或装置的指向线的系统和方法。 该方法和系统可以用于使得用户能够与诸如计算机游戏，3D设计程序等的计算机程序通信。 该方法和系统可以进一步采用类似触发器的机构来识别可被解释为触发激活的用户的移动。

公开(公告)号：US20120056982A1

公开(公告)日：2012-03-08

申请号：US12877595

申请日：2010-09-08

Applicant: Sagi Katz ,  Avishai Adler

Inventor： Sagi Katz ,  Avishai Adler

IPC: H04N13/02

CPC classification number: G06F3/017 ,  G01S3/7864 ,  G06F3/0304 ,  G06T7/521 ,  G06T7/593 ,  G06T2207/30196 ,  H04N13/25 ,  H04N13/254 ,  H04N13/271

Abstract: A depth camera system uses a structured light illuminator and multiple sensors such as infrared light detectors, such as in a system which tracks the Motion of a user in a field of view. One sensor can be optimized for shorter range detection while another sensor is optimized for longer range detection. The sensors can have a different baseline distance from the illuminator, as well as a different spatial resolution, exposure time and sensitivity. In one approach, depth values are obtained from each sensor by matching to the structured light pattern, and the depth values are merged to obtain a final depth map which is provided as an input to an application. The merging can involve unweighted averaging, weighted averaging, accuracy measures and/or confidence measures. In another approach, additional depth values which are included in the merging are obtained using stereoscopic matching among pixel data of the sensors.

Abstract translation: 深度相机系统使用结构化光照射器和诸如红外光检测器的多个传感器，例如在视野中跟踪用户的运动的系统中。 一个传感器可以针对较短的范围检测进行优化，另一个传感器可针对较长距离检测进行优化。 传感器可以具有与照明器不同的基准距离，以及不同的空间分辨率，曝光时间和灵敏度。 在一种方法中，通过匹配结构化光图案从每个传感器获得深度值，并且将深度值合并以获得作为应用的输入提供的最终深度图。 合并可以涉及未加权平均，加权平均，准确性度量和/或置信度度量。 在另一种方法中，使用传感器的像素数据中的立体匹配来获得包括在合并中的附加深度值。

公开(公告)号：US20110234756A1

公开(公告)日：2011-09-29

申请号：US12732918

申请日：2010-03-26

Applicant: Avishai Adler ,  Sagi Katz ,  Guy Gilboa ,  John Tardif

Inventor： Avishai Adler ,  Sagi Katz ,  Guy Gilboa ,  John Tardif

IPC: H04N13/02 ,  G06K9/00

CPC classification number: G06T5/002 ,  G06T2207/10028

Abstract: Techniques are provided for de-aliasing depth images. The depth image may have been generated based on phase differences between a transmitted and received modulated light beam. A method may include accessing a depth image that has a depth value for a plurality of locations in the depth image. Each location has one or more neighbor locations. Potential depth values are determined for each of the plurality of locations based on the depth value in the depth image for the location and potential aliasing in the depth image. A cost function is determined based on differences between the potential depth values of each location and its neighboring locations. Determining the cost function includes assigning a higher cost for greater differences in potential depth values between neighboring locations. The cost function is substantially minimized to select one of the potential depth values for each of the locations.

Abstract translation: 提供了去锯齿深度图像的技术。 可以基于发送和接收的调制光束之间的相位差来生成深度图像。 一种方法可以包括访问具有深度图像中的多个位置的深度值的深度图像。 每个位置都有一个或多个邻居位置。 基于深度图像中的深度图像中的深度值和深度图像中的潜在混叠，为每个多个位置确定潜在深度值。 基于每个位置的潜在深度值与其相邻位置之间的差异来确定成本函数。 确定成本函数包括为相邻位置之间的潜在深度值的更大差异分配更高的成本。 成本函数基本上被最小化以选择每个位置的潜在深度值之一。