公开(公告)号：US20050024324A1

公开(公告)日：2005-02-03

申请号：US10750452

申请日：2003-12-30

申请人： Carlo Tomasi ,  Abbas Rafii

发明人： Carlo Tomasi ,  Abbas Rafii

IPC分类号： G06F1/16 ,  G06F3/00 ,  G06F3/01 ,  G06F3/02 ,  G06F3/033 ,  G06F3/042 ,  G09G5/00

CPC分类号： G06F3/011 ,  G06F1/1613 ,  G06F1/1626 ,  G06F1/1632 ,  G06F1/1673 ,  G06F3/0221 ,  G06F3/0423 ,  G06F3/0426 ,  G06F3/04886 ,  G06K9/224

摘要： A system used with a virtual device inputs or transfers information to a companion device, and includes two optical systems OS1, OS2. In a structured-light embodiment, OS1 emits a fan beam plane of optical energy parallel to and above the virtual device. When a user-object penetrates the beam plane of interest, OS2 registers the event. Triangulation methods can locate the virtual contact, and transfer user-intended information to the companion system. In a non-structured active light embodiment, OS1 is preferably a digital camera whose field of view defines the plane of interest, which is illuminated by an active source of optical energy. Preferably the active source, OS1, and OS2 operate synchronously to reduce effects of ambient light. A non-structured passive light embodiment is similar except the source of optical energy is ambient light. A subtraction technique preferably enhances the signal/noise ratio. The companion device may in fact house the present invention.

摘要翻译： 与虚拟设备一起使用的系统将信息输入或传送到配套设备，并且包括两个光学系统OS1，OS2。 在结构化光实施例中，OS1发射平行于虚拟设备并且在虚拟设备之上的光能的扇形光束平面。 当用户对象穿透感兴趣的光束平面时，OS2会注册该事件。 三角测量方法可以定位虚拟联系人，并将用户意图的信息传输到配套系统。 在非结构化主动光实施例中，OS1优选地是其视场限定感兴趣平面的数字照相机，其由有效的光能源照亮。 优选地，有源源OS1和OS2同步地操作以减少环境光的影响。 非结构化无源光实施例是类似的，除了光能源是环境光。 减法技术优选地增强信噪比。 伴侣装置实际上可以容纳本发明。

公开(公告)号：US07526120B2

公开(公告)日：2009-04-28

申请号：US10660907

申请日：2003-09-11

申请人： Salih Burak Gokturk ,  Cyrus Bamji ,  Abbas Rafii ,  Carlo Tomasi ,  Xinqiao Liu

发明人： Salih Burak Gokturk ,  Cyrus Bamji ,  Abbas Rafii ,  Carlo Tomasi ,  Xinqiao Liu

IPC分类号： G06K9/00

CPC分类号： B60R21/01516 ,  B60R21/013 ,  B60R21/0152 ,  B60R21/01538 ,  G06K9/00362

摘要： A sensor system is provided for determining a deployment level of an airbag in a vehicle. A light source of the sensor system emits light onto a region around a vehicle seat. An array of light-sensitive pixels which capture reflected light from the scene, including reflected light that originated from the light source. Processing resources are provided that determine depth information for an object in the scene based on a time-of-flight characteristic of the reflected light from the light source captured on the array. The processing resources may be configured to determine occupancy data for the object based on the captured reflected light from the scene. The processing resources are configured to determine the deployment level of the airbag based at least in part on the occupancy data in when a collision of the vehicle occurs.

摘要翻译： 提供用于确定车辆中的气囊的展开水平的传感器系统。 传感器系统的光源将光发射到车辆座椅周围的区域。 捕获来自场景的反射光的光敏像素阵列，包括源自光源的反射光。 提供处理资源，其基于来自在阵列上捕获的光源的反射光的飞行时间特性来确定场景中的对象的深度信息。 处理资源可以被配置为基于来自场景的所捕获的反射光来确定对象的占用数据。 处理资源被配置为至少部分地基于当车辆碰撞发生时的占用数据来确定安全气囊的部署水平。

公开(公告)号：US10242255B2

公开(公告)日：2019-03-26

申请号：US12074443

申请日：2008-03-04

申请人： Abbas Rafii ,  Salih Burak Gokturk ,  Carlo Tomasi ,  Fahri Sürücü

发明人： Abbas Rafii ,  Salih Burak Gokturk ,  Carlo Tomasi ,  Fahri Sürücü

IPC分类号： G06K9/00 ,  G06F3/01 ,  H04N21/4223 ,  H04N21/442

摘要： Acquired three-dimensional positional information is used to identify user created gesture(s), which gesture(s) are classified to determine appropriate input(s) to an associated electronic device or devices. Preferably at at least one instance of a time interval, the posture of a portion of a user is recognized, based at least one factor such as shape, position, orientation, velocity. Posture over each of the instance(s) is recognized as a combined gesture. Because acquired information is three-dimensional, two gestures may occur simultaneously.

公开(公告)号：US20110291926A1

公开(公告)日：2011-12-01

申请号：US12074443

申请日：2008-03-04

申请人： Salih Burak Gokturk ,  Carlo Tomasi ,  Fahri Surucu ,  Abbas Rafii

发明人： Salih Burak Gokturk ,  Carlo Tomasi ,  Fahri Surucu ,  Abbas Rafii

IPC分类号： G06F3/033 ,  G06K9/66

CPC分类号： G06K9/00389 ,  A63F2300/1093 ,  G06F3/017 ,  G06K9/00382 ,  H04N21/4223 ,  H04N21/44218

摘要： Acquired three-dimensional positional information is used to identify user created gesture(s), which gesture(s) are classified to determine appropriate input(s) to an associated electronic device or devices. Preferably at at least one instance of a time interval, the posture of a portion of a user is recognized, based at least one factor such as shape, position, orientation, velocity. Posture over each of the instance(s) is recognized as a combined gesture. Because acquired information is three-dimensional, two gestures may occur simultaneously.

摘要翻译： 获取的三维位置信息用于识别用户创建的手势，哪些手势被分类以确定与相关联的电子设备或设备的适当输入。 优选地，在至少一个时间间隔的情况下，基于形状，位置，取向，速度等至少一个因素来识别用户的一部分的姿势。 每个实例的姿势被识别为组合手势。 因为获取的信息是三维的，所以可能同时发生两个手势。

公开(公告)号：US07340077B2

公开(公告)日：2008-03-04

申请号：US10369999

申请日：2003-02-18

申请人： Salih Burak Gokturk ,  Carlo Tomasi ,  Fahri Sürücü ,  Abbas Rafii

发明人： Salih Burak Gokturk ,  Carlo Tomasi ,  Fahri Sürücü ,  Abbas Rafii

IPC分类号： G06K9/00

CPC分类号： G06F3/017 ,  A63F2300/1093 ,  G06K9/00335 ,  G06K9/00362 ,  G06K9/00382 ,  H04L2012/2841

摘要： Three-dimensional position information is used to identify the gesture created by a body part of interest. At one or more instances of an interval, the posture of a body part is recognized, based on the shape of the body part and its position and orientation. The posture of the body part over each of the one or more instances in the interval are recognized as a combined gesture. The gesture is classified for determining an input into a related electronic device.

摘要翻译： 三维位置信息用于识别由感兴趣的身体部分创建的手势。 在间隔的一个或多个情况下，基于身体部位的形状及其位置和取向来识别身体部位的姿势。 在该间隔中的一个或多个实例中的每一个上的身体部位的姿势被识别为组合手势。 手势被分类以确定相关电子设备的输入。

公开(公告)号：US06710770B2

公开(公告)日：2004-03-23

申请号：US09948508

申请日：2001-09-07

申请人： Carlo Tomasi ,  Abbas Rafii

发明人： Carlo Tomasi ,  Abbas Rafii

IPC分类号： G09G500

CPC分类号： G06F3/011 ,  G06F1/1613 ,  G06F1/1626 ,  G06F1/1632 ,  G06F1/1673 ,  G06F3/0221 ,  G06F3/0423 ,  G06F3/0426 ,  G06F3/04886 ,  G06K9/224

摘要： A system used with a virtual device inputs or transfers information to a companion device, and includes two optical systems OS1, OS2. In a structured-light embodiment, OS1 emits a fan beam plane of optical energy parallel to and above the virtual device. When a user-object penetrates the beam plane of interest, OS2 registers the event. Triangulation methods can locate the virtual contact, and transfer user-intended information to the companion system. In a non-structured active light embodiment, OS1 is preferably a digital camera whose field of view defines the plane of interest, which is illuminated by an active source of optical energy. Preferably the active source, OS1, and OS2 operate synchronously to reduce effects of ambient light. A non-structured passive light embodiment is similar except the source of optical energy is ambient light. A subtraction technique preferably enhances the signal/noise ratio. The companion device may in fact house the present invention.

摘要翻译： 与虚拟设备一起使用的系统将信息输入或传送到配套设备，并且包括两个光学系统OS1，OS2。 在结构化光实施例中，OS1发射平行于虚拟设备并且在虚拟设备之上的光能的扇形光束平面。 当用户对象穿透感兴趣的光束平面时，OS2会注册该事件。 三角测量方法可以定位虚拟联系人，并将用户意图的信息传输到配套系统。 在非结构化主动光实施例中，OS2优选为数字照相机; 其视场定义了由有源光能源照明的感兴趣平面。 优选地，有源源OS1和OS2同步地操作以减少环境光的影响。 非结构化无源光实施例是类似的，除了光能源是环境光。 减法技术优选地增强信噪比。 伴侣装置实际上可以容纳本发明。

公开(公告)号：US09325973B1

公开(公告)日：2016-04-26

申请号：US14788795

申请日：2015-07-01

申请人： Aryan Hazeghi ,  Carlo Dal Mutto ,  Abbas Rafii ,  David Demirdjian

发明人： Aryan Hazeghi ,  Carlo Dal Mutto ,  Abbas Rafii ,  David Demirdjian

IPC分类号： H04N13/02 ,  G06K9/00

CPC分类号： H04N13/271 ,  G01B11/2513 ,  G01B11/2545 ,  G02B27/4227 ,  G02B27/4272 ,  G06K9/00335 ,  G06K9/00375 ,  G06K9/2036 ,  G06T7/521 ,  G06T2207/10028 ,  H04N5/332 ,  H04N13/239 ,  H04N13/254 ,  H04N13/296

摘要： Dynamic projection of at least first and second patterns contributes detectable disparity onto a scene that includes a target object. The scene is imaged with two-dimensional cameras whose acquired imagery includes disparity contributions whose presence enable a three-dimensional reconstruction depth map to be rapidly and accurately generated. In one embodiment coherent light is input to a first DOE within whose near range output is disposed a second DOE, whose far range output projects an image. Electronically varying effective optical distance between the two DOEs varies the pattern projected from the second DOE. A processor system and algorithms enable dynamic intelligent selection of projected patterns to more readily discern target object characteristics: shape, size, velocity. Patterns can implement spatio-temporal depth reconstruction, spatio-temporal depth reconstruction, and even single-camera spatio-temporal light coding reconstruction. Target objects may be scanned or may make gestures that are rapidly detected and recognized by the system and method.

公开(公告)号：US08134637B2

公开(公告)日：2012-03-13

申请号：US11444947

申请日：2006-06-01

申请人： Christopher J. Rossbach ,  Abbas Rafii ,  Peiqian Zhao

发明人： Christopher J. Rossbach ,  Abbas Rafii ,  Peiqian Zhao

IPC分类号： G03B13/00 ,  H04N9/07 ,  H04N5/225 ,  H04N13/02 ,  G01C3/08

CPC分类号： H04N9/045 ,  G01S17/89 ,  G01S17/936 ,  H04N5/2355 ,  H04N13/128

摘要： An imaging system substantially simultaneously acquires z-depth and brightness data from first sensors, and acquires higher resolution RGB data from second sensors, and fuses data from the first and second sensors to model an RGBZ image whose resolution can be as high as resolution of the second sensors. Time correlation of captured data from first and second sensors is associated with captured image data, which permits arbitrary mapping between the two data sources, ranging from 1:many to many:1. Preferably pixels from each set of sensors that image the same target point are mapped. Many z-depth sensor settings may be used to create a static environmental model. Non-correlative and correlative filtering is carried out, and up-sampling to increase z-resolution occurs, from which a three-dimensional model is constructed using registration and calibration data.

摘要翻译： 成像系统基本上同时从第一传感器获取z深度和亮度数据，并且从第二传感器获取更高分辨率的RGB数据，并且将来自第一和第二传感器的数据融合以对分辨率可以高达分辨率的RGBZ图像进行建模 第二传感器。 来自第一和第二传感器的捕获数据的时间相关性与捕获的图像数据相关联，其允许两个数据源之间的任意映射，范围从1：多到多：1。 优选地对映射相同目标点的每组传感器的像素进行映射。 许多z深度传感器设置可用于创建静态环境模型。 进行非相关和相关滤波，并且发生上采样以增加z分辨率，使用配准和校准数据构建三维模型。

公开(公告)号：US07741961B1

公开(公告)日：2010-06-22

申请号：US11906046

申请日：2007-09-28

申请人： Abbas Rafii ,  Colin Tracey ,  Stephen Charles Hsu

发明人： Abbas Rafii ,  Colin Tracey ,  Stephen Charles Hsu

IPC分类号： B60Q1/00

CPC分类号： B60Q9/008 ,  B60Q9/005 ,  B60R1/00 ,  B60R2300/107 ,  B60R2300/301 ,  B60R2300/305 ,  B60R2300/307 ,  B60R2300/70 ,  B60R2300/8093 ,  G06T7/20 ,  G06T7/70 ,  G06T2207/30252

摘要： An obstacle detection and tracking system identifies objects in the path of a vehicle equipped with the system and issues a visual, audible, and/or control system warning. The system includes a depth imaging system that acquires depth data from objects in the field of view of a detection zone encompassing at least a portion of the road to be driven upon. It is assumed most of the acquired data represents road plane information. Statistical analysis of the depth image data identifies in (X,Y,Z) space at least one plane of the road being driven, after which identification threshold normal heights above and below the road plane are defined. Imaged objects within the detection zone that are higher or lower than a threshold normal are deemed of potential concern and will generate a warning to the vehicle operator or vehicle.

摘要翻译： 障碍物检测和跟踪系统识别配备有系统的车辆的路径中的物体，并发出视觉，听觉和/或控制系统警告。 该系统包括深度成像系统，该深度成像系统从包含要驱动的道路的至少一部分的检测区域的视场中获取来自物体的深度数据。 假设所获取的大部分数据表示道路平面信息。 深度图像数据的统计分析在（X，Y，Z）空间中识别正在被驱动的道路的至少一个平面，之后定义道路平面上方和下方的识别阈值正常高度。 高于或低于阈值正常的检测区内的成像物体被认为是潜在的关注点，并且将向车辆操作者或车辆产生警告。

公开(公告)号：US07379100B2

公开(公告)日：2008-05-27

申请号：US11058028

申请日：2005-02-14

申请人： Salih Burak Gokturk ,  Abbas Rafii

发明人： Salih Burak Gokturk ,  Abbas Rafii

IPC分类号： H04N5/235

CPC分类号： G01S17/89 ,  G01S7/4865 ,  G01S7/4868 ,  G01S7/487 ,  G01S17/10 ,  H04N5/2355

摘要： Dynamic range of photodetector sensors useable in a TOF system is enhanced by capturing images of an object using multiple exposure time settings. Longer exposure settings more appropriately capture non-reflective and/or distant objects, while shorter exposure settings more appropriately capture reflective and/or closer objects. During parallel mode operation, detection signal readouts are taken from each photodetector at different time intervals within an overall exposure time. In sequential mode operation, detection signal readouts are taken and stored for each photodetector at the end of a first exposure time interval and the photodetectors are reset. After a second, different exposure time interval readouts are taken and stored, and the photodetectors reset, etc. In these modes one of the time exposure intervals will be relatively optimum for enhanced dynamic range operation. Once images with multiple exposure settings are obtained, best effort brightness and range images can be obtained, and motion artifacts can be reduced.

摘要翻译： 在TOF系统中可用的光电检测器传感器的动态范围通过使用多个曝光时间设置捕获物体的图像来增强。 较长的曝光设置更适当地捕获非反射和/或远距离的物体，而较短的曝光设置更适当地捕获反射和/或更近的物体。 在并行模式操作期间，在整个曝光时间内以不同的时间间隔从每个光电检测器获取检测信号读出。 在顺序模式操作中，在第一曝光时间间隔结束时对每个光电检测器采集和存储检测信号读出，并且光电检测器被复位。 一秒钟后，拍摄和存储不同的曝光时间间隔读数，并且光电探测器复位等。在这些模式中，对于增强的动态范围操作，时间曝光间隔之一将是相对最佳的。 一旦获得具有多个曝光设置的图像，就可以获得尽力而为的亮度和范围图像，并且可以减少运动伪影。