公开(公告)号：US08416302B2

公开(公告)日：2013-04-09

申请号：US12368831

申请日：2009-02-10

Applicant: Chunhui Zhang ,  Yasuyuki Matsushita ,  Yuan Kong ,  Zicheng Liu

Inventor： Chunhui Zhang ,  Yasuyuki Matsushita ,  Yuan Kong ,  Zicheng Liu

IPC: H04N5/33

CPC classification number: H04N5/33 ,  H04N5/2256 ,  H04N5/23219 ,  H04N5/332 ,  H04N9/045 ,  H04N9/735

Abstract: In some implementations, invisible light is emitted toward a subject being imaged in a low-light environment. A camera having a first color image sensor captures an image of the subject. Image processing is used to correct distortion in the image caused by the invisible light, and an augmented color image is output.

Abstract translation: 在一些实施方式中，向在低光环境中成像的被摄体发射不可见的光。 具有第一彩色图像传感器的照相机捕获被摄体的图像。 图像处理用于校正由不可见光引起的图像失真，并且输出增强的彩色图像。

公开(公告)号：US20100201823A1

公开(公告)日：2010-08-12

申请号：US12368831

申请日：2009-02-10

Applicant: Chunhui Zhang ,  Yasuyuki Matsushita ,  Yuan Kong ,  Zicheng Liu

Inventor： Chunhui Zhang ,  Yasuyuki Matsushita ,  Yuan Kong ,  Zicheng Liu

IPC: H04N5/44

CPC classification number: H04N5/33 ,  H04N5/2256 ,  H04N5/23219 ,  H04N5/332 ,  H04N9/045 ,  H04N9/735

Abstract: In some implementations, invisible light is emitted toward a subject being imaged in a low-light environment. A camera having a first color image sensor captures an image of the subject. Image processing is used to correct distortion in the image caused by the invisible light, and an augmented color image is output.

Abstract translation: 在一些实施方式中，向在低光环境中成像的被摄体发射不可见的光。 具有第一彩色图像传感器的照相机捕获被摄体的图像。 图像处理用于校正由不可见光引起的图像失真，并且输出增强的彩色图像。

公开(公告)号：US09055607B2

公开(公告)日：2015-06-09

申请号：US12323570

申请日：2008-11-26

Applicant: Michael J. Sinclair ,  Yuan Kong ,  Zhengyou Zhang ,  Behrooz Chitsaz ,  David W. Williams ,  Silviu-Petru Cucerzan ,  Zicheng Liu

Inventor： Michael J. Sinclair ,  Yuan Kong ,  Zhengyou Zhang ,  Behrooz Chitsaz ,  David W. Williams ,  Silviu-Petru Cucerzan ,  Zicheng Liu

IPC: H04M1/00 ,  H04W88/06 ,  H04M1/725 ,  H04W8/24 ,  H04W92/02 ,  H04W92/10

CPC classification number: H04W88/06 ,  H04M1/72572 ,  H04M2250/12 ,  H04M2250/58 ,  H04W8/245 ,  H04W92/02 ,  H04W92/10

Abstract: Multi-modal, multi-lingual devices can be employed to consolidate numerous items including, but not limited to, keys, remote controls, image capture devices, audio recorders, cellular telephone functionalities, location/direction detectors, health monitors, calendars, gaming devices, smart home inputs, pens, optical pointing devices or the like. For example, a corner of a cellular telephone can be used as an electronic pen. Moreover, the device can be used to snap multiple pictures stitching them together to create a panoramic image. A device can automate ignition of an automobile, initiate appliances, etc. based upon relative distance. The device can provide for near to eye capabilities for enhanced image viewing. Multiple cameras/sensors can be provided on a single device to provide for stereoscopic capabilities. The device can also provide assistance to blind, privacy, etc. by consolidating services.

Abstract translation: 可以使用多模式，多语言设备来整合许多项目，包括但不限于键，遥控器，图像捕获设备，音频记录器，蜂窝电话功能，位置/方向检测器，健康监视器，日历，游戏设备 智能家庭输入，笔，光学指向装置等。 例如，蜂窝电话的角落可以用作电子笔。 此外，该设备可以用于将多个图片拼接在一起以创建全景图像。 设备可以基于相对距离自动点火汽车，起动电器等。 该设备可以提供近眼睛的功能，以增强图像观看效果。 可以在单个设备上提供多个摄像机/传感器以提供立体能力。 该设备还可以通过整合服务来提供盲人，隐私等方面的帮助。

公开(公告)号：US07460884B2

公开(公告)日：2008-12-02

申请号：US11170545

申请日：2005-06-29

Applicant: Michael J. Sinclair ,  Yuan Kong ,  Zhengyou Zhang ,  Behrooz Chitsaz ,  David W. Williams ,  Silviu-Petru Cucerzan ,  Zicheng Liu

Inventor： Michael J. Sinclair ,  Yuan Kong ,  Zhengyou Zhang ,  Behrooz Chitsaz ,  David W. Williams ,  Silviu-Petru Cucerzan ,  Zicheng Liu

IPC: H04M1/00

CPC classification number: H04W88/06 ,  H04M1/72572 ,  H04M2250/12 ,  H04M2250/58 ,  H04W8/245 ,  H04W92/02 ,  H04W92/10

Abstract: Multi-modal, multi-lingual devices can be employed to consolidate numerous items including, but not limited to, keys, remote controls, image capture devices, audio recorders, cellular telephone functionalities, location/direction detectors, health monitors, calendars, gaming devices, smart home inputs, pens, optical pointing devices or the like. For example, a corner of a cellular telephone can be used as an electronic pen. Moreover, the device can be used to snap multiple pictures stitching them together to create a panoramic image. A device can automate ignition of an automobile, initiate appliances, etc. based upon relative distance. The device can provide for near to eye capabilities for enhanced image viewing. Multiple cameras/sensors can be provided on a single device to provide for stereoscopic capabilities. The device can also provide assistance to blind, privacy, etc. by consolidating services.

Abstract translation: 可以使用多模式，多语言设备来整合许多项目，包括但不限于键，遥控器，图像捕获设备，音频记录器，蜂窝电话功能，位置/方向检测器，健康监视器，日历，游戏设备 智能家庭输入，笔，光学指向装置等。 例如，蜂窝电话的角落可以用作电子笔。 此外，该设备可以用于将多个图片拼接在一起以创建全景图像。 设备可以基于相对距离自动点火汽车，起动电器等。 该设备可以提供近眼睛的功能，以增强图像观看效果。 可以在单个设备上提供多个摄像机/传感器以提供立体能力。 该设备还可以通过整合服务来提供盲人，隐私等方面的帮助。

公开(公告)号：US07991607B2

公开(公告)日：2011-08-02

申请号：US11167870

申请日：2005-06-27

Applicant: Zhengyou Zhang ,  David W. Williams ,  Yuan Kong ,  Zicheng Liu

Inventor： Zhengyou Zhang ,  David W. Williams ,  Yuan Kong ,  Zicheng Liu

IPC: G06F17/28

CPC classification number: G06F17/289 ,  G06K9/00335 ,  G06K9/6293 ,  G10L15/1822

Abstract: Architecture that combines capture and translation of concepts, goals, needs, locations, objects, locations, and items (e.g., sign text) into complete conversational utterances that take a translation of the item, and morph it with fluidity into sets of sentences that can be echoed to a user, and that the user can select to communicate speech (or textual utterances). A plurality of modalities that process images, audio, video, searches and cultural context, for example, which are representative of at least context and/or content, and can be employed to glean additional information regarding a communications exchange to facilitate more accurate and efficient translation. Gesture recognition can be utilized to enhance input recognition, urgency, and/or emotional interaction, for example. Speech can be used for document annotation. Moreover, translation (e.g., speech to speech, text to speech, speech to text, handwriting to speech, text or audio, . . . ) can be significantly improved in combination with this architecture.

Abstract translation: 将概念，目标，需求，位置，对象，位置和项目（例如，签名文本）的捕获和翻译结合到完整的对话话语中进行翻译的体系结构，并将其流畅地转换成可以组合的句子集 被回传给用户，并且用户可以选择通信语音（或文本话语）。 处理例如代表至少上下文和/或内容的图像，音频，视频，搜索和文化语境的多种模式，并且可以用于收集关于通信交换的附加信息以促进更准确和更有效率 翻译。 例如，手势识别可用于增强输入识别，紧急性和/或情感交互。 语音可用于文档注释。 此外，结合该架构，可以显着地改进翻译（例如，语音到语音，文本到语音，语音到文本，手写到语音，文本或音频等等）。

公开(公告)号：US20060293874A1

公开(公告)日：2006-12-28

申请号：US11167870

申请日：2005-06-27

Applicant: Zhengyou Zhang ,  David Williams ,  Yuan Kong ,  Zicheng Liu

Inventor： Zhengyou Zhang ,  David Williams ,  Yuan Kong ,  Zicheng Liu

IPC: G06F17/28

CPC classification number: G06F17/289 ,  G06K9/00335 ,  G06K9/6293 ,  G10L15/1822

Abstract: Architecture that combines capture and translation of concepts, goals, needs, locations, objects, locations, and items (e.g., sign text) into complete conversational utterances that take a translation of the item, and morph it with fluidity into sets of sentences that can be echoed to a user, and that the user can select to communicate speech (or textual utterances). A plurality of modalities that process images, audio, video, searches and cultural context, for example, which are representative of at least context and/or content, and can be employed to glean additional information regarding a communications exchange to facilitate more accurate and efficient translation. Gesture recognition can be utilized to enhance input recognition, urgency, and/or emotional interaction, for example. Speech can be used for document annotation. Moreover, translation (e.g., speech to speech, text to speech, speech to text, handwriting to speech, text or audio, . . . ) can be significantly improved in combination with this architecture.

Abstract translation: 将概念，目标，需求，位置，对象，位置和项目（例如，签名文本）的捕获和翻译结合到完整的对话话语中进行翻译的体系结构，并将其流畅地转换成可以组合的句子集 被回传给用户，并且用户可以选择通信语音（或文本话语）。 处理例如代表至少上下文和/或内容的图像，音频，视频，搜索和文化语境的多种模式，并且可以用于收集关于通信交换的附加信息以促进更准确和更有效率 翻译。 例如，手势识别可用于增强输入识别，紧急性和/或情感交互。 语音可用于文档注释。 此外，结合该架构，可以显着地改进翻译（例如，语音到语音，文本到语音，语音到文本，手写到语音，文本或音频等等）。

公开(公告)号：US20090075634A1

公开(公告)日：2009-03-19

申请号：US12323570

申请日：2008-11-26

Applicant: Michael J. Sinclair ,  Yuan Kong ,  Zhengyou Zhang ,  Behrooz Chitsaz ,  David W. Williams ,  Silviu-Petru Cucerzan ,  Zicheng Liu

Inventor： Michael J. Sinclair ,  Yuan Kong ,  Zhengyou Zhang ,  Behrooz Chitsaz ,  David W. Williams ,  Silviu-Petru Cucerzan ,  Zicheng Liu

IPC: H04M3/42

CPC classification number: H04W88/06 ,  H04M1/72572 ,  H04M2250/12 ,  H04M2250/58 ,  H04W8/245 ,  H04W92/02 ,  H04W92/10

Abstract: Multi-modal, multi-lingual devices can be employed to consolidate numerous items including, but not limited to, keys, remote controls, image capture devices, audio recorders, cellular telephone functionalities, location/direction detectors, health monitors, calendars, gaming devices, smart home inputs, pens, optical pointing devices or the like. For example, a corner of a cellular telephone can be used as an electronic pen. Moreover, the device can be used to snap multiple pictures stitching them together to create a panoramic image. A device can automate ignition of an automobile, initiate appliances, etc. based upon relative distance. The device can provide for near to eye capabilities for enhanced image viewing. Multiple cameras/sensors can be provided on a single device to provide for stereoscopic capabilities. The device can also provide assistance to blind, privacy, etc. by consolidating services.

Abstract translation: 可以使用多模式，多语言设备来整合许多项目，包括但不限于键，遥控器，图像捕获设备，音频记录器，蜂窝电话功能，位置/方向检测器，健康监视器，日历，游戏设备 智能家庭输入，笔，光学指向装置等。 例如，蜂窝电话的角落可以用作电子笔。 此外，该设备可以用于将多个图片拼接在一起以创建全景图像。 设备可以基于相对距离自动点火汽车，起动电器等。 该设备可以提供近眼睛的功能，以增强图像观看效果。 可以在单个设备上提供多个摄像机/传感器以提供立体能力。 该设备还可以通过整合服务来提供盲人，隐私等方面的帮助。

公开(公告)号：US20070015494A1

公开(公告)日：2007-01-18

申请号：US11170545

申请日：2005-06-29

Applicant: Michael Sinclair ,  Yuan Kong ,  Zhengyou Zhang ,  Behrooz Chitsaz ,  David Williams ,  Silviu-Petru Cucerzan ,  Zicheng Liu

Inventor： Michael Sinclair ,  Yuan Kong ,  Zhengyou Zhang ,  Behrooz Chitsaz ,  David Williams ,  Silviu-Petru Cucerzan ,  Zicheng Liu

IPC: H04Q7/38

CPC classification number: H04W88/06 ,  H04M1/72572 ,  H04M2250/12 ,  H04M2250/58 ,  H04W8/245 ,  H04W92/02 ,  H04W92/10

Abstract: Multi-modal, multi-lingual devices can be employed to consolidate numerous items including, but not limited to, keys, remote controls, image capture devices, audio recorders, cellular telephone functionalities, location/direction detectors, health monitors, calendars, gaming devices, smart home inputs, pens, optical pointing devices or the like. For example, a corner of a cellular telephone can be used as an electronic pen. Moreover, the device can be used to snap multiple pictures stitching them together to create a panoramic image. A device can automate ignition of an automobile, initiate appliances, etc. based upon relative distance. The device can provide for near to eye capabilities for enhanced image viewing. Multiple cameras/sensors can be provided on a single device to provide for stereoscopic capabilities. The device can also provide assistance to blind, privacy, etc. by consolidating services.

Abstract translation: 可以使用多模式，多语言设备来整合许多项目，包括但不限于键，遥控器，图像捕获设备，音频记录器，蜂窝电话功能，位置/方向检测器，健康监视器，日历，游戏设备 智能家庭输入，笔，光学指向装置等。 例如，蜂窝电话的角落可以用作电子笔。 此外，该设备可以用于将多个图片拼接在一起以创建全景图像。 设备可以基于相对距离自动点火汽车，起动电器等。 该设备可以提供近眼睛的功能，以增强图像观看效果。 可以在单个设备上提供多个摄像机/传感器以提供立体能力。 该设备还可以通过整合服务来提供盲人，隐私等方面的帮助。

公开(公告)号：US20070004969A1

公开(公告)日：2007-01-04

申请号：US11170525

申请日：2005-06-29

Applicant: Yuan Kong ,  David Kurlander ,  Silviu-Petru Cucerzan ,  Zhengyou Zhang ,  David Williams ,  Zicheng Liu ,  Michael Sinclair

Inventor： Yuan Kong ,  David Kurlander ,  Silviu-Petru Cucerzan ,  Zhengyou Zhang ,  David Williams ,  Zicheng Liu ,  Michael Sinclair

IPC: A61B5/00

CPC classification number: A61B5/0022 ,  A61B5/0013 ,  A61B5/0205 ,  A61B5/02438 ,  A61B5/1112 ,  A61B5/411 ,  A61B5/749 ,  A61B2560/0242 ,  G16H40/67

Abstract: A device and/or devices can be placed on an individual to continuously collect and/or transmit information regarding the health state of the individual. The monitor, for example, can transmit data to doctor(s), hospital(s), emergency personnel, as well as automatically initiate affirmative actions (e.g., call an ambulance). The invention can facilitate preventive medicine by monitoring the individual's day to day actions (e.g., eating habits, exercise, stress, sleep, allergy detection, heart rate, blood sugar). This monitored information can be employed to facilitate the individual in taking proactive steps to living a healthy life. The device can also be used to record a user reaction to an event and/or to broadcast information about oneself whether for health, business or social purposes. Additionally, the invention can be used as a driver monitor to facilitate safe handling of equipment (e.g., alcohol sensor).

Abstract translation: 设备和/或设备可以放置在个人身上以连续地收集和/或发送关于个人的健康状态的信息。 例如，监视器可以向医生，医院，急救人员传送数据，并自动启动肯定行动（例如呼叫救护车）。 本发明可以通过监测个体的日常作用（例如，饮食习惯，运动，压力，睡眠，过敏检测，心率，血糖）来促进预防医学。 这种监测的信息可以用于促进个人采取积极的步骤来维持健康的生活。 该设备还可以用于记录用户对事件的反应和/或广播关于自身的信息，无论是为了健康，商业或社会目的。 另外，本发明可以用作驱动器监视器以便于设备（例如酒精传感器）的安全处理。

公开(公告)号：US08079079B2

公开(公告)日：2011-12-13

申请号：US11171145

申请日：2005-06-29

Applicant: Zhengyou Zhang ,  David W. Williams ,  Yuan Kong ,  Zicheng Liu ,  David Kurlander ,  Mike Sinclair

Inventor： Zhengyou Zhang ,  David W. Williams ,  Yuan Kong ,  Zicheng Liu ,  David Kurlander ,  Mike Sinclair

IPC: G06F7/04 ,  G06F12/00 ,  G06F12/14 ,  G06F13/00 ,  G06F17/30 ,  G11C7/00

CPC classification number: H04L63/08 ,  G06F21/32 ,  G06K9/00885 ,  G06K9/6293 ,  H04L63/0861

Abstract: A multimodal system that employs a plurality of sensing modalities which can be processed concurrently to increase confidence in connection with authentication. The multimodal system and/or set of various devices can provide several points of information entry in connection with authentication. Authentication can be improved, for example, by combining face recognition, biometrics, speech recognition, handwriting recognition, gait recognition, retina scan, thumb/hand prints, or subsets thereof. Additionally, portable multimodal devices (e.g., a smartphone) can be used as credit cards, and authentication in connection with such use can mitigate unauthorized transactions.

Abstract translation: 采用多个感测模式的多模式系统，可以同时处理以增加与认证相关联的置信度。 多模式系统和/或各种设备的集合可以提供与认证相关联的多个信息点。 可以通过组合人脸识别，生物识别，语音识别，手写识别，步态识别，视网膜扫描，拇指/手印或其子集来改进认证。 此外，便携式多模式设备（例如，智能电话）可以用作信用卡，并且与此类使用相关的认证可以减轻未经授权的交易。