公开(公告)号：US20050180657A1

公开(公告)日：2005-08-18

申请号：US11108545

申请日：2005-04-18

申请人： Zhengyou Zhang ,  Zicheng Liu ,  Ying Shan

发明人： Zhengyou Zhang ,  Zicheng Liu ,  Ying Shan

IPC分类号： G06T11/00 ,  G06T15/20 ,  G06K9/00

CPC分类号： G06T15/04 ,  G06T11/001

摘要： A system and method, called Image-Based Surface Detail Transfer, to transfer geometric details from one surface of an object in an image to another with simple 2D image operations. The basic observation is that, without knowing its 3D geometry, geometric details (local deformations) can be extracted from a single image of an object in a way independent of its surface reflectance, and furthermore, these geometric details can be transferred to modify the appearance of other objects directly in images. Examples are shown including surface detail transfer between real objects, as well as between real and synthesized objects.

摘要翻译： 一种称为基于图像的表面细节传输的系统和方法，通过简单的2D图像操作将图像中的对象的一个​​表面的几何细节传输到另一个。 基本的观察是，在不知道其3D几何形状的情况下，可以以独立于其表面反射率的方式从对象的单个图像中提取几何细节（局部变形），此外，这些几何细节可以被转移以修改外观 的其他对象直接在图像。 示例的实例包括真实对象之间的表面细节传递，以及真实对象和合成对象之间的表面细节传递。

公开(公告)号：US08031967B2

公开(公告)日：2011-10-04

申请号：US11765029

申请日：2007-06-19

申请人： Cha Zhang ,  Zhengyou Zhang ,  Zicheng Liu

发明人： Cha Zhang ,  Zhengyou Zhang ,  Zicheng Liu

IPC分类号： G06K9/40

CPC分类号： G06T5/002 ,  G06T2207/10016 ,  H04N5/14 ,  H04N5/21

摘要： A video noise reduction technique is presented. Generally, the technique involves first decomposing each frame of the video into low-pass and high-pass frequency components. Then, for each frame of the video after the first frame, an estimate of a noise variance in the high pass component is obtained. The noise in the high pass component of each pixel of each frame is reduced using the noise variance estimate obtained for the frame under consideration, whenever there has been no substantial motion exhibited by the pixel since the last previous frame. Evidence of motion is determined by analyzing the high and low pass components.

摘要翻译： 提出了一种视频降噪技术。 通常，该技术首先将视频的每帧分解为低通和高通频率分量。 然后，对于第一帧之后的视频的每帧，获得高通分量中的噪声方差的估计。 每当从最后一帧起就没有像素所呈现的实质运动时，使用针对所考虑的帧获得的噪声方差估计，减少每帧的每个像素的高通分量中的噪声。 通过分析高通和低通分量来确定运动的证据。

公开(公告)号：US07840638B2

公开(公告)日：2010-11-23

申请号：US12147603

申请日：2008-06-27

申请人： Zhengyou Zhang ,  Xuedong David Huang ,  Zicheng Liu ,  Cha Zhang ,  Philip A. Chou ,  Christian Huitema

发明人： Zhengyou Zhang ,  Xuedong David Huang ,  Zicheng Liu ,  Cha Zhang ,  Philip A. Chou ,  Christian Huitema

IPC分类号： G06F15/16 ,  G06F12/00

CPC分类号： H04N7/142 ,  H04M3/567 ,  H04N7/147 ,  H04N7/15

摘要： A multimedia conference technique is disclosed that allows physically remote users to participate in an immersive telecollaborative environment by synchronizing multiple data, images and sounds. The multimedia conference implementation provides users with the perception of being in the same room visually as well as acoustically according to an orientation plan which reflects each remote user's position within the multimedia conference environment.

摘要翻译： 公开了一种多媒体会议技术，其允许物理上的远程用户通过同步多个数据，图像和声音来参与沉浸式的电视解码环境。 多媒体会议实现为用户提供了根据反映每个远程用户在多媒体会议环境中的位置的方向计划在视觉上和声学上在同一房间中的感觉。

公开(公告)号：US20090327418A1

公开(公告)日：2009-12-31

申请号：US12147603

申请日：2008-06-27

申请人： Zhengyou Zhang ,  Xuedong David Huang ,  Zicheng Liu ,  Cha Zhang ,  Philip A. Chou ,  Christian Huitema

发明人： Zhengyou Zhang ,  Xuedong David Huang ,  Zicheng Liu ,  Cha Zhang ,  Philip A. Chou ,  Christian Huitema

IPC分类号： G06F15/16

CPC分类号： H04N7/142 ,  H04M3/567 ,  H04N7/147 ,  H04N7/15

摘要： A multimedia conference technique is disclosed that allows physically remote users to participate in an immersive telecollaborative environment by synchronizing multiple data, images and sounds. The multimedia conference implementation provides users with the perception of being in the same room visually as well as acoustically according to an orientation plan which reflects each remote user's position within the multimedia conference environment.

摘要翻译： 公开了一种多媒体会议技术，其允许物理上的远程用户通过同步多个数据，图像和声音来参与沉浸式的电视解码环境。 多媒体会议实现为用户提供了根据反映每个远程用户在多媒体会议环境中的位置的方向计划在视觉上和声学上在同一房间中的感觉。

公开(公告)号：US20120281059A1

公开(公告)日：2012-11-08

申请号：US13100504

申请日：2011-05-04

申请人： Philip A. Chou ,  Zhengyou Zhang ,  Cha Zhang ,  Dinei A. Florencio ,  Zicheng Liu ,  Rajesh K. Hegde ,  Nirupama Chandrasekaran

发明人： Philip A. Chou ,  Zhengyou Zhang ,  Cha Zhang ,  Dinei A. Florencio ,  Zicheng Liu ,  Rajesh K. Hegde ,  Nirupama Chandrasekaran

IPC分类号： H04N7/15

CPC分类号： H04L12/1827 ,  H04N7/147 ,  H04N7/157

摘要： The subject disclosure is directed towards an immersive conference, in which participants in separate locations are brought together into a common virtual environment (scene), such that they appear to each other to be in a common space, with geometry, appearance, and real-time natural interaction (e.g., gestures) preserved. In one aspect, depth data and video data are processed to place remote participants in the common scene from the first person point of view of a local participant. Sound data may be spatially controlled, and parallax computed to provide a realistic experience. The scene may be augmented with various data, videos and other effects/animations.

摘要翻译： 本发明涉及一种身临其境的会议，其中分开的位置的参与者被聚集到一个共同的虚拟环境（场景）中，使得它们彼此看起来处于共同的空间中，具有几何，外观和实时性， 保留时间自然的相互作用（如手势）。 在一个方面，深度数据和视频数据被处理以将远程参与者从本地参与者的第一人的角度放置在公共场景中。 声音数据可以是空间控制的，并且计算视差以提供真实的体验。 场景可能会增加各种数据，视频和其他效果/动画。

公开(公告)号：US08175382B2

公开(公告)日：2012-05-08

申请号：US11801620

申请日：2007-05-10

申请人： Zicheng Liu ,  Cha Zhang ,  Zhengyou Zhang

发明人： Zicheng Liu ,  Cha Zhang ,  Zhengyou Zhang

IPC分类号： G06K9/00

CPC分类号： G06K9/00234 ,  H04N1/62 ,  H04N1/628

摘要： Image enhancement techniques are described to enhance an image in accordance with a set of training images. In an implementation, an image color tone map is generated for a facial region included in an image. The image color tone map may be normalized to a color tone map for a set of training images so that the image color tone map matches the map for the training images. The normalized color tone map may be applied to the image to enhance the in-question image. In further implementations, the procedure may be updated when the average color intensity in non-facial regions differs from an accumulated mean by a threshold amount.

摘要翻译： 描述图像增强技术以根据一组训练图像来增强图像。 在实现中，为包括在图像中的面部区域生成图像色调映射。 图像色调图可以被归一化为用于一组训练图像的色调图，使得图像色调图匹配训练图像的图。 归一化色调图可以应用于图像以增强问题图像。 在进一步的实施中，当非面部区域中的平均颜色强度与积累的平均值不同阈值量时，可以更新该过程。

公开(公告)号：US20100085416A1

公开(公告)日：2010-04-08

申请号：US12245774

申请日：2008-10-06

申请人： Rajesh K. Hegde ,  Zhengyou Zhang ,  Philip A. Chou ,  Cha Zhang ,  Zicheng Liu ,  Sasa Junuzovic

发明人： Rajesh K. Hegde ,  Zhengyou Zhang ,  Philip A. Chou ,  Cha Zhang ,  Zicheng Liu ,  Sasa Junuzovic

IPC分类号： H04N7/14

CPC分类号： H04N7/157 ,  H04N7/147

摘要： Multi-device capture and spatial browsing of conferences is described. In one implementation, a system detects cameras and microphones, such as the webcams on participants' notebook computers, in a conference room, group meeting, or table game, and enlists an ad-hoc array of available devices to capture each participant and the spatial relationships between participants. A video stream composited from the array is browsable by a user to navigate a 3-dimensional representation of the meeting. Each participant may be represented by a video pane, a foreground object, or a 3-D geometric model of the participant's face or body displayed in spatial relation to the other participants in a 3-dimensional arrangement analogous to the spatial arrangement of the meeting. The system may automatically re-orient the 3-dimensional representation as needed to best show the currently interesting event such as current speaker or may extend navigation controls to a user for manually viewing selected participants or nuanced interactions between participants.

摘要翻译： 描述会议的多设备捕获和空间浏览。 在一个实现中，系统检测相机和麦克风，例如参与者的笔记本计算机上的网络摄像机，会议室，组会议或桌面游戏，并且招募可用设备的特设阵列以捕获每个参与者和空间 参与者之间的关系。 从阵列合成的视频流可由用户浏览以浏览会议的三维表示。 每个参与者可以以类似于会议的空间安排的三维布置的视频窗格，前景对象或与其他参与者以空间关系显示的三维几何模型来表示。 该系统可以根据需要自动重新定向三维表示，以最佳地显示当前有趣的事件，例如当前的扬声器，或者可以将导航控件扩展到用户，以便手动地观看选定的参与者或参与者之间微妙的交互。

公开(公告)号：US20080279467A1

公开(公告)日：2008-11-13

申请号：US11801620

申请日：2007-05-10

申请人： Zicheng Liu ,  Cha Zhang ,  Zhengyou Zhang

发明人： Zicheng Liu ,  Cha Zhang ,  Zhengyou Zhang

IPC分类号： G06K9/40

CPC分类号： G06K9/00234 ,  H04N1/62 ,  H04N1/628

摘要： Image enhancement techniques are described to enhance an image in accordance with a set of training images. In an implementation, an image color tone map is generated for a facial region included in an image. The image color tone map may be normalized to a color tone map for a set of training images so that the image color tone map matches the map for the training images. The normalized color tone map may be applied to the image to enhance the in-question image. In further implementations, the procedure may be updated when the average color intensity in non-facial regions differs from an accumulated mean by a threshold amount.

摘要翻译： 描述图像增强技术以根据一组训练图像来增强图像。 在实现中，为包括在图像中的面部区域生成图像色调映射。 图像色调图可以被归一化为用于一组训练图像的色调图，使得图像色调图匹配训练图像的图。 归一化色调图可以应用于图像以增强问题图像。 在进一步的实施中，当非面部区域中的平均颜色强度与积累的平均值不同阈值量时，可以更新该过程。

公开(公告)号：US08675067B2

公开(公告)日：2014-03-18

申请号：US13100504

申请日：2011-05-04

申请人： Philip A. Chou ,  Zhengyou Zhang ,  Cha Zhang ,  Dinei A. Florencio ,  Zicheng Liu ,  Rajesh K. Hegde ,  Nirupama Chandrasekaran

发明人： Philip A. Chou ,  Zhengyou Zhang ,  Cha Zhang ,  Dinei A. Florencio ,  Zicheng Liu ,  Rajesh K. Hegde ,  Nirupama Chandrasekaran

IPC分类号： H04N7/18

CPC分类号： H04L12/1827 ,  H04N7/147 ,  H04N7/157

摘要： The subject disclosure is directed towards an immersive conference, in which participants in separate locations are brought together into a common virtual environment (scene), such that they appear to each other to be in a common space, with geometry, appearance, and real-time natural interaction (e.g., gestures) preserved. In one aspect, depth data and video data are processed to place remote participants in the common scene from the first person point of view of a local participant. Sound data may be spatially controlled, and parallax computed to provide a realistic experience. The scene may be augmented with various data, videos and other effects/animations.

摘要翻译： 本发明涉及一种身临其境的会议，其中分开的位置的参与者被聚集到一个共同的虚拟环境（场景）中，使得它们彼此看起来处于共同的空间中，具有几何，外观和实时性， 保留时间自然的相互作用（如手势）。 在一个方面，深度数据和视频数据被处理以将远程参与者从本地参与者的第一人的角度放置在公共场景中。 声音数据可以是空间控制的，并且计算视差以提供真实的体验。 场景可能会增加各种数据，视频和其他效果/动画。

公开(公告)号：US08537196B2

公开(公告)日：2013-09-17

申请号：US12245774

申请日：2008-10-06

申请人： Rajesh K. Hegde ,  Zhengyou Zhang ,  Philip A. Chou ,  Cha Zhang ,  Zicheng Liu ,  Sasa Junuzovic

发明人： Rajesh K. Hegde ,  Zhengyou Zhang ,  Philip A. Chou ,  Cha Zhang ,  Zicheng Liu ,  Sasa Junuzovic

IPC分类号： H04N7/14 ,  G06F15/16 ,  G06F3/48

CPC分类号： H04N7/157 ,  H04N7/147

摘要： Multi-device capture and spatial browsing of conferences is described. In one implementation, a system detects cameras and microphones, such as the webcams on participants' notebook computers, in a conference room, group meeting, or table game, and enlists an ad-hoc array of available devices to capture each participant and the spatial relationships between participants. A video stream composited from the array is browsable by a user to navigate a 3-dimensional representation of the meeting. Each participant may be represented by a video pane, a foreground object, or a 3-D geometric model of the participant's face or body displayed in spatial relation to the other participants in a 3-dimensional arrangement analogous to the spatial arrangement of the meeting. The system may automatically re-orient the 3-dimensional representation as needed to best show the currently interesting event such as current speaker or may extend navigation controls to a user for manually viewing selected participants or nuanced interactions between participants.

摘要翻译： 描述会议的多设备捕获和空间浏览。 在一个实现中，系统检测相机和麦克风，例如参与者的笔记本计算机上的网络摄像机，会议室，组会议或桌面游戏，并且招募可用设备的特设阵列以捕获每个参与者和空间 参与者之间的关系。 从阵列合成的视频流可由用户浏览以浏览会议的三维表示。 每个参与者可以以类似于会议的空间安排的三维布置的视频窗格，前景对象或与其他参与者以空间关系显示的三维几何模型来表示。 该系统可以根据需要自动重新定向三维表示，以最佳地显示当前有趣的事件，例如当前的扬声器，或者可以将导航控件扩展到用户，以便手动地观看选定的参与者或参与者之间微妙的交互。