公开(公告)号：US20100142801A1

公开(公告)日：2010-06-10

申请号：US12331419

申请日：2008-12-09

Applicant: Sanjeev Jagannath Koppal ,  Sing Bing Kang ,  Charles Lawrence Zitnick, III ,  Michael F. Cohen ,  Bryan Kent Ressler

Inventor： Sanjeev Jagannath Koppal ,  Sing Bing Kang ,  Charles Lawrence Zitnick, III ,  Michael F. Cohen ,  Bryan Kent Ressler

IPC: G06K9/00

CPC classification number: H04N13/10

Abstract: The stereo movie editing technique described herein combines knowledge of both multi-view stereo algorithms and human depth perception. The technique creates a digital editor, specifically for stereographic cinema. The technique employs an interface that allows intuitive manipulation of the different parameters in a stereo movie setup, such as camera locations and screen position. Using the technique it is possible to reduce or enhance well-known stereo movie effects such as cardboarding and miniaturization. The technique also provides new editing techniques such as directing the user's attention and easier transitions between scenes.

Abstract translation: 这里描述的立体声电影编辑技术结合了多视角立体声算法和人类深度感知的知识。 该技术创建了一个专门用于立体影院的数字编辑器。 该技术采用允许在立体声电影设置中的不同参数的直观操纵的界面，例如相机位置和屏幕位置。 使用该技术可以减少或增强诸如硬纸板和小型化的众所周知的立体电影效果。 该技术还提供了新的编辑技术，例如指导用户的注意力和更容易的场景之间的转换。

公开(公告)号：US07724952B2

公开(公告)日：2010-05-25

申请号：US11434567

申请日：2006-05-15

Applicant: Heung-Yeung Shum ,  Jian Sun ,  Sing Bing Kang ,  Yin Li

Inventor： Heung-Yeung Shum ,  Jian Sun ,  Sing Bing Kang ,  Yin Li

IPC: G06K9/34

CPC classification number: H04N5/275 ,  H04N5/2354

Abstract: Foreground object matting uses flash/no-flash images pairs to obtain a flash-only image. A trimap is obtained from the flash-only image. A joint Bayesian algorithm uses the flash-only image, the trimap and one of the image of the scene taken without the flash or the image of the scene taken with the flash to generate a high quality matte that can be used to extract the foreground from the background.

Abstract translation: 前景对象消光使用闪光/非闪光图像对来获取闪光灯图像。 从闪光灯图像获得一个微调。 联合贝叶斯算法使用仅闪光图像，微调和没有闪光灯拍摄的场景中的一个图像或用闪光灯拍摄的场景的图像，以生成可用于从 的背景。

公开(公告)号：US20100054595A1

公开(公告)日：2010-03-04

申请号：US12198136

申请日：2008-08-26

Applicant: Denis Demandolx ,  Sing Bing Kang

Inventor： Denis Demandolx ,  Sing Bing Kang

IPC: G06K9/54

CPC classification number: G06T3/60 ,  G06K9/3275 ,  G06K9/4604

Abstract: Tilt is reduced or eliminated in captured digital images. Edges in a first image are detected. Angles corresponding to the detected edges are determined. A dominant angle is selected from the determined angles. The first image is rotated according to the selected dominant angle to generate a second image. The second image is a de-tilted version of the first image.

Abstract translation: 捕获的数字图像中的倾斜减少或消除。 检测到第一幅图像中的边缘。 确定对应于检测到的边缘的角度。 从确定的角度中选择主角。 第一图像根据选择的主角旋转以产生第二图像。 第二个图像是第一个图像的倾斜版本。

公开(公告)号：US07639250B2

公开(公告)日：2009-12-29

申请号：US11554970

申请日：2006-10-31

Applicant: Ying-Qing Xu ,  Sing Bing Kang ,  Heung-Yeung Shum ,  Xuejin Chen

Inventor： Ying-Qing Xu ,  Sing Bing Kang ,  Heung-Yeung Shum ,  Xuejin Chen

IPC: G06T15/00

CPC classification number: G06T15/20 ,  G06T7/543 ,  G06T15/02 ,  G06T17/00 ,  G06T19/20 ,  G06T2200/08 ,  G06T2219/2012 ,  G06T2219/2021 ,  G06T2219/2024

Abstract: Systems and methods for sketching reality are described. In one aspect, a set of vector primitives is identified from a 2-D sketch. In one implementation, the 2-D sketch is hand-drawn by a user. A 2.5D geometry model is automatically generated from the vector primitives. The 2.5D geometry model is automatically rendered and presented to a user. In one implementation, the user provides 2-D sketch-based user inputs to modify one or more of lighting position, lighting direction, lighting intensity, texture, color, and geometry of the presentation.

Abstract translation: 描述了绘制现实的系统和方法。 在一个方面，从2-D草图识别一组矢量基元。 在一个实现中，2-D草图由用户手绘。 从矢量基元自动生成2.5D几何模型。 2.5D几何模型自动呈现给用户。 在一个实现中，用户提供基于2D草图的用户输入来修改演示的照明位置，照明方向，照明强度，纹理，颜色和几何形状中的一个或多个。

公开(公告)号：US20090290810A1

公开(公告)日：2009-11-26

申请号：US12124158

申请日：2008-05-21

Applicant: Sing Bing Kang ,  Jiading Gai

Inventor： Sing Bing Kang ,  Jiading Gai

IPC: G06K9/40

CPC classification number: G06T5/005 ,  G06T5/20 ,  G06T5/50 ,  G06T2207/10016 ,  G06T2207/10024 ,  G06T2207/20028 ,  G06T2207/20182 ,  H04N9/11

Abstract: Matte-based video restoration technique embodiments are presented which model spatio-temporally varying film wear artifacts found in digitized copies of film media. In general, this is accomplished by employing residual color information in recovering of artifact mattes. To this end, the distributions of artifact colors and their fractional contribution to each pixel of each frame being considered are extracted based on color information from the spatial and temporal neighborhoods of the pixel. The extracted information can then be used to restore the video by removing the artifacts.

Abstract translation: 提出了基于Matte的视频恢复技术实施例，其模型在电影媒体的数字化副本中发现的时空变化的电影磨损伪像。 一般来说，这是通过使用残余颜色信息来恢复伪像哑光来实现的。 为此，基于来自该像素的空间和时间邻域的颜色信息，提取伪像颜色的分布及其对所考虑的每帧的每个像素的分数贡献。 所提取的信息然后可以用于通过去除伪影来恢复视频。

公开(公告)号：US07599547B2

公开(公告)日：2009-10-06

申请号：US11289907

申请日：2005-11-30

Applicant: Jian Sun ,  Yin Li ,  Sing Bing Kang ,  Heung-Yeung Shum

Inventor： Jian Sun ,  Yin Li ,  Sing Bing Kang ,  Heung-Yeung Shum

IPC: G06K9/00 ,  G06T15/00 ,  G01C3/14

CPC classification number: G06K9/32

Abstract: The present symmetric stereo matching technique provides a method for iteratively estimating a minimum energy for occlusion and disparity using belief propagation. The minimum energy is based on an energy minimization framework in which a visibility constraint is embedded. By embedding the visibility constraint, the present symmetric stereo matching technique treats both images equally, instead of treating one as a reference image. The visibility constraint ensures that occlusion in one view and the disparity in another view are consistent.

Abstract translation: 本对称立体匹配技术提供了一种使用置信传播迭代估计遮挡和视差的最小能量的方法。 最小能量基于嵌入可见性约束的能量最小化框架。 通过嵌入可见度约束，本对称立体匹配技术可以平等对待两个图像，而不是将其视为参考图像。 可见性约束确保一个视图中的遮挡和另一个视图中的视差是一致的。

公开(公告)号：US07492927B2

公开(公告)日：2009-02-17

申请号：US10846308

申请日：2004-05-14

Applicant: Stephen Marschner ,  Brian K. Guenter ,  Sashi Raghupathy ,  Kirk Olynyk ,  Sing Bing Kang

Inventor： Stephen Marschner ,  Brian K. Guenter ,  Sashi Raghupathy ,  Kirk Olynyk ,  Sing Bing Kang

IPC: G06K9/00

CPC classification number: G06K9/4661 ,  G06K9/00268 ,  G06T7/521 ,  G06T15/506

Abstract: In the described embodiment, methods and systems for processing facial image data for use in animation are described. In one embodiment, a system is provided that illuminates a face with illumination that is sufficient to enable the simultaneous capture of both structure data, e.g. a range or depth map, and reflectance properties, e.g. the diffuse reflectance of a subject's face. This captured information can then be used for various facial animation operations, among which are included expression recognition and expression transformation.

Abstract translation: 在所描述的实施例中，描述了用于处理用于动画的面部图像数据的方法和系统。 在一个实施例中，提供了一种系统，其利用足以使得能够同时捕获结构数据的照明来照亮面部，例如， 范围或深度图，以及反射率特性，例如。 受试者面部的漫反射。 然后，该捕获的信息可以用于各种面部动画操作，其中包括表达式识别和表达变换。

公开(公告)号：US20080309660A1

公开(公告)日：2008-12-18

申请号：US11761604

申请日：2007-06-12

Applicant: Joe Bertolami ,  Robert M. Craig ,  Dax Hawkins ,  Sing Bing Kang ,  Jonathan E. Lange

Inventor： Joe Bertolami ,  Robert M. Craig ,  Dax Hawkins ,  Sing Bing Kang ,  Jonathan E. Lange

IPC: G06T15/00

CPC classification number: A63F13/525 ,  A63F13/10 ,  A63F2300/66 ,  G06T15/20 ,  H04N13/275

Abstract: Game data is rendered in three dimensions in the GPU of a game console. A left camera view and a right camera view are generated from a single camera view. The left and right camera positions are derived as an offset from a default camera. The focal distance of the left and right cameras is infinity. A game developer does not have to encode dual images into a specific hardware format. When a viewer sees the two slightly offset images, the user's brain combines the two offset images into a single 3D image to give the illusion that objects either pop out from or recede into the display screen. In another embodiment, individual, private video is rendered, on a single display screen, for different viewers. Rather than rendering two similar offset images, two completely different images are rendered allowing each player to view only one of the images.

Abstract translation: 游戏数据在游戏机的GPU中呈现三维。 从单个摄像机视图生成左侧摄像机视图和右侧摄像机视图。 左和右摄像机位置被派生为与默认摄像机的偏移量。 左右相机的焦距为无穷远。 游戏开发者不必将双重图像编码为特定的硬件格式。 当观众看到两个轻微偏移的图像时，用户的大脑将两个偏移图像组合成单个3D图像，以给出对象从显示屏幕中弹出或退回到显示屏幕的错觉。 在另一个实施例中，单独的专用视频在单个显示屏幕上被呈现给不同的观看者。 而不是渲染两个相似的偏移图像，渲染两个完全不同的图像，允许每个播放器仅查看其中一个图像。

公开(公告)号：US20080298712A1

公开(公告)日：2008-12-04

申请号：US11755661

申请日：2007-05-30

Applicant: Sing Bing Kang

Inventor： Sing Bing Kang

IPC: G06K9/40

CPC classification number: G06T5/004 ,  G06T2207/20192 ,  H04N5/23229 ,  H04N2201/00

Abstract: An image sharpening technique with halo suppression is presented. Generally, one implementation of this technique completely suppresses the haloing effect typically caused by image sharpening by restricting values to within the local minimum and maximum intensities of the unsharpened image. Thus, if the sharpened value is below the local minimum, it is replaced with the local minimum. Similarly, the local maximum is taken if the sharpened value exceeds it. In other implementations of the technique, haloing caused by image sharpening is suppressed but not completely eliminated, thereby producing a subtle haloing effect.

Abstract translation: 提出了具有光晕抑制的图像锐化技术。 通常，该技术的一个实现完全抑制通常通过将值限制在未钝化图像的局部最小和最大强度内的图像锐化引起的晕圈效应。 因此，如果锐化值低于局部最小值，则将其替换为局部最小值。 类似地，如果锐化值超过本地值，则采用局部最大值。 在该技术的其他实施方式中，由图像锐化引起的晕圈被抑制但不能完全消除，从而产生微妙的晕圈效应。

公开(公告)号：US07379583B2

公开(公告)日：2008-05-27

申请号：US11097529

申请日：2005-03-31

Applicant: Charles Zitnick, III ,  Sing Bing Kang ,  Matthew Uyttendaele ,  Simon Winder ,  Richard Szeliski

Inventor： Charles Zitnick, III ,  Sing Bing Kang ,  Matthew Uyttendaele ,  Simon Winder ,  Richard Szeliski

IPC: G06K9/00

CPC classification number: G06K9/20 ,  G06K2209/40 ,  G06T7/55

Abstract: A system and process for computing a 3D reconstruction of a scene from multiple images thereof, which is based on a color segmentation-based approach, is presented. First, each image is independently segmented. Second, an initial disparity space distribution (DSD) is computed for each segment, using the assumption that all pixels within a segment have the same disparity. Next, each segment's DSD is refined using neighboring segments and its projection into other images. The assumption that each segment has a single disparity is then relaxed during a disparity smoothing stage. The result is a disparity map for each image, which in turn can be used to compute a per pixel depth map if the reconstruction application calls for it.

Abstract translation: 提出了一种用于基于基于颜色分割的方法从其多个图像计算场景的3D重建的系统和过程。 首先，每个图像被独立地分割。 第二，使用假设一个段内的所有像素具有相同的视差来为每个段计算初始视差空间分布（DSD）。 接下来，每个段的DSD使用相邻段进行细化，并将其投影到其他图像中。 然后在视差平滑阶段放宽每个段具有单个视差的假设。 结果是每个图像的视差图，如果重建应用程序需要它，它又可以用于计算每像素深度图。