公开(公告)号：US20130100256A1

公开(公告)日：2013-04-25

申请号：US13278184

申请日：2011-10-21

Applicant: Adam G. Kirk ,  Yaron Eshet ,  Kestutis Patiejunas ,  Sing Bing Kang ,  Charles Lawrence Zitnick, III ,  David Eraker ,  Simon Winder

Inventor： Adam G. Kirk ,  Yaron Eshet ,  Kestutis Patiejunas ,  Sing Bing Kang ,  Charles Lawrence Zitnick, III ,  David Eraker ,  Simon Winder

IPC: H04N13/02

CPC classification number: G06T7/0057 ,  G06T7/521 ,  G06T7/593 ,  G06T2207/10048

Abstract: Methods and systems for generating a depth map are provided. The method includes projecting an infrared (IR) dot pattern onto a scene. The method also includes capturing stereo images from each of two or more synchronized IR cameras, detecting a number of dots within the stereo images, computing a number of feature descriptors for the dots in the stereo images, and computing a disparity map between the stereo images. The method further includes generating a depth map for the scene using the disparity map.

Abstract translation: 提供了生成深度图的方法和系统。 该方法包括将红外（IR）点图案投影到场景上。 该方法还包括从两个或多个同步红外相机中的每一个捕获立体图像，检测立体图像内的多个点，计算立体图像中的点的特征描述符的数量，以及计算立体图像之间的视差图 。 该方法还包括使用视差图生成场景的深度图。

公开(公告)号：US08428390B2

公开(公告)日：2013-04-23

申请号：US12815264

申请日：2010-06-14

Applicant: Yunpeng Li ,  Sing Bing Kang ,  Neel Suresh Joshi ,  Steven Maxwell Seitz

Inventor： Yunpeng Li ,  Sing Bing Kang ,  Neel Suresh Joshi ,  Steven Maxwell Seitz

IPC: G06K9/40 ,  G06K9/00 ,  G09G1/14 ,  G09G3/28 ,  G09G3/30 ,  G09G5/00 ,  H04N9/64 ,  H04N5/202 ,  H04N1/40 ,  G03F3/08

CPC classification number: H04N5/23238 ,  G06T5/003 ,  G06T2207/10016 ,  G06T2207/20201

Abstract: A “Blur Remover” provides various techniques for constructing deblurred images from a sequence of motion-blurred images such as a video sequence of a scene. Significantly, this deblurring is accomplished without requiring specialized side information or camera setups. In fact, the Blur Remover receives sequential images, such as a typical video stream captured using conventional digital video capture devices, and directly processes those images to generate or construct deblurred images for use in a variety of applications. No other input beyond the video stream is required for a variety of the embodiments enabled by the Blur Remover. More specifically, the Blur Remover uses joint global motion estimation and multi-frame deblurring with optional automatic video “duty cycle” estimation to construct deblurred images from video sequences for use in a variety of applications. Further, the automatically estimated video duty cycle is also separately usable in a variety of applications.

Abstract translation: “模糊去除”提供了用于从诸如场景的视频序列的运动模糊图像序列构建去模糊图像的各种技术。 重要的是，这种脱模是完成的，而不需要专门的信息或相机设置。 事实上，Blur Remover接收连续图像，例如使用常规数字视频捕获设备捕获的典型视频流，并直接处理这些图像以生成或构造用于各种应用的去模糊图像。 对于由Blur Remover启用的各种实施例，不需要视频流之外的其他输入。 更具体地，Blur Remover使用联合全局运动估计和多帧去模糊与可选的自动视频“占空比”估计来构建来自用于各种应用的视频序列的去模糊图像。 此外，自动估计的视频占空比也可以在各种应用中单独使用。

公开(公告)号：US08422788B2

公开(公告)日：2013-04-16

申请号：US12198136

申请日：2008-08-26

Applicant: Denis Demandolx ,  Sing Bing Kang

Inventor： Denis Demandolx ,  Sing Bing Kang

IPC: G06K9/00

CPC classification number: G06T3/60 ,  G06K9/3275 ,  G06K9/4604

Abstract: Tilt is reduced or eliminated in captured digital images. Edges in a first image are detected. Angles corresponding to the detected edges are determined. A dominant angle is selected from the determined angles. The first image is rotated according to the selected dominant angle to generate a second image. The second image is a de-tilted version of the first image.

公开(公告)号：US08417047B2

公开(公告)日：2013-04-09

申请号：US13037366

申请日：2011-03-01

Applicant: Priyam Chatterjee ,  Neel Joshi ,  Sing Bing Kang ,  Yasuyuki Matsushita

Inventor： Priyam Chatterjee ,  Neel Joshi ,  Sing Bing Kang ,  Yasuyuki Matsushita

IPC: G06K9/40 ,  H04N9/14

CPC classification number: G06T5/002 ,  G06T3/4015

Abstract: A low light noise reduction mechanism may perform denoising prior to demosaicing, and may also use parameters determined during the denoising operation for performing demosaicing. The denoising operation may attempt to find several patches of an image that are similar to a first patch, and use a weighted average based on similarity to determine an appropriate value for denoising a raw digital image. The same weighted average and similar patches may be used for demosaicing the same image after the denoising operation.

Abstract translation: 低光噪声降低机构可以在去马赛克之前执行去噪，并且还可以使用在去噪操作期间确定的用于执行去马赛克的参数。 去噪操作可以尝试找到类似于第一贴片的图像的多个贴片，并且使用基于相似度的加权平均来确定用于去噪原始数字图像的适当值。 在去噪操作之后，可以使用相同的加权平均和相似的补丁来对相同的图像进行去马赛克。

公开(公告)号：US08358359B2

公开(公告)日：2013-01-22

申请号：US12690929

申请日：2010-01-21

Applicant: Simon J. Baker ,  Eric P. Bennett ,  Sing Bing Kang ,  Richard Szeliski

Inventor： Simon J. Baker ,  Eric P. Bennett ,  Sing Bing Kang ,  Richard Szeliski

IPC: H04N5/217 ,  H04N11/00 ,  H04N7/00 ,  G06K9/40

CPC classification number: G06T5/003 ,  G06T2207/20201

Abstract: A system is described for reducing artifacts produced by a rolling shutter capture technique in the presence of high-frequency motion, e.g., produced by large accelerations or jitter. The system operates by computing low-frequency information based on the motion of points from one frame to the next. The system then uses the low-frequency information to infer the high-frequency motion, e.g., by treating the low-frequency information as known integrals of the unknown underlying high-frequency information. The system then uses the high-frequency information to reduce the presence of artifacts. In effect, the correction aims to re-render video information as though all the pixels in each frame were imaged at the same time using a global shutter technique. An auto-calibration module can estimate the value of a capture parameter, which relates to a time interval between the capture of two subsequent rows of video information.

Abstract translation: 描述了一种用于在存在高频运动（例如由大的加速度或抖动产生的）的情况下减少由快门拍摄技术产生的假象的系统。 该系统通过基于从一帧到下一帧的点的运动来计算低频信息来进行操作。 然后，系统使用低频信息来推断高频运动，例如通过将低频信息作为未知底层高频信息的已知积分来处理。 然后，系统使用高频信息来减少伪像的存在。 实际上，校正旨在重新渲染视频信息，就像使用全局快门技术同时成像每个帧中的所有像素一样。 自动校准模块可以估计捕获参数的值，其涉及捕获两个后续行的视频信息之间的时间间隔。

公开(公告)号：US08264553B2

公开(公告)日：2012-09-11

申请号：US12616782

申请日：2009-11-12

Applicant: Neel S. Joshi ,  Sing Bing Kang ,  Charles L. Zitnick, III ,  Richard S. Szeliski

Inventor： Neel S. Joshi ,  Sing Bing Kang ,  Charles L. Zitnick, III ,  Richard S. Szeliski

IPC: H04N5/228 ,  G06K9/40

CPC classification number: H04N5/23248 ,  H04N5/23258 ,  H04N5/23267

Abstract: The described implementations relate to deblurring images. One system includes an imaging device configured to capture an image, a linear motion detector and a rotational motion detector. This system also includes a controller configured to receive a signal from the imaging device relating to capture of the image and to responsively cause the linear motion detector and the rotational motion detector to detect motion-related information. Finally, this particular system includes a motion calculator configured to recover camera motion associated with the image based upon the detected motion-related information and to infer imaging device motion induced blur of the image and an image deblurring component configured to reduce imaging device induced blur from the image utilizing the inferred camera motion induced blur.

Abstract translation: 所描述的实现涉及去模糊图像。 一个系统包括被配置为捕获图像的成像装置，线性运动检测器和旋转运动检测器。 该系统还包括控制器，其被配置为从成像装置接收与捕获图像有关的信号，并且响应地使线性运动检测器和旋转运动检测器检测运动相关信息。 最后，该特定系统包括运动计算器，该运动计算器被配置为基于检测到的运动相关信息来恢复与图像相关联的摄像机运动，并且推断图像的成像装置运动引起的模糊，以及被配置成减少成像装置引起的模糊的图像去模糊部件 该图像利用推测的相机运动引起的模糊。

公开(公告)号：US20120114037A1

公开(公告)日：2012-05-10

申请号：US13348262

申请日：2012-01-11

Applicant: Simon Winder ,  Matthew T. Uyttendaele ,  Charles Lawrence Zitnick, III ,  Richard Szeliski ,  Sing Bing Kang

Inventor： Simon Winder ,  Matthew T. Uyttendaele ,  Charles Lawrence Zitnick, III ,  Richard Szeliski ,  Sing Bing Kang

IPC: H04N11/02

CPC classification number: H04N21/4347 ,  H04N13/111 ,  H04N19/109 ,  H04N19/39 ,  H04N19/593 ,  H04N19/597 ,  H04N19/61 ,  H04N19/70 ,  H04N19/96 ,  H04N21/2365

Abstract: A process for compressing and decompressing non-keyframes in sequential sets of contemporaneous video frames making up multiple video streams where the video frames in a set depict substantially the same scene from different viewpoints. Each set of contemporaneous video frames has a plurality frames designated as keyframes with the remaining being non-keyframes. In one embodiment, the non-keyframes are compressed using a multi-directional spatial prediction technique. In another embodiment, the non-keyframes of each set of contemporaneous video frames are compressed using a combined chaining and spatial prediction compression technique. The spatial prediction compression technique employed can be a single direction technique where just one reference frame, and so one chain, is used to predict each non-keyframe, or it can be a multi-directional technique where two or more reference frames, and so chains, are used to predict each non-keyframe.

Abstract translation: 一种用于在构成多个视频流的同步视频帧的顺序集合中压缩和解压缩非关键帧的过程，其中集合中的视频帧从不同视点描绘基本上相同的场景。 每组同时期的视频帧具有指定为关键帧的多个帧，其余的是非关键帧。 在一个实施例中，使用多方向空间预测技术来压缩非关键帧。 在另一个实施例中，使用组合链接和空间预测压缩技术来压缩每组同时期视频帧的非关键帧。 所使用的空间预测压缩技术可以是单向技术，其中仅使用一个参考帧，因此使用一条链来预测每个非关键帧，或者它可以是多方向技术，其中两个或更多个参考帧等 链，用于预测每个非关键帧。

公开(公告)号：US20110176043A1

公开(公告)日：2011-07-21

申请号：US12690929

申请日：2010-01-21

Applicant: Simon J. Baker ,  Eric P. Bennett ,  Sing Bing Kang ,  Richard Szeliski

Inventor： Simon J. Baker ,  Eric P. Bennett ,  Sing Bing Kang ,  Richard Szeliski

IPC: H04N5/335

CPC classification number: G06T5/003 ,  G06T2207/20201

Abstract: A system is described for reducing artifacts produced by a rolling shutter capture technique in the presence of high-frequency motion, e.g., produced by large accelerations or jitter. The system operates by computing low-frequency information based on the motion of points from one frame to the next. The system then uses the low-frequency information to infer the high-frequency motion, e.g., by treating the low-frequency information as known integrals of the unknown underlying high-frequency information. The system then uses the high-frequency information to reduce the presence of artifacts. In effect, the correction aims to re-render video information as though all the pixels in each frame were imaged at the same time using a global shutter technique. An auto-calibration module can estimate the value of a capture parameter, which relates to a time interval between the capture of two subsequent rows of video information.

Abstract translation: 描述了一种用于在存在高频运动（例如由大的加速度或抖动产生的）的情况下减少由快门拍摄技术产生的假象的系统。 该系统通过基于从一帧到下一帧的点的运动来计算低频信息来进行操作。 然后，系统使用低频信息来推断高频运动，例如通过将低频信息作为未知底层高频信息的已知积分来处理。 然后，系统使用高频信息来减少伪像的存在。 实际上，校正旨在重新渲染视频信息，就像使用全局快门技术同时成像每个帧中的所有像素一样。 自动校准模块可以估计捕获参数的值，其涉及捕获两个后续行的视频信息之间的时间间隔。

公开(公告)号：US07809208B2

公开(公告)日：2010-10-05

申请号：US11755661

申请日：2007-05-30

Applicant: Sing Bing Kang

Inventor： Sing Bing Kang

IPC: G06K9/40

CPC classification number: G06T5/004 ,  G06T2207/20192 ,  H04N5/23229 ,  H04N2201/00

Abstract: An image sharpening technique with halo suppression is presented. Generally, one implementation of this technique completely suppresses the haloing effect typically caused by image sharpening by restricting values to within the local minimum and maximum intensities of the unsharpened image. Thus, if the sharpened value is below the local minimum, it is replaced with the local minimum. Similarly, the local maximum is taken if the sharpened value exceeds it. In other implementations of the technique, haloing caused by image sharpening is suppressed but not completely eliminated, thereby producing a subtle haloing effect.

Abstract translation: 提出了具有光晕抑制的图像锐化技术。 通常，该技术的一个实现完全抑制通常通过将值限制在未钝化图像的局部最小和最大强度内的图像锐化引起的晕圈效应。 因此，如果锐化值低于局部最小值，则将其替换为局部最小值。 类似地，如果锐化值超过本地值，则采用局部最大值。 在该技术的其他实施方式中，由图像锐化引起的晕圈被抑制但不能完全消除，从而产生微妙的晕圈效应。

公开(公告)号：US07792357B2

公开(公告)日：2010-09-07

申请号：US11755357

申请日：2007-05-30

Applicant: Sing Bing Kang

Inventor： Sing Bing Kang

IPC: G06K9/00

CPC classification number: H04N9/045 ,  G06T5/002 ,  G06T5/003 ,  G06T5/20 ,  G06T2207/10024 ,  H04N1/4092

Abstract: A chromatic aberration (CA) correction technique is presented that substantially removes CA from an image captured by a digital camera. In general, the effects of any in-camera sharpening are reversed by applying a blurring kernel. The image is then super-sampled to approximate its state prior to the application of in-camera sampling. One of the color channels is designated as a reference channel, and an objective function is established for each of the non-reference channels. The reference color channel is assumed to be CA-free, while the objective functions are used to compute the unknown CA parameters for each non-reference channel. These sets are used in a CA removal function to substantially remove the CA associated with each of the non-reference channels. The image is then sampled to return it to its original resolution, and a sharpening filter is applied if needed to undo the effects of the previously applied blurring kernel.

Abstract translation: 提出了一种色差（CA）校正技术，其基本上从数字照相机拍摄的图像中除去CA。 通常，通过应用模糊内核，任何相机内锐化的效果都会相反。 然后在应用相机内采样之前，将图像超采样以近似其状态。 一个颜色通道被指定为参考通道，并且为每个非参考通道建立目标函数。 假设参考色彩通道是无CA的，而目标函数用于计算每个非参考通道的未知CA参数。 这些组用于CA删除功能，以基本上移除与每个非参考信道相关联的CA。 然后对图像进行采样以将其恢复到其原始分辨率，并且如果需要，则应用锐化滤波器来撤销先前应用的模糊内核的效果。