-
公开(公告)号：US09098908B2
公开(公告)日：2015-08-04
申请号：US13278184
申请日：2011-10-21
Applicant: Adam G. Kirk , Yaron Eshet , Kestutis Patiejunas , Sing Bing Kang , Charles Lawrence Zitnick, III , David Eraker , Simon Winder
Inventor： Adam G. Kirk , Yaron Eshet , Kestutis Patiejunas , Sing Bing Kang , Charles Lawrence Zitnick, III , David Eraker , Simon Winder
IPC: G06T7/00
CPC classification number: G06T7/0057 , G06T7/521 , G06T7/593 , G06T2207/10048
Abstract: Methods and systems for generating a depth map are provided. The method includes projecting an infrared (IR) dot pattern onto a scene. The method also includes capturing stereo images from each of two or more synchronized IR cameras, detecting a number of dots within the stereo images, computing a number of feature descriptors for the dots in the stereo images, and computing a disparity map between the stereo images. The method further includes generating a depth map for the scene using the disparity map.
Abstract translation: 提供了用于生成深度图的方法和系统。 该方法包括将红外（IR）点图案投影到场景上。 该方法还包括从两个或多个同步红外相机中的每一个捕获立体图像，检测立体图像内的点数，计算立体图像中的点的特征描述符的数量，以及计算立体图像之间的视差图 。 该方法还包括使用视差图生成场景的深度图。
-
公开(公告)号：US08345956B2
公开(公告)日：2013-01-01
申请号：US12263618
申请日：2008-11-03
Applicant: Benjamin Ward , Sing Bing Kang , Eric Bennett
Inventor： Benjamin Ward , Sing Bing Kang , Eric Bennett
CPC classification number: G06T7/579 , G06T2207/10012 , G06T2207/10016 , G06T2207/20104 , H04N13/261
Abstract: Two-dimensional (2D) video is converted into multi-view video. The 2D video is segmented to generate a temporally consistent segmented 2D video which is made up of a sequence of segmented frames. The multi-view video is generated by employing user-guided operations to generate depth assignments for the segments associated with user-assigned regions of the segmented frames, where a user-assigned region is formed from a group of contiguous segments selected by the user.
Abstract translation: 二维（2D）视频转换为多视角视频。 2D视频被分割以产生由分段帧序列组成的时间上一致的分割的2D视频。 多视点视频是通过采用用户指导的操作来生成与分段帧的用户分配区域相关联的片段的深度分配，其中由用户选择的一组连续片段形成用户分配的区域。
-
公开(公告)号：US08274603B2
公开(公告)日：2012-09-25
申请号：US12057372
申请日：2008-03-28
Applicant: Shengyang Dai , Simon John Baker , Sing Bing Kang
Inventor： Shengyang Dai , Simon John Baker , Sing Bing Kang
CPC classification number: H04N7/0145 , H04N7/012
Abstract: Deinterlacing of video involves converting interlaced video to progressive video by interpolating a missing pixel in the interlaced video from other pixels in the video. A plurality of interpolants are provided, each of which interpolates a pixel value from other pixels that are nearby in space and/or time. The data costs of using the various interpolants is calculated. A particular one of the interpolants is chosen based on the data costs associated with the various interpolants. The chosen interpolant is used to interpolate the value of the missing pixel. The interpolated pixel value may be refined based on exemplars. The exemplars may be taken from the video that is being deinterlaced.
Abstract translation: 视频的去隔行扫描涉及通过从视频中的其他像素插入隔行视频中的丢失像素来将隔行扫描视频转换为逐行视频。 提供了多个内插器，每个插值器都在空间和/或时间附近的其他像素中插入像素值。 计算使用各种内插剂的数据成本。 基于与各种内插剂相关联的数据成本来选择特定的一个内插剂。 所选择的插值器用于内插缺失像素的值。 可以基于示例来改进内插像素值。 示例可以从正在被去隔行扫描的视频中取出。
-
公开(公告)号：US08078002B2
公开(公告)日：2011-12-13
申请号：US12124158
申请日：2008-05-21
Applicant: Sing Bing Kang , Jiading Gai
Inventor： Sing Bing Kang , Jiading Gai
IPC: G06K9/40
CPC classification number: G06T5/005 , G06T5/20 , G06T5/50 , G06T2207/10016 , G06T2207/10024 , G06T2207/20028 , G06T2207/20182 , H04N9/11
Abstract: Matte-based video restoration technique embodiments are presented which model spatio-temporally varying film wear artifacts found in digitized copies of film media. In general, this is accomplished by employing residual color information in recovering of artifact mattes. To this end, the distributions of artifact colors and their fractional contribution to each pixel of each frame being considered are extracted based on color information from the spatial and temporal neighborhoods of the pixel. The extracted information can then be used to restore the video by removing the artifacts.
Abstract translation: 提出了基于Matte的视频恢复技术实施例，其模型在电影媒体的数字化副本中发现的时空变化的电影磨损伪像。 一般来说，这是通过使用残余颜色信息来恢复伪像哑光来实现的。 为此，基于来自该像素的空间和时间邻域的颜色信息，提取伪像颜色的分布及其对所考虑的每帧的每个像素的分数贡献。 所提取的信息然后可以用于通过去除伪影来恢复视频。
-
5.发明授权System and process for compressing and decompressing multiple, layered, video streams of a scene captured from different viewpoints forming a grid using spatial and temporal encoding 有权用于压缩和解压缩从使用空间和时间编码形成网格的不同视点捕获的场景的多个分层视频流的系统和过程公开(公告)号：US07702016B2
公开(公告)日：2010-04-20
申请号：US11097533
申请日：2005-03-31
Applicant: Simon Winder , Matthew T. Uyttendaele , Charles Lawrence Zitnick, III , Richard Szeliski , Sing Bing Kang
Inventor： Simon Winder , Matthew T. Uyttendaele , Charles Lawrence Zitnick, III , Richard Szeliski , Sing Bing Kang
CPC classification number: H04N21/4347 , H04N13/111 , H04N19/109 , H04N19/39 , H04N19/593 , H04N19/597 , H04N19/61 , H04N19/70 , H04N19/96 , H04N21/2365
Abstract: A system and process for compressing and decompressing multiple video streams depicting substantially the same dynamic scene from different viewpoints that from a grid of viewpoints. Each frame in each contemporaneous set of video frames of the multiple streams is represented by at least a two layers—a main layer and a boundary layer. Compression of the main layers involves first designating one or more of these layers in each set of contemporaneous frames as keyframes. For each set of contemporaneous frames in time sequence order, the main layer of each keyframe is compressed using an inter-frame compression technique. In addition, the main layer of each non-keyframe within the frame set under consideration is compressed using a spatial prediction compression technique. Finally, the boundary layers of each frame in the current frame set are each compressed using an intra-frame compression technique. Decompression is generally the reverse of the compression process.
Abstract translation: 一种用于压缩和解压缩从视点网格的不同观点描绘基本相同的动态场景的多个视频流的系统和过程。 多个流的每个同期视频帧集合中的每个帧由至少两层（主层和边界层）表示。 主要层的压缩包括首先将每组同期帧中的这些层中的一个或多个指定为关键帧。 对于按时间顺序排列的每组同期帧，使用帧间压缩技术对每个关键帧的主层进行压缩。 另外，使用空间预测压缩技术对所考虑的帧集合内的每个非关键帧的主层进行压缩。 最后，使用帧内压缩技术对当前帧集合中每帧的边界层进行压缩。 压缩通常与压缩过程相反。
-
Patent Agency Ranking
公开(公告)号：US20090244367A1
公开(公告)日：2009-10-01
申请号：US12057372
申请日：2008-03-28
Applicant: Shengyang Dai , Simon John Baker , Sing Bing Kang
Inventor： Shengyang Dai , Simon John Baker , Sing Bing Kang
CPC classification number: H04N7/0145 , H04N7/012
Abstract: Deinterlacing of video involves converting interlaced video to progressive video by interpolating a missing pixel in the interlaced video from other pixels in the video. A plurality of interpolants are provided, each of which interpolates a pixel value from other pixels that are nearby in space and/or time. The data costs of using the various interpolants is calculated. A particular one of the interpolants is chosen based on the data costs associated with the various interpolants. The chosen interpolant is used to interpolate the value of the missing pixel. The interpolated pixel value may be refined based on exemplars. The exemplars may be taken from the video that is being deinterlaced.
Abstract translation: 视频的去隔行扫描涉及通过从视频中的其他像素插入隔行视频中的丢失像素来将隔行扫描视频转换为逐行视频。 提供了多个内插器，每个插值器都在空间和/或时间附近的其他像素中插入像素值。 计算使用各种内插剂的数据成本。 基于与各种内插剂相关联的数据成本来选择特定的一个内插剂。 所选择的插值器用于内插缺失像素的值。 可以基于示例来改进内插像素值。 示例可以从正在被去隔行扫描的视频中取出。
-
公开(公告)号：US07548253B2
公开(公告)日：2009-06-16
申请号：US11015828
申请日：2004-12-15
Applicant: Sing Bing Kang
Inventor： Sing Bing Kang
IPC: H04N17/02
CPC classification number: H04N5/2628 , G06T5/006 , G06T7/80
Abstract: A method and a system for self-calibrating a wide field-of-view camera (such as a catadioptric camera) using a sequence of omni-directional images of a scene obtained from the camera. The present invention uses the consistency of pairwise features tracked across at least a portion of the image collection and uses these tracked features to determine unknown calibration parameters based on the characteristics of catadioptric imaging. More specifically, the self-calibration method of the present invention generates a sequence of omni-directional images representing a scene and tracks features across the image sequence. An objective function is defined in terms of the tracked features and an error metric (an image-based error metric in a preferred embodiment). The catadioptric imaging characteristics are defined by calibration parameters, and determination of optimal calibration parameters is accomplished by minimizing the objective function using an optimizing technique.
Abstract translation: 一种用于使用从相机获得的场景的全方位图像序列来自动校准宽视野相机（例如反折射相机）的方法和系统。 本发明使用在图像集合的至少一部分上跟踪的成对特征的一致性，并且使用这些跟踪的特征来基于反射折射成像的特征来确定未知的校准参数。 更具体地，本发明的自校准方法生成表示场景的全方位图像序列，并且跨越图像序列跟踪特征。 根据跟踪特征和误差度量（优选实施例中的基于图像的误差度量）来定义目标函数。 反射折射成像特征由校准参数定义，并且通过使用优化技术来最小化目标函数来实现最佳校准参数的确定。
-
公开(公告)号：US20080298678A1
公开(公告)日：2008-12-04
申请号：US11755357
申请日：2007-05-30
Applicant: Sing Bing Kang
Inventor： Sing Bing Kang
IPC: G06K9/00
CPC classification number: H04N9/045 , G06T5/002 , G06T5/003 , G06T5/20 , G06T2207/10024 , H04N1/4092
Abstract: A chromatic aberration (CA) correction technique is presented that substantially removes CA from an image captured by a digital camera. In general, the effects of any in-camera sharpening are reversed by applying a blurring kernel. The image is then super-sampled to approximate its state prior to the application of in-camera sampling. One of the color channels is designated as a reference channel, and an objective function is established for each of the non-reference channels. The reference color channel is assumed to be CA-free, while the objective functions are used to compute the unknown CA parameters for each non-reference channel. These sets are used in a CA removal function to substantially remove the CA associated with each of the non-reference channels. The image is then sampled to return it to its original resolution, and a sharpening filter is applied if needed to undo the effects of the previously applied blurring kernel.
Abstract translation: 提出了一种色差（CA）校正技术，其基本上从数字照相机拍摄的图像中除去CA。 通常，通过应用模糊内核，任何相机内锐化的效果都会相反。 然后在应用相机内采样之前，将图像超采样以近似其状态。 一个颜色通道被指定为参考通道，并且为每个非参考通道建立目标函数。 假设参考色彩通道是无CA的，而目标函数用于计算每个非参考通道的未知CA参数。 这些组用于CA删除功能，以基本上移除与每个非参考信道相关联的CA。 然后对图像进行采样以将其恢复到其原始分辨率，并且如果需要，则应用锐化滤波器来撤销先前应用的模糊内核的效果。
-
公开(公告)号：US07286143B2
公开(公告)日：2007-10-23
申请号：US11097542
申请日：2005-03-31
Applicant: Sing Bing Kang , Charles Zitnick, III , Matthew Uyttendaele , Simon Winder , Richard Szeliski
Inventor： Sing Bing Kang , Charles Zitnick, III , Matthew Uyttendaele , Simon Winder , Richard Szeliski
IPC: G09G5/00
CPC classification number: H04N5/2627 , G06T7/557 , G06T7/596 , G06T15/205 , G06T2207/10021
Abstract: A system and process for generating, and then rendering and displaying, an interactive viewpoint video in which a user can watch a dynamic scene while manipulating (freezing, slowing down, or reversing) time and changing the viewpoint at will. In general, the interactive viewpoint video is generated using a small number of cameras to capture multiple video streams. A multi-view 3D reconstruction and matting technique is employed to create a layered representation of the video frames that enables both efficient compression and interactive playback of the captured dynamic scene, while at the same time allowing for real-time rendering.
Abstract translation: 一种用于生成并再现和显示交互视点视频的系统和过程，其中用户可以在操纵（冻结，减慢或反转）时间并随意改变视点的同时观看动态场景。 通常，使用少量摄像机生成交互视点视频以捕获多个视频流。 采用多视图3D重建和消隐技术来创建视频帧的分层表示，使得能够实现捕获的动态场景的高效压缩和交互式回放，同时允许实时渲染。
-
公开(公告)号：US07224386B2
公开(公告)日：2007-05-29
申请号：US11015822
申请日：2004-12-15
Applicant: Sing Bing Kang
Inventor： Sing Bing Kang
CPC classification number: H04N5/2628 , G06T5/006 , G06T7/80
Abstract: A method and a system for self-calibrating a wide field-of-view camera (such as a catadioptric camera) using a sequence of omni-directional images of a scene obtained from the camera. The present invention uses the consistency of pairwise features tracked across at least a portion of the image collection and uses these tracked features to determine unknown calibration parameters based on the characteristics of catadioptric imaging. More specifically, the self-calibration method of the present invention generates a sequence of omni-directional images representing a scene and tracks features across the image sequence. An objective function is defined in terms of the tracked features and an error metric (an image-based error metric in a preferred embodiment). The catadioptric imaging characteristics are defined by calibration parameters, and determination of optimal calibration parameters is accomplished by minimizing the objective function using an optimizing technique.
Abstract translation: 一种用于使用从相机获得的场景的全方位图像序列来自动校准宽视野相机（例如反折射相机）的方法和系统。 本发明使用在图像集合的至少一部分上跟踪的成对特征的一致性，并且使用这些跟踪的特征来基于反射折射成像的特征来确定未知的校准参数。 更具体地，本发明的自校准方法生成表示场景的全方位图像序列，并且跨越图像序列跟踪特征。 根据跟踪特征和误差度量（优选实施例中的基于图像的误差度量）来定义目标函数。 反射折射成像特征由校准参数定义，并且通过使用优化技术来最小化目标函数来实现最佳校准参数的确定。
-
-
-
-
-
-
-
-
-
Search Results
111
records
(took 0.01 seconds)
