System and process for generating high dynamic range video
    21.
    发明授权
    System and process for generating high dynamic range video 有权
    用于生成高动态范围视频的系统和过程

    公开(公告)号:US07239757B2

    公开(公告)日:2007-07-03

    申请号:US11338910

    申请日:2006-01-23

    IPC分类号: G06K9/40

    摘要: A system and process for generating High Dynamic Range (HDR) video is presented which involves first capturing a video image sequence while varying the exposure so as to alternate between frames having a shorter and longer exposure. The exposure for each frame is set prior to it being captured as a function of the pixel brightness distribution in preceding frames. Next, for each frame of the video, the corresponding pixels between the frame under consideration and both preceding and subsequent frames are identified. For each corresponding pixel set, at least one pixel is identified as representing a trustworthy pixel. The pixel color information associated with the trustworthy pixels is then employed to compute a radiance value for each pixel set to form a radiance map. A tone mapping procedure can then be performed to convert the radiance map into an 8-bit representation of the HDR frame.

    摘要翻译: 提出了用于产生高动态范围(HDR)视频的系统和过程,其涉及首先在改变曝光的同时捕获视频图像序列,以便在具有较短和较长曝光的帧之间交替。 每个帧的曝光在其被捕获之前被设置为在先前帧中的像素亮度分布的函数。 接下来,对于视频的每个帧,识别所考虑的帧与前后帧之间的对应像素。 对于每个对应的像素集合,至少一个像素被识别为表示可靠的像素。 然后使用与可信赖像素相关联的像素颜色信息来计算每个像素组的辐射值以形成辐射图。 然后可以执行色调映射过程以将辐射图转换成HDR帧的8位表示。

    System and process for generating high dynamic range video
    22.
    发明授权
    System and process for generating high dynamic range video 失效
    用于生成高动态范围视频的系统和过程

    公开(公告)号:US06879731B2

    公开(公告)日:2005-04-12

    申请号:US10425338

    申请日:2003-04-29

    摘要: A system and process for generating High Dynamic Range (HDR) video is presented which involves first capturing a video image sequence while varying the exposure so as to alternate between frames having a shorter and longer exposure. The exposure for each frame is set prior to it being captured as a function of the pixel brightness distribution in preceding frames. Next, for each frame of the video, the corresponding pixels between the frame under consideration and both preceding and subsequent frames are identified. For each corresponding pixel set, at least one pixel is identified as representing a trustworthy pixel. The pixel color information associated with the trustworthy pixels is then employed to compute a radiance value for each pixel set to form a radiance map. A tone mapping procedure can then be performed to convert the radiance map into an 8-bit representation of the HDR frame.

    摘要翻译: 提出了用于产生高动态范围(HDR)视频的系统和过程,其涉及首先在改变曝光的同时捕获视频图像序列,以便在具有较短和较长曝光的帧之间交替。 每个帧的曝光在其被捕获之前被设置为在先前帧中的像素亮度分布的函数。 接下来,对于视频的每个帧,识别所考虑的帧与前后帧之间的对应像素。 对于每个对应的像素集合,至少一个像素被识别为表示可靠的像素。 然后使用与可信赖像素相关联的像素颜色信息来计算每个像素组的辐射值以形成辐射图。 然后可以执行色调映射过程以将辐射图转换成HDR帧的8位表示。

    Color segmentation-based stereo 3D reconstruction system and process employing overlapping images of a scene captured from viewpoints forming either a line or a grid
    23.
    发明授权
    Color segmentation-based stereo 3D reconstruction system and process employing overlapping images of a scene captured from viewpoints forming either a line or a grid 有权
    基于颜色分割的立体3D重建系统和使用从形成线或网格的视点捕获的场景的重叠图像的过程

    公开(公告)号:US07379583B2

    公开(公告)日:2008-05-27

    申请号:US11097529

    申请日:2005-03-31

    IPC分类号: G06K9/00

    CPC分类号: G06K9/20 G06K2209/40 G06T7/55

    摘要: A system and process for computing a 3D reconstruction of a scene from multiple images thereof, which is based on a color segmentation-based approach, is presented. First, each image is independently segmented. Second, an initial disparity space distribution (DSD) is computed for each segment, using the assumption that all pixels within a segment have the same disparity. Next, each segment's DSD is refined using neighboring segments and its projection into other images. The assumption that each segment has a single disparity is then relaxed during a disparity smoothing stage. The result is a disparity map for each image, which in turn can be used to compute a per pixel depth map if the reconstruction application calls for it.

    摘要翻译: 提出了一种用于基于基于颜色分割的方法从其多个图像计算场景的3D重建的系统和过程。 首先,每个图像被独立地分割。 第二,使用假设一个段内的所有像素具有相同的视差来为每个段计算初始视差空间分布(DSD)。 接下来,每个段的DSD使用相邻段进行细化,并将其投影到其他图像中。 然后在视差平滑阶段放宽每个段具有单个视差的假设。 结果是每个图像的视差图,如果重建应用程序需要它,它又可以用于计算每像素深度图。

    Interactive viewpoint video system and process
    24.
    发明授权
    Interactive viewpoint video system and process 有权
    互动观点视频系统和过程

    公开(公告)号:US07292257B2

    公开(公告)日:2007-11-06

    申请号:US10880774

    申请日:2004-06-28

    摘要: A system and process for generating, and then rendering and displaying, an interactive viewpoint video in which a user can watch a dynamic scene while manipulating (freezing, slowing down, or reversing) time and changing the viewpoint at will. In general, the interactive viewpoint video is generated using a small number of cameras to capture multiple video streams. A multi-view 3D reconstruction and matting technique is employed to create a layered representation of the video frames that enables both efficient compression and interactive playback of the captured dynamic scene, while at the same time allowing for real-time rendering.

    摘要翻译: 一种用于生成并再现和显示交互视点视频的系统和过程,其中用户可以在操纵(冻结,减慢或反转)时间并随意改变视点的同时观看动态场景。 通常,使用少量摄像机生成交互视点视频以捕获多个视频流。 采用多视图3D重建和消隐技术来创建视频帧的分层表示,使得能够实现捕获的动态场景的高效压缩和交互式回放,同时允许实时渲染。

    Converting 2D video into stereo video
    26.
    发明授权
    Converting 2D video into stereo video 有权
    将2D视频转换为立体声视频

    公开(公告)号:US08345956B2

    公开(公告)日:2013-01-01

    申请号:US12263618

    申请日:2008-11-03

    IPC分类号: G06K9/00 G06K9/34

    摘要: Two-dimensional (2D) video is converted into multi-view video. The 2D video is segmented to generate a temporally consistent segmented 2D video which is made up of a sequence of segmented frames. The multi-view video is generated by employing user-guided operations to generate depth assignments for the segments associated with user-assigned regions of the segmented frames, where a user-assigned region is formed from a group of contiguous segments selected by the user.

    摘要翻译: 二维(2D)视频转换为多视角视频。 2D视频被分割以产生由分段帧序列组成的时间上一致的分割的2D视频。 多视点视频是通过采用用户指导的操作来生成与分段帧的用户分配区域相关联的片段的深度分配,其中由用户选择的一组连续片段形成用户分配的区域。

    Choosing video deinterlacing interpolant based on cost
    27.
    发明授权
    Choosing video deinterlacing interpolant based on cost 有权
    基于成本选择视频去隔行插值

    公开(公告)号:US08274603B2

    公开(公告)日:2012-09-25

    申请号:US12057372

    申请日:2008-03-28

    IPC分类号: H04N7/01 H04N11/20

    CPC分类号: H04N7/0145 H04N7/012

    摘要: Deinterlacing of video involves converting interlaced video to progressive video by interpolating a missing pixel in the interlaced video from other pixels in the video. A plurality of interpolants are provided, each of which interpolates a pixel value from other pixels that are nearby in space and/or time. The data costs of using the various interpolants is calculated. A particular one of the interpolants is chosen based on the data costs associated with the various interpolants. The chosen interpolant is used to interpolate the value of the missing pixel. The interpolated pixel value may be refined based on exemplars. The exemplars may be taken from the video that is being deinterlaced.

    摘要翻译: 视频的去隔行扫描涉及通过从视频中的其他像素插入隔行视频中的丢失像素来将隔行扫描视频转换为逐行视频。 提供了多个内插器,每个插值器都在空间和/或时间附近的其他像素中插入像素值。 计算使用各种内插剂的数据成本。 基于与各种内插剂相关联的数据成本来选择特定的一个内插剂。 所选择的插值器用于内插缺失像素的值。 可以基于示例来改进内插像素值。 示例可以从正在被去隔行扫描的视频中取出。

    Matte-based video restoration
    28.
    发明授权
    Matte-based video restoration 有权
    基于Matte的视频恢复

    公开(公告)号:US08078002B2

    公开(公告)日:2011-12-13

    申请号:US12124158

    申请日:2008-05-21

    IPC分类号: G06K9/40

    摘要: Matte-based video restoration technique embodiments are presented which model spatio-temporally varying film wear artifacts found in digitized copies of film media. In general, this is accomplished by employing residual color information in recovering of artifact mattes. To this end, the distributions of artifact colors and their fractional contribution to each pixel of each frame being considered are extracted based on color information from the spatial and temporal neighborhoods of the pixel. The extracted information can then be used to restore the video by removing the artifacts.

    摘要翻译: 提出了基于Matte的视频恢复技术实施例,其模型在电影媒体的数字化副本中发现的时空变化的电影磨损伪像。 一般来说,这是通过使用残余颜色信息来恢复伪像哑光来实现的。 为此,基于来自该像素的空间和时间邻域的颜色信息,提取伪像颜色的分布及其对所考虑的每帧的每个像素的分数贡献。 所提取的信息然后可以用于通过去除伪影来恢复视频。

    CHOOSING VIDEO DEINTERLACING INTERPOLANT BASED ON COST
    29.
    发明申请
    CHOOSING VIDEO DEINTERLACING INTERPOLANT BASED ON COST 有权
    根据成本选择视频去除插件

    公开(公告)号:US20090244367A1

    公开(公告)日:2009-10-01

    申请号:US12057372

    申请日:2008-03-28

    IPC分类号: H04N7/01 G06K9/32

    CPC分类号: H04N7/0145 H04N7/012

    摘要: Deinterlacing of video involves converting interlaced video to progressive video by interpolating a missing pixel in the interlaced video from other pixels in the video. A plurality of interpolants are provided, each of which interpolates a pixel value from other pixels that are nearby in space and/or time. The data costs of using the various interpolants is calculated. A particular one of the interpolants is chosen based on the data costs associated with the various interpolants. The chosen interpolant is used to interpolate the value of the missing pixel. The interpolated pixel value may be refined based on exemplars. The exemplars may be taken from the video that is being deinterlaced.

    摘要翻译: 视频的去隔行扫描涉及通过从视频中的其他像素插入隔行视频中的丢失像素来将隔行扫描视频转换为逐行视频。 提供了多个内插器,每个插值器都在空间和/或时间附近的其他像素中插入像素值。 计算使用各种内插剂的数据成本。 基于与各种内插剂相关联的数据成本来选择特定的一个内插剂。 所选择的插值器用于内插缺失像素的值。 可以基于示例来改进内插像素值。 示例可以从正在被去隔行扫描的视频中取出。

    Self-calibration for a catadioptric camera
    30.
    发明授权
    Self-calibration for a catadioptric camera 有权
    反折射相机的自校准

    公开(公告)号:US07548253B2

    公开(公告)日:2009-06-16

    申请号:US11015828

    申请日:2004-12-15

    申请人: Sing Bing Kang

    发明人: Sing Bing Kang

    IPC分类号: H04N17/02

    CPC分类号: H04N5/2628 G06T5/006 G06T7/80

    摘要: A method and a system for self-calibrating a wide field-of-view camera (such as a catadioptric camera) using a sequence of omni-directional images of a scene obtained from the camera. The present invention uses the consistency of pairwise features tracked across at least a portion of the image collection and uses these tracked features to determine unknown calibration parameters based on the characteristics of catadioptric imaging. More specifically, the self-calibration method of the present invention generates a sequence of omni-directional images representing a scene and tracks features across the image sequence. An objective function is defined in terms of the tracked features and an error metric (an image-based error metric in a preferred embodiment). The catadioptric imaging characteristics are defined by calibration parameters, and determination of optimal calibration parameters is accomplished by minimizing the objective function using an optimizing technique.

    摘要翻译: 一种用于使用从相机获得的场景的全方位图像序列来自动校准宽视野相机(例如反折射相机)的方法和系统。 本发明使用在图像集合的至少一部分上跟踪的成对特征的一致性,并且使用这些跟踪的特征来基于反射折射成像的特征来确定未知的校准参数。 更具体地,本发明的自校准方法生成表示场景的全方位图像序列,并且跨越图像序列跟踪特征。 根据跟踪特征和误差度量(优选实施例中的基于图像的误差度量)来定义目标函数。 反射折射成像特征由校准参数定义,并且通过使用优化技术来最小化目标函数来实现最佳校准参数的确定。