Interactive viewpoint video system and process
    31.
    发明授权
    Interactive viewpoint video system and process 有权
    互动观点视频系统和过程

    公开(公告)号:US07292257B2

    公开(公告)日:2007-11-06

    申请号:US10880774

    申请日:2004-06-28

    摘要: A system and process for generating, and then rendering and displaying, an interactive viewpoint video in which a user can watch a dynamic scene while manipulating (freezing, slowing down, or reversing) time and changing the viewpoint at will. In general, the interactive viewpoint video is generated using a small number of cameras to capture multiple video streams. A multi-view 3D reconstruction and matting technique is employed to create a layered representation of the video frames that enables both efficient compression and interactive playback of the captured dynamic scene, while at the same time allowing for real-time rendering.

    摘要翻译: 一种用于生成并再现和显示交互视点视频的系统和过程,其中用户可以在操纵(冻结,减慢或反转)时间并随意改变视点的同时观看动态场景。 通常,使用少量摄像机生成交互视点视频以捕获多个视频流。 采用多视图3D重建和消隐技术来创建视频帧的分层表示,使得能够实现捕获的动态场景的高效压缩和交互式回放,同时允许实时渲染。

    Deghosting mosaics using multiperspective plane sweep

    公开(公告)号:US20060072851A1

    公开(公告)日:2006-04-06

    申请号:US11286524

    申请日:2005-11-22

    IPC分类号: G06K9/32 G06K9/36

    摘要: A system and method for deghosting mosaics provides a novel multiperspective plane sweep approach for generating an image mosaic from a sequence of still images, video images, scanned photographic images, computer generated images, etc. This multiperspective plane sweep approach uses virtual camera positions to compute depth maps for columns of overlapping pixels in adjacent images. Object distortions and ghosting caused by image parallax when generating the image mosaics are then minimized by blending pixel colors, or grey values, for each computed depth to create a common composite area for each of the overlapping images. Further, the multiperspective plane sweep approach described herein is both computationally efficient, and applicable to both the case of limited overlap between the images used for creating the image mosaics, and to the case of extensive or increased image overlap.

    System and process for generating a two-layer, 3D representation of a scene
    34.
    发明授权
    System and process for generating a two-layer, 3D representation of a scene 有权
    用于生成场景的两层3D表示的系统和过程

    公开(公告)号:US07015926B2

    公开(公告)日:2006-03-21

    申请号:US10879235

    申请日:2004-06-28

    IPC分类号: G09G5/02

    CPC分类号: G06T15/205

    摘要: A system and process for generating a two-layer, 3D representation of a digital or digitized image from the image and a pixel disparity map of the image is presented. The two layer representation includes a main layer having pixels exhibiting background colors and background disparities associated with correspondingly located pixels of depth discontinuity areas in the image, as well as pixels exhibiting colors and disparities associated with correspondingly located pixels of the image not found in these depth discontinuity areas. The other layer is a boundary layer made up of pixels exhibiting foreground colors, foreground disparities and alpha values associated with the correspondingly located pixels of the depth discontinuity areas. The depth discontinuity areas correspond to prescribed sized areas surrounding depth discontinuities found in the image using a disparity map thereof.

    摘要翻译: 提出了一种用于从图像生成数字或数字化图像的二层3D表示和图像的像素视差图的系统和过程。 两层表示包括具有显示背景颜色的像素和与图像中的深度不连续区域的相应定位的像素相关联的背景差异的主层以及与在这些深度中未找到的图像的相应定位的像素相关联的颜色和差异的像素 不连续区域。 另一层是由与前述深度不连续区域的对应位置的像素相关联的前景色,前景差异和α值的像素构成的边界层。 深度不连续区域对应于使用其视差图在图像中发现的围绕深度不连续性的规定尺寸的区域。

    Converting 2D video into stereo video
    37.
    发明授权
    Converting 2D video into stereo video 有权
    将2D视频转换为立体声视频

    公开(公告)号:US08345956B2

    公开(公告)日:2013-01-01

    申请号:US12263618

    申请日:2008-11-03

    IPC分类号: G06K9/00 G06K9/34

    摘要: Two-dimensional (2D) video is converted into multi-view video. The 2D video is segmented to generate a temporally consistent segmented 2D video which is made up of a sequence of segmented frames. The multi-view video is generated by employing user-guided operations to generate depth assignments for the segments associated with user-assigned regions of the segmented frames, where a user-assigned region is formed from a group of contiguous segments selected by the user.

    摘要翻译: 二维(2D)视频转换为多视角视频。 2D视频被分割以产生由分段帧序列组成的时间上一致的分割的2D视频。 多视点视频是通过采用用户指导的操作来生成与分段帧的用户分配区域相关联的片段的深度分配,其中由用户选择的一组连续片段形成用户分配的区域。

    Choosing video deinterlacing interpolant based on cost
    38.
    发明授权
    Choosing video deinterlacing interpolant based on cost 有权
    基于成本选择视频去隔行插值

    公开(公告)号:US08274603B2

    公开(公告)日:2012-09-25

    申请号:US12057372

    申请日:2008-03-28

    IPC分类号: H04N7/01 H04N11/20

    CPC分类号: H04N7/0145 H04N7/012

    摘要: Deinterlacing of video involves converting interlaced video to progressive video by interpolating a missing pixel in the interlaced video from other pixels in the video. A plurality of interpolants are provided, each of which interpolates a pixel value from other pixels that are nearby in space and/or time. The data costs of using the various interpolants is calculated. A particular one of the interpolants is chosen based on the data costs associated with the various interpolants. The chosen interpolant is used to interpolate the value of the missing pixel. The interpolated pixel value may be refined based on exemplars. The exemplars may be taken from the video that is being deinterlaced.

    摘要翻译: 视频的去隔行扫描涉及通过从视频中的其他像素插入隔行视频中的丢失像素来将隔行扫描视频转换为逐行视频。 提供了多个内插器,每个插值器都在空间和/或时间附近的其他像素中插入像素值。 计算使用各种内插剂的数据成本。 基于与各种内插剂相关联的数据成本来选择特定的一个内插剂。 所选择的插值器用于内插缺失像素的值。 可以基于示例来改进内插像素值。 示例可以从正在被去隔行扫描的视频中取出。

    Matte-based video restoration
    39.
    发明授权
    Matte-based video restoration 有权
    基于Matte的视频恢复

    公开(公告)号:US08078002B2

    公开(公告)日:2011-12-13

    申请号:US12124158

    申请日:2008-05-21

    IPC分类号: G06K9/40

    摘要: Matte-based video restoration technique embodiments are presented which model spatio-temporally varying film wear artifacts found in digitized copies of film media. In general, this is accomplished by employing residual color information in recovering of artifact mattes. To this end, the distributions of artifact colors and their fractional contribution to each pixel of each frame being considered are extracted based on color information from the spatial and temporal neighborhoods of the pixel. The extracted information can then be used to restore the video by removing the artifacts.

    摘要翻译: 提出了基于Matte的视频恢复技术实施例,其模型在电影媒体的数字化副本中发现的时空变化的电影磨损伪像。 一般来说,这是通过使用残余颜色信息来恢复伪像哑光来实现的。 为此,基于来自该像素的空间和时间邻域的颜色信息,提取伪像颜色的分布及其对所考虑的每帧的每个像素的分数贡献。 所提取的信息然后可以用于通过去除伪影来恢复视频。

    CHOOSING VIDEO DEINTERLACING INTERPOLANT BASED ON COST
    40.
    发明申请
    CHOOSING VIDEO DEINTERLACING INTERPOLANT BASED ON COST 有权
    根据成本选择视频去除插件

    公开(公告)号:US20090244367A1

    公开(公告)日:2009-10-01

    申请号:US12057372

    申请日:2008-03-28

    IPC分类号: H04N7/01 G06K9/32

    CPC分类号: H04N7/0145 H04N7/012

    摘要: Deinterlacing of video involves converting interlaced video to progressive video by interpolating a missing pixel in the interlaced video from other pixels in the video. A plurality of interpolants are provided, each of which interpolates a pixel value from other pixels that are nearby in space and/or time. The data costs of using the various interpolants is calculated. A particular one of the interpolants is chosen based on the data costs associated with the various interpolants. The chosen interpolant is used to interpolate the value of the missing pixel. The interpolated pixel value may be refined based on exemplars. The exemplars may be taken from the video that is being deinterlaced.

    摘要翻译: 视频的去隔行扫描涉及通过从视频中的其他像素插入隔行视频中的丢失像素来将隔行扫描视频转换为逐行视频。 提供了多个内插器,每个插值器都在空间和/或时间附近的其他像素中插入像素值。 计算使用各种内插剂的数据成本。 基于与各种内插剂相关联的数据成本来选择特定的一个内插剂。 所选择的插值器用于内插缺失像素的值。 可以基于示例来改进内插像素值。 示例可以从正在被去隔行扫描的视频中取出。