公开(公告)号：US08897596B1

公开(公告)日：2014-11-25

申请号：US13367316

申请日：2012-02-06

Applicant: Charles Passmore ,  Tony Baldridge ,  Barry Sandrew

Inventor： Charles Passmore ,  Tony Baldridge ,  Barry Sandrew

IPC: G06K9/00

CPC classification number: H04N13/266 ,  H04N13/257

Abstract: Motion picture scenes to be colorized/depth enhanced (2D→3D) are broken into separate elements, backgrounds/sets or motion/onscreen-action. Background and motion elements are combined into composite frame which becomes a visual reference database that includes data for all frame offsets used later for the computer controlled application of masks within a sequence of frames. Masks are applied to subsequent frames of motion objects based on various differentiating image processing methods, including automated mask fitting/reshaping. Colors and/or depths are automatically applied to masks throughout a scene from the composite background, translucent, motion objects. Areas never exposed by motion or foreground objects in a series of images may be partially or fully realistically drawn or rendered and applied to the occluded areas of the background and then automatically applied throughout the images to generate of minimal artifact or artifact-free secondary viewpoints when translating foreground objects horizontally during 2D→3D conversion.

Abstract translation: 要被着色/深度增强的动态影像场景（2D→3D）被分为单独的元素，背景/集合或运动/屏幕动作。 背景和运动元素被组合成复合帧，其成为视觉参考数据库，其包括用于稍后在计算机控制的帧序列内的掩码的所有帧偏移的数据。 基于各种差异化图像处理方法，包括自动掩模拟合/重新成形，将掩模应用于后续运动对象帧。 颜色和/或深度自动应用于从复合背景，半透明，运动对象的场景中的蒙版。 一系列图像中未被运动或前景物体暴露的区域可能部分或完全实际绘制或渲染并应用于背景的遮挡区域，然后自动应用于整个图像，以产生最少的伪像或无伪影次要视点， 在2D→3D转换期间水平地翻译前景对象。

公开(公告)号：US08385684B2

公开(公告)日：2013-02-26

申请号：US13029862

申请日：2011-02-17

Applicant: Jared Sandrew ,  Tony Baldridge ,  Barry Sandrew

Inventor： Jared Sandrew ,  Tony Baldridge ,  Barry Sandrew

IPC: G06K9/36

CPC classification number: H04N13/257 ,  H04N13/266

Abstract: Movies to be colorized/depth enhanced (2D->3D) are broken into backgrounds/sets or motion/onscreen-action. Background and motion elements are combined into composite frame which becomes a visual reference database that includes data for all frame offsets used later for the computer controlled application of masks within a sequence of frames. Masks are applied to subsequent frames of motion objects based on various differentiating image processing methods, including automated mask fitting/reshaping. Colors/depths are automatically applied with masks throughout a scene from the composite background and to motion objects. Areas never exposed by motion or foreground objects may be partially or fully realistically drawn/rendered/applied to the occluded areas and applied throughout the images to generate artifact-free secondary viewpoints during 2D->3D conversion. Iterative workflow is eliminated for simple artifact correction through real-time manipulation of images to avoid re-rendering of images and associated delays of sending work product to other workgroups for correction.

Abstract translation: 要着色/深度增强的电影（2D-> 3D）被分为背景/集合或运动/屏幕动作。 背景和运动元素被组合成复合帧，其成为视觉参考数据库，其包括用于稍后在计算机控制的帧序列内的掩码的所有帧偏移的数据。 基于各种差异化图像处理方法，包括自动掩模拟合/重新成形，将掩模应用于后续运动对象帧。 颜色/深度自动应用于整个场景中的掩模，从复合背景和运动对象。 未被运动或前景物体曝光的区域可能部分或完全实际绘制/渲染/应用于遮挡区域，并在整个图像中应用，以在2D-> 3D转换期间生成无伪影次要视点。 迭代工作流程通过实时处理图像来消除简单的伪像纠正，避免重新渲染图像，并将工作产品发送到其他工作组进行更正的相关延迟。

公开(公告)号：US08078006B1

公开(公告)日：2011-12-13

申请号：US12916637

申请日：2010-11-01

Applicant: Barry Sandrew ,  Tony Baldridge

Inventor： Barry Sandrew ,  Tony Baldridge

IPC: G06K9/32

CPC classification number: H04N9/43 ,  G06T11/001

Abstract: Motion picture scenes to be colorized/depth enhanced (2D→3D) are broken into separate elements, backgrounds/sets or motion/onscreen-action. Background and motion elements are combined into composite frame which becomes a visual reference database that includes data for all frame offsets used later for the computer controlled application of masks within a sequence of frames. Masks are applied to subsequent frames of motion objects based on various differentiating image processing methods, including automated mask fitting/reshaping. Colors and/or depths are automatically applied to masks throughout a scene from the composite background and to motion objects. Areas never exposed by motion or foreground objects in a series of images may be partially or fully realistically drawn or rendered and applied to the occluded areas of the background and then automatically applied throughout the images to generate of minimal artifact or artifact-free secondary viewpoints when translating foreground objects horizontally during 2D→3D conversion.

Abstract translation: 要被着色/深度增强的动态影像场景（2D→3D）被分为单独的元素，背景/集合或运动/屏幕动作。 背景和运动元素被组合成复合帧，其成为视觉参考数据库，其包括用于稍后在计算机控制的帧序列内的掩码的所有帧偏移的数据。 基于各种差异化图像处理方法，包括自动掩模拟合/重新成形，将掩模应用于后续运动对象帧。 颜色和/或深度自动应用于从复合背景和运动对象的整个场景中的蒙版。 一系列图像中未被运动或前景物体暴露的区域可能部分或完全实际绘制或渲染并应用于背景的遮挡区域，然后自动应用于整个图像，以产生最小的伪像或无伪影次要视点， 在2D→3D转换期间水平地翻译前景对象。

公开(公告)号：US08073247B1

公开(公告)日：2011-12-06

申请号：US12916636

申请日：2010-11-01

Applicant: Barry Sandrew ,  Tony Baldridge

Inventor： Barry Sandrew ,  Tony Baldridge

IPC: G06K9/00

CPC classification number: H04N9/43 ,  G06T11/001

Abstract: Motion picture scenes to be colorized/depth enhanced (2D->3D) are broken into separate elements, backgrounds/sets or motion/onscreen-action. Background and motion elements are combined into composite frame which becomes a visual reference database that includes data for all frame offsets used later for the computer controlled application of masks within a sequence of frames. Masks are applied to subsequent frames of motion objects based on various differentiating image processing methods, including automated mask fitting/reshaping. Colors and/or depths are automatically applied to masks throughout a scene from the composite background and to motion objects. Areas never exposed by motion or foreground objects in a series of images may be partially or fully realistically drawn or rendered and applied to the occluded areas of the background and then automatically applied throughout the images to generate of minimal artifact or artifact-free secondary viewpoints when translating foreground objects horizontally during 2D->3D conversion.

Abstract translation: 要进行着色/深度增强的动态影像场景（2D-> 3D）分为单独的元素，背景/集合或运动/屏幕动作。 背景和运动元素被组合成复合帧，其成为视觉参考数据库，其包括用于稍后在计算机控制的帧序列内的掩码的所有帧偏移的数据。 基于各种差异化图像处理方法，包括自动掩模拟合/重新成形，将掩模应用于后续运动对象帧。 颜色和/或深度自动应用于从复合背景和运动对象的整个场景中的蒙版。 一系列图像中未被运动或前景物体暴露的区域可能部分或完全实际绘制或渲染并应用于背景的遮挡区域，然后自动应用于整个图像，以产生最小的伪像或无伪影次要视点， 在2D-> 3D转换期间水平地翻译前景对象。

公开(公告)号：US20120063681A1

公开(公告)日：2012-03-15

申请号：US12913614

申请日：2010-10-27

Applicant: Barry SANDREW ,  Tony Baldridge

Inventor： Barry SANDREW ,  Tony Baldridge

IPC: G06K9/00

CPC classification number: G06T11/001 ,  G06T5/005 ,  G06T2207/10028 ,  H04N9/43 ,  H04N13/257 ,  H04N13/266

Abstract: Motion picture scenes to be colorized/depth enhanced (2D->3D) are broken into separate elements, backgrounds/sets or motion/onscreen-action. Background and motion elements are combined into composite frame which becomes a visual reference database that includes data for all frame offsets used later for the computer controlled application of masks within a sequence of frames. Masks are applied to subsequent frames of motion objects based on various differentiating image processing methods, including automated mask fitting/reshaping. Colors and/or depths are automatically applied to masks throughout a scene from the composite background and to motion objects. Areas never exposed by motion or foreground objects in a series of images may be partially or fully realistically drawn or rendered and applied to the occluded areas of the background and then automatically applied throughout the images to generate of minimal artifact or artifact-free secondary viewpoints when translating foreground objects horizontally during 2D->3D conversion.

Abstract translation: 要进行着色/深度增强的动态影像场景（2D-> 3D）分为单独的元素，背景/集合或运动/屏幕动作。 背景和运动元素被组合成复合帧，其成为视觉参考数据库，其包括用于稍后在计算机控制的帧序列内的掩码的所有帧偏移的数据。 基于各种差异化图像处理方法，包括自动掩模拟合/重新成形，将掩模应用于后续运动对象帧。 颜色和/或深度自动应用于从复合背景和运动对象的整个场景中的蒙版。 一系列图像中未被运动或前景物体暴露的区域可能部分或完全实际绘制或渲染并应用于背景的遮挡区域，然后自动应用于整个图像，以产生最小的伪像或无伪影次要视点， 在2D-> 3D转换期间水平地翻译前景对象。

公开(公告)号：US07907793B1

公开(公告)日：2011-03-15

申请号：US12542498

申请日：2009-08-17

Applicant: Barry Sandrew

Inventor： Barry Sandrew

IPC: G06K9/36

CPC classification number: H04N9/43 ,  G06T11/001

Abstract: Motion picture scenes to be colorized/depth enhanced (2D→3D) are broken into separate elements, backgrounds/sets or motion/onscreen-action. Background and motion elements are combined separately into single frame representations of multiple frames which becomes a visual reference database that includes data for all frame offsets used later for the computer controlled application of masks within a sequence of frames. Each pixel address within the database corresponds to a mask/lookup table address within the digital frame and X, Y, Z location of subsequent frames. Masks are applied to subsequent frames of motion objects based on various differentiating image processing methods, including automated mask fitting of all masks or single masks in an entire frame, bezier and polygon tracing of selected regions with edge detected shaping and operator directed detection of subsequent regions. Colors and/or depths are automatically applied to masks throughout a scene from the composite background and to motion objects.

Abstract translation: 要被着色/深度增强的动态影像场景（2D→3D）被分为单独的元素，背景/集合或运动/屏幕动作。 背景和运动元素被分别组合成多个帧的单帧表示，其成为视觉参考数据库，该视觉参考数据库包括稍后用于帧序列内的计算机控制的掩码应用的所有帧偏移的数据。 数据库内的每个像素地址对应于数字帧内的掩码/查找表地址，后续帧的X，Y，Z位置。 基于各种差异化图像处理方法将掩码应用于后续的运动对象帧，包括在整个帧中的所有掩模或单个掩模的自动掩码拟合，具有边缘检测整形的所选区域的贝塞尔和多边形跟踪以及后续区域的操作者定向检测 。 颜色和/或深度自动应用于从复合背景和运动对象的整个场景中的蒙版。

公开(公告)号：US20080219641A1

公开(公告)日：2008-09-11

申请号：US11925620

申请日：2007-10-26

Applicant: Barry Sandrew ,  Mark Bevins

Inventor： Barry Sandrew ,  Mark Bevins

IPC: H04N7/087

CPC classification number: H04N21/4307 ,  G11B27/10 ,  G11B27/105 ,  G11B27/28 ,  H04N5/91 ,  H04N9/806 ,  H04N9/8205

Abstract: Synchronizes a secondary audio track to a video. Analyzes at least one track of a video using audio frequency analysis or spectrograms, image analysis or text analysis to find distinct audio/image/caption events from which to ensure synchronization of a secondary audio track. For example, commentary that mocks a character may be played immediately after a particular noise in the audio track of a video occurs such as a door slam. Keeping the secondary audio track in synch with the audio track of a video is performed by periodically searching for distinct events in a track of a video and adjusting the timing of the secondary audio track. May utilize a sound card on a computer to both analyze a DVD sound track and play and adjust timing of the secondary audio track to maintain synchronization. Secondary audio tracks may be purchased and/or downloaded and utilized to add humorous external commentary to a DVD for example.

Abstract translation: 将辅助音轨同步到视频。 使用音频分析或频谱图，图像分析或文本分析来分析视频的至少一个轨道，以找到不同的音频/图像/字幕事件，从而确保辅助音轨的同步。 例如，在视频的音轨中出现特定的噪声（例如门铃）之后，可以立即播放嘲弄字符的评论。 通过周期性地搜索视频的轨道中的不同事件并且调整辅助音轨的定时，来实现辅助音轨与视频的音轨同步。 可以在计算机上使用声卡来分析DVD声轨，并播放并调整辅助音轨的时序以保持同步。 次要音轨可以购买和/或下载并被用来为例如DVD添加幽默的外部评论。

公开(公告)号：US20060171584A1

公开(公告)日：2006-08-03

申请号：US11324815

申请日：2006-01-04

Applicant: Barry Sandrew

Inventor： Barry Sandrew

IPC: G06K9/00

CPC classification number: H04N9/43 ,  G06T7/215 ,  G06T7/262 ,  G06T7/37 ,  G06T11/001

Abstract: Motion picture scenes to be colorized are broken into separate elements, backgrounds/sets or motion/onscreen-action. Background and motion elements are combined separately into single frame representations of multiple frames which becomes a visual reference database that includes data for all frame offsets used later for the computer controlled application of masks within a sequence of frames. Each pixel address within the database corresponds to a mask/lookup table address within the digital frame and X, Y, Z location of subsequent frames. Masks are applied to subsequent frames of motion objects based on various differentiating image processing methods, including automated mask fitting of all masks or single masks in an entire frame, bezier and polygon tracing of selected regions with edge detected shaping and operator directed detection of subsequent regions. The gray scale actively determines the mask and corresponding color lookup that is applied in a keying fashion within regions of interest.

公开(公告)号：US20120120054A1

公开(公告)日：2012-05-17

申请号：US13029862

申请日：2011-02-17

Applicant: Jared Sandrew ,  Tony Baldridge ,  Barry Sandrew

Inventor： Jared Sandrew ,  Tony Baldridge ,  Barry Sandrew

IPC: G06T15/00

CPC classification number: H04N13/257 ,  H04N13/266

Abstract: Movies to be colorized/depth enhanced (2D->3D) are broken into backgrounds/sets or motion/onscreen-action. Background and motion elements are combined into composite frame which becomes a visual reference database that includes data for all frame offsets used later for the computer controlled application of masks within a sequence of frames. Masks are applied to subsequent frames of motion objects based on various differentiating image processing methods, including automated mask fitting/reshaping. Colors/depths are automatically applied with masks throughout a scene from the composite background and to motion objects. Areas never exposed by motion or foreground objects may be partially or fully realistically drawn/rendered/applied to the occluded areas and applied throughout the images to generate artifact-free secondary viewpoints during 2D->3D conversion. Iterative workflow is eliminated for simple artifact correction through real-time manipulation of images to avoid re-rendering of images and associated delays of sending work product to other workgroups for correction.

Abstract translation: 要着色/深度增强的电影（2D-> 3D）被分为背景/集合或运动/屏幕动作。 背景和运动元素被组合成复合帧，其成为视觉参考数据库，其包括用于稍后在计算机控制的帧序列内的掩码的所有帧偏移的数据。 基于各种差异化图像处理方法，包括自动掩模拟合/重新成形，将掩模应用于后续运动对象帧。 颜色/深度自动应用于整个场景中的掩模，从复合背景和运动对象。 未被运动或前景物体曝光的区域可能部分或完全实际绘制/渲染/应用于遮挡区域，并在整个图像中应用，以在2D-> 3D转换期间生成无伪影次要视点。 迭代工作流程通过实时处理图像来消除简单的伪像纠正，避免重新渲染图像，并将工作产品发送到其他工作组进行更正的相关延迟。

公开(公告)号：US08160390B1

公开(公告)日：2012-04-17

申请号：US12916638

申请日：2010-11-01

Applicant: Barry Sandrew ,  Tony Baldridge

Inventor： Barry Sandrew ,  Tony Baldridge

IPC: G06K9/20

CPC classification number: G06T11/001 ,  G06T5/005 ,  G06T2207/10028 ,  H04N9/43 ,  H04N13/257 ,  H04N13/266

Abstract: Motion picture scenes to be colorized/depth enhanced (2D→3D) are broken into separate elements, backgrounds/sets or motion/onscreen-action. Background and motion elements are combined into composite frame which becomes a visual reference database that includes data for all frame offsets used later for the computer controlled application of masks within a sequence of frames. Masks are applied to subsequent frames of motion objects based on various differentiating image processing methods, including automated mask fitting/reshaping. Colors and/or depths are automatically applied to masks throughout a scene from the composite background and to motion objects. Areas never exposed by motion or foreground objects in a series of images may be partially or fully realistically drawn or rendered and applied to the occluded areas of the background and then automatically applied throughout the images to generate of minimal artifact or artifact-free secondary viewpoints when translating foreground objects horizontally during 2D→3D conversion.

Abstract translation: 要被着色/深度增强的动态影像场景（2D→3D）被分为单独的元素，背景/集合或运动/屏幕动作。 背景和运动元素被组合成复合帧，其成为视觉参考数据库，其包括用于稍后在计算机控制的帧序列内的掩码的所有帧偏移的数据。 基于各种差异化图像处理方法，包括自动掩模拟合/重新成形，将掩模应用于后续运动对象帧。 颜色和/或深度自动应用于从复合背景和运动对象的整个场景中的蒙版。 一系列图像中未被运动或前景物体暴露的区域可能部分或完全实际绘制或渲染并应用于背景的遮挡区域，然后自动应用于整个图像，以产生最小的伪像或无伪影次要视点， 在2D→3D转换期间水平地翻译前景对象。