公开(公告)号：US09299160B2

公开(公告)日：2016-03-29

申请号：US13532502

申请日：2012-06-25

申请人： James Acquavella ,  David Simons ,  Daniel M. Wilk

发明人： James Acquavella ,  David Simons ,  Daniel M. Wilk

IPC分类号： H04N13/00 ,  G06T7/20 ,  G06T7/00 ,  G06T19/20

CPC分类号： H04N13/257 ,  G06T7/248 ,  G06T7/50 ,  G06T7/579 ,  G06T11/60 ,  G06T15/04 ,  G06T19/20 ,  G06T2207/30244 ,  G06T2219/2012 ,  G06T2219/2016

摘要： One exemplary embodiment involves identifying a plane defined by a plurality of three-dimensional (3D) track points rendered on a two-dimensional (2D) display, wherein the 3D track points are rendered at a plurality of corresponding locations of a video frame. The embodiment also involves displaying a target marker at the plane defined by the 3D track points to allow for visualization of the plane, wherein the target marker is displayed at an angle that corresponds with an angle of the plane. Additionally, the embodiment involves inserting a 3D object at a location in the plane defined by the 3D track points to be embedded into the video frame. The location of the 3D object is based at least in part on the target marker.

摘要翻译： 一个示例性实施例涉及识别由在二维（2D）显示器上呈现的多个三维（3D）轨迹点所定义的平面，其中3D轨迹点在视频帧的多个对应位置呈现。 该实施例还涉及在由3D轨迹点限定的平面上显示目标标记以允许平面的可视化，其中以与该平面的角度对应的角度显示目标标记。 此外，该实施例涉及将3D对象插入由要嵌入到视频帧中的3D轨迹点定义的平面中的位置。 3D对象的位置至少部分地基于目标标记。

公开(公告)号：US09208577B2

公开(公告)日：2015-12-08

申请号：US13532544

申请日：2012-06-25

申请人： James Acquavella ,  David Simons ,  Daniel M. Wilk

发明人： James Acquavella ,  David Simons ,  Daniel M. Wilk

IPC分类号： H04N13/02 ,  G06T7/20 ,  G06T7/00 ,  G06T19/20 ,  G11B27/031

CPC分类号： H04N13/257 ,  G06T7/248 ,  G06T7/579 ,  G06T19/20 ,  G06T2207/30244 ,  G06T2219/2012 ,  G06T2219/2016 ,  G11B27/031

摘要： One exemplary embodiment involves receiving a plurality of three-dimensional (3D) track points for a plurality of frames of a video, wherein the 3D track points are extracted from a plurality of two-dimensional source points. The embodiment further involves rendering the 3D track points across a plurality of frames of the video on a two-dimensional (2D) display. Additionally, the embodiment involves coloring each of the 3D track points wherein the color of each 3D track point visually distinguishes the 3D track point from a plurality of surrounding 3D track points, and wherein the color of each 3D track point is consistent across the frames of the video. The embodiment also involves sizing each of the 3D track points based on a distance between a camera that captured the video and a location of the 2D source points referenced by the respective one of the 3D track points.

摘要翻译： 一个示例性实施例涉及为视频的多个帧接收多个三维（3D）轨道点，其中从多个二维源点提取3D轨迹点。 该实施例还涉及在二维（2D）显示器上使视频的多个帧呈现3D轨迹点。 另外，该实施例涉及对每个3D轨迹点进行着色，其中每个3D轨迹点的颜色可视地区分3D轨迹点与多个周围的3D轨迹点，并且其中每个3D轨迹点的颜色在 视频。 该实施例还涉及基于拍摄视频的相机与由3D轨迹点之一引用的2D源点的位置之间的距离来对每个3D轨迹点进行尺寸调整。

公开(公告)号：US20140285624A1

公开(公告)日：2014-09-25

申请号：US13532544

申请日：2012-06-25

申请人： James Acquavella ,  David Simons ,  Daniel M. Wilk

发明人： James Acquavella ,  David Simons ,  Daniel M. Wilk

IPC分类号： H04N13/02

CPC分类号： H04N13/257 ,  G06T7/248 ,  G06T7/579 ,  G06T19/20 ,  G06T2207/30244 ,  G06T2219/2012 ,  G06T2219/2016 ,  G11B27/031

摘要： One exemplary embodiment involves receiving a plurality of three-dimensional (3D) track points for a plurality of frames of a video, wherein the 3D track points are extracted from a plurality of two-dimensional source points. The embodiment further involves rendering the 3D track points across a plurality of frames of the video on a two-dimensional (2D) display. Additionally, the embodiment involves coloring each of the 3D track points wherein the color of each 3D track point visually distinguishes the 3D track point from a plurality of surrounding 3D track points, and wherein the color of each 3D track point is consistent across the frames of the video. The embodiment also involves sizing each of the 3D track points based on a distance between a camera that captured the video and a location of the 2D source points referenced by the respective one of the 3D track points.

摘要翻译： 一个示例性实施例涉及为视频的多个帧接收多个三维（3D）轨道点，其中从多个二维源点提取3D轨迹点。 该实施例还涉及在二维（2D）显示器上使视频的多个帧呈现3D轨迹点。 另外，该实施例涉及对每个3D轨迹点进行着色，其中每个3D轨迹点的颜色可视地区分3D轨迹点与多个周围3D轨迹点，并且其中每个3D轨迹点的颜色在 视频。 该实施例还涉及基于拍摄视频的相机与由3D轨迹点之一引用的2D源点的位置之间的距离来对每个3D轨迹点进行尺寸调整。

公开(公告)号：US20140285619A1

公开(公告)日：2014-09-25

申请号：US13532502

申请日：2012-06-25

申请人： James Acquavella ,  David Simons ,  Daniel M. Wilk

发明人： James Acquavella ,  David Simons ,  Daniel M. Wilk

IPC分类号： H04N13/00

CPC分类号： H04N13/257 ,  G06T7/248 ,  G06T7/50 ,  G06T7/579 ,  G06T11/60 ,  G06T15/04 ,  G06T19/20 ,  G06T2207/30244 ,  G06T2219/2012 ,  G06T2219/2016

摘要： One exemplary embodiment involves identifying a plane defined by a plurality of three-dimensional (3D) track points rendered on a two-dimensional (2D) display, wherein the 3D track points are rendered at a plurality of corresponding locations of a video frame. The embodiment also involves displaying a target marker at the plane defined by the 3D track points to allow for visualization of the plane, wherein the target marker is displayed at an angle that corresponds with an angle of the plane. Additionally, the embodiment involves inserting a 3D object at a location in the plane defined by the 3D track points to be embedded into the video frame. The location of the 3D object is based at least in part on the target marker.

摘要翻译： 一个示例性实施例涉及识别由在二维（2D）显示器上呈现的多个三维（3D）轨迹点所定义的平面，其中3D轨迹点在视频帧的多个对应位置呈现。 该实施例还涉及在由3D轨迹点限定的平面上显示目标标记以允许平面的可视化，其中以与该平面的角度对应的角度显示目标标记。 此外，该实施例涉及将3D对象插入由要嵌入到视频帧中的3D轨迹点定义的平面中的位置。 3D对象的位置至少部分地基于目标标记。

公开(公告)号：US07656406B1

公开(公告)日：2010-02-02

申请号：US10696740

申请日：2003-10-28

申请人： Jason Bartell ,  Daniel M. Wilk ,  James Acquavella

发明人： Jason Bartell ,  Daniel M. Wilk ,  James Acquavella

IPC分类号： G06T11/20 ,  G09G5/00 ,  G09G5/26 ,  G06T13/00 ,  G06T15/70

CPC分类号： G06T11/001 ,  G06T13/80

摘要： Techniques for representing a stroke in an image, the stroke being defined by a path extending across one or more positions in the image and one or more stroke parameters, each stroke parameter representing an appearance attribute of the stroke. The techniques include associating values for the one or more stroke parameters with time values in a time dimension of the stroke, the parameter values being associated with the time values independent of position along the stroke path; and representing the stroke according to the parameter values and their associated time values.

摘要翻译： 用于表示图像中的笔画的技术，笔画由延伸穿过图像中的一个或多个位置的路径以及一个或多个笔画参数定义，每个笔画参数表示笔画的外观属性。 这些技术包括将一个或多个笔画参数的值与笔画的时间维度中的时间值相关联，该参数值与独立于笔划路径的位置的时间值相关联; 并根据参数值及其相关时间值表示笔画。

公开(公告)号：US06683613B1

公开(公告)日：2004-01-27

申请号：US09221269

申请日：1998-12-23

申请人： David F. Herbstman ,  David P. Simons ,  Daniel M. Wilk

发明人： David F. Herbstman ,  David P. Simons ,  Daniel M. Wilk

IPC分类号： G06T1500

CPC分类号： G06T15/40

摘要： A method of integrating two independent simulations including running a first simulation simulating changes in an object over time. The first simulation includes a first simulation output reflective of a state of the first simulation at one or more predefined times. A second simulation is run concurrently simulating changes in a second object over time. An interaction between the first and second simulations is defined resulting in an integrated simulation output without affecting the first simulation state.

摘要翻译： 一种集成两个独立模拟的方法，包括运行模拟物体随时间变化的第一个模拟。 第一模拟包括在一个或多个预定时间反映第一模拟的状态的第一模拟输出。 同时运行第二个模拟模拟第二个对象随着时间的变化。 定义第一和第二模拟之间的相互作用，导致集成模拟输出而不影响第一模拟状态。

公开(公告)号：US08520975B2

公开(公告)日：2013-08-27

申请号：US12871719

申请日：2010-08-30

申请人： Jue Wang ,  David P. Simons ,  Daniel M. Wilk ,  Xue Bai

发明人： Jue Wang ,  David P. Simons ,  Daniel M. Wilk ,  Xue Bai

IPC分类号： G06K9/34 ,  G06K9/00 ,  G06K9/62 ,  G06K9/20 ,  G06K9/36 ,  H04N1/387 ,  H04N5/225 ,  H04N7/12 ,  H04N11/02 ,  H04N11/04 ,  H04B1/66 ,  G09G5/00

CPC分类号： G06T7/20 ,  G06K9/6277 ,  G06T7/12 ,  G06T7/143 ,  G06T7/149 ,  G06T2207/10024 ,  G06T2207/20121 ,  G06T2207/20124 ,  G06T2207/30196

摘要： Systems, methods, and computer-readable storage media for chatter reduction in video object segmentation using optical flow assisted gaussholding. An optical flow assisted gaussholding method may be applied to segmentation masks generated for a video sequence. For each frame of at least some frames in a video sequence, for each of one or more other frames prior to and one or more other frames after the current frame, optical flow is computed for the other frame in relation to the current frame and used to warp the contour of the segmentation mask of the other frame to generate warped segmentation mask for the other frames. The weighted average of the warpedsegmentation masks and the segmentation mask of the current frame is then computed; this weighted average may be blurred spatially, for example using a Gaussian filter. The initial smoothed mask may be thresholded to produce a binary smoothed mask.

摘要翻译： 系统，方法和计算机可读存储介质，用于使用光流辅助高斯跟踪的视频对象分割中的抖动减少。 可以将光流辅助高斯跟踪方法应用于为视频序列生成的分割掩码。 对于视频序列中的至少一些帧的每帧，对于在当前帧之前和之后的一个或多个其他帧之前的一个或多个其他帧中的每一帧，针对当前帧针对另一帧计算光流，并使用 以扭曲另一帧的分割掩模的轮廓以产生其他帧的翘曲分割掩码。 然后计算翘曲分割蒙版的加权平均值和当前帧的分割蒙版; 该加权平均值可能在空间上模糊，例如使用高斯滤波器。 初始平滑掩模可以被阈值化以产生二进制平滑掩模。

公开(公告)号：US5917549A

公开(公告)日：1999-06-29

申请号：US693943

申请日：1996-08-07

申请人： David P. Simons ,  Scott S. Snibbe ,  Daniel M. Wilk

发明人： David P. Simons ,  Scott S. Snibbe ,  Daniel M. Wilk

IPC分类号： G06T3/40 ,  H04N5/262 ,  H04N7/01 ,  H04N9/74

CPC分类号： H04N7/01 ,  G06T3/40 ,  H04N5/2628

摘要： A method for compositing first and second digital images having different pixel aspect ratios to reduce distortion of image content. The method includes determining a scaling factor from first and second pixel aspect ratios; scaling a first image by the scaling factor; and compositing the first and second images into a composite image. The scaling step may be limited to stretching or squashing the first image in only a horizontal direction. The scaling step may include resampling the first image. In another aspect, the invention features a method for controlling motion along a motion path in a composition having nonsquare pixels. The method includes determining a scaling factor based on the composition pixel aspect ratio; applying the scaling factor to a copy of the motion path; reparameterizing the copy of the motion path to generate a scaled motion mapping; and using the scaled motion mapping to control motion along the motion path. The motion path may define the motion of a layer in the composition.

摘要翻译： 一种用于合成具有不同像素宽高比的第一和第二数字图像以减少图像内容的失真的方法。 该方法包括从第一和第二像素长宽比确定缩放因子; 按比例因子缩放第一个图像; 并将第一和第二图像合成为合成图像。 缩放步骤可以仅限于在水平方向上拉伸或挤压第一图像。 缩放步骤可以包括重新采样第一图像。 在另一方面，本发明的特征在于一种用于在具有非正方形像素的组合物中沿着运动路径控制运动的方法。 该方法包括基于合成像素长宽比来确定缩放因子; 将缩放因子应用于运动路径的副本; 重新参数化运动路径的副本以生成缩放的运动映射; 并且使用缩放的运动映射来控制沿运动路径的运动。 运动路径可以限定组合物中的层的运动。

公开(公告)号：US20130121577A1

公开(公告)日：2013-05-16

申请号：US12871719

申请日：2010-08-30

申请人： Jue Wang ,  David P. Simons ,  Daniel M. Wilk ,  Xue Bai

发明人： Jue Wang ,  David P. Simons ,  Daniel M. Wilk ,  Xue Bai

IPC分类号： G06K9/34

CPC分类号： G06T7/20 ,  G06K9/6277 ,  G06T7/12 ,  G06T7/143 ,  G06T7/149 ,  G06T2207/10024 ,  G06T2207/20121 ,  G06T2207/20124 ,  G06T2207/30196

摘要： Systems, methods, and computer-readable storage media for chatter reduction in video object segmentation using optical flow assisted gaussholding. An optical flow assisted gaussholding method may be applied to segmentation masks generated for a video sequence. For each frame of at least some frames in a video sequence, for each of one or more other frames prior to and one or more other frames after the current frame, optical flow is computed for the other frame in relation to the current frame and used to warp the contour of the segmentation mask of the other frame to generate warped segmentation mask for the other frames. The weighted average of the warpedsegmentation masks and the segmentation mask of the current frame is then computed; this weighted average may be blurred spatially, for example using a Gaussian filter. The initial smoothed mask may be thresholded to produce a binary smoothed mask.

摘要翻译： 系统，方法和计算机可读存储介质，用于使用光流辅助高斯跟踪的视频对象分割中的抖动减少。 光流辅助高斯保留方法可以应用于为视频序列生成的分割掩码。 对于视频序列中的至少一些帧的每帧，对于在当前帧之前和之后的一个或多个其他帧之前的一个或多个其他帧中的每一帧，针对当前帧针对另一帧计算光流，并使用 以扭曲另一帧的分割掩模的轮廓以产生其他帧的翘曲分割掩码。 然后计算翘曲分割蒙版的加权平均值和当前帧的分割蒙版; 该加权平均值可能在空间上模糊，例如使用高斯滤波器。 初始平滑掩模可以被阈值化以产生二进制平滑掩模。

公开(公告)号：US08358691B1

公开(公告)日：2013-01-22

申请号：US12871724

申请日：2010-08-30

申请人： Jue Wang ,  David P. Simons ,  Daniel M. Wilk ,  Xue Bai

发明人： Jue Wang ,  David P. Simons ,  Daniel M. Wilk ,  Xue Bai

IPC分类号： H04N7/26 ,  G06K9/00 ,  G06K9/48

CPC分类号： G06T7/20 ,  G06K9/6277 ,  G06T7/12 ,  G06T7/143 ,  G06T7/149 ,  G06T2207/10024 ,  G06T2207/20121 ,  G06T2207/20124 ,  G06T2207/30196

摘要： Systems, methods, and computer-readable storage media for chatter reduction in video object segmentation using a variable bandwidth search region. A variable bandwidth search region generation method may be applied to a uniform search region to generate a variable bandwidth search region that reduces the search range for segmentation methods such as a graph cut method. The method may identify parts of the contour that are moving slowly, and reduce the search region bandwidth in those places to stabilize the segmentation. This method may determine a bandwidth for each of a plurality of local windows of an image according to an estimate of how much an object in the image has moved from a previous image. The method may blend the bandwidths for the plurality of local windows to generate a blended map. The method may then generate a variable bandwidth search region for an object according to the blended map.