公开(公告)号：US08655069B2

公开(公告)日：2014-02-18

申请号：US12718343

申请日：2010-03-05

Applicant: Carsten Curt Eckard Rother ,  Toby Sharp ,  Andrew Blake ,  Vladimir Kolmogorov

Inventor： Carsten Curt Eckard Rother ,  Toby Sharp ,  Andrew Blake ,  Vladimir Kolmogorov

IPC: G06K9/34

CPC classification number: G06K9/34

Abstract: Methods of updating image segmentation following user input are described. In an embodiment, the properties used in computing the different portions of the image are updated as a result of one or more user inputs. Image elements which have been identified by a user input are given more weight when updating the properties than other image elements which have already been assigned to a particular portion of the image. In another embodiment, an updated segmentation is post-processed such that only regions which are connected to an appropriate user input are updated.

Abstract translation: 描述用户输入后更新图像分割的方法。 在一个实施例中，用于计算图像的不同部分的属性被更新为一个或多个用户输入的结果。 当已经被分配给图像的特定部分的其他图像元素更新时，由用户输入识别的图像元素被赋予更多的权重。 在另一个实施例中，更新的分段被后处理，使得仅更新连接到适当的用户输入的区域。

公开(公告)号：US20120257814A1

公开(公告)日：2012-10-11

申请号：US13083271

申请日：2011-04-08

Applicant: Pushmeet KOHLI ,  Toby SHARP ,  Carsten Curt Eckard ROTHER

Inventor： Pushmeet KOHLI ,  Toby SHARP ,  Carsten Curt Eckard ROTHER

IPC: G06K9/36 ,  G06K9/00

CPC classification number: G06T5/005 ,  G06T2207/10004 ,  G06T2207/10024 ,  G06T2207/10028

Abstract: Image completion using scene geometry is described, for example, to remove marks from digital photographs or complete regions which are blank due to editing. In an embodiment an image depicting, from a viewpoint, a scene of textured objects has regions to be completed. In an example, geometry of the scene is estimated from a depth map and the geometry used to warp the image so that at least some surfaces depicted in the image are fronto-parallel to the viewpoint. An image completion process is guided using distortion applied during the warping. For example, patches used to fill the regions are selected on the basis of distortion introduced by the warping. In examples where the scene comprises regions having only planar surfaces the warping process comprises rotating the image. Where the scene comprises non-planar surfaces, geodesic distances between image elements may be scaled to flatten the non-planar surfaces.

Abstract translation: 描述使用场景几何的图像完成，例如，从数字照片或由于编辑而为空的完整区域中移除标记。 在一个实施例中，从视点描绘纹理对象的场景的图像具有要完成的区域。 在一个示例中，从深度图和用于扭曲图像的几何估计场景的几何形状，使得图像中描绘的至少一些表面与视点平行。 使用在翘曲期间施加的变形来指导图像完成处理。 例如，基于由翘曲引入的失真来选择用于填充区域的补丁。 在场景包括仅具有平面表面的区域的示例中，翘曲过程包括旋转图像。 在场景包括非平面表面的情况下，图像元素之间的测地距离可以被缩放以平坦化非平面表面。

公开(公告)号：US20100272367A1

公开(公告)日：2010-10-28

申请号：US12431421

申请日：2009-04-28

Applicant: Antonio Criminisi ,  Toby Sharp

Inventor： Antonio Criminisi ,  Toby Sharp

IPC: G06K9/46

CPC classification number: G06K9/6215 ,  G06T11/001

Abstract: Image processing using geodesic forests is described. In an example, a geodesic forest engine determines geodesic shortest-path distances between each image element and a seed region specified in the image in order to form a geodesic forest data structure. The geodesic distances take into account gradients in the image of a given image modality such as intensity, color, or other modality. In some embodiments, a 1D processing engine carries out 1D processing along the branches of trees in the geodesic forest data structure to form a processed image. For example, effects such as ink painting, edge-aware texture flattening, contrast-aware image editing, forming animations using geodesic forests and other effects are achieved using the geodesic forest data structure. In some embodiments the geodesic forest engine uses a four-part raster scan process to achieve real-time processing speeds and parallelization is possible in many of the embodiments.

Abstract translation: 描述了使用测地森林进行图像处理。 在一个示例中，测地森林引擎确定每个图像元素与图像中指定的种子区域之间的测距最短路径距离，以形成测地森林数据结构。 测距距离考虑了给定图像形态（如强度，颜色或其他形式）图像中的渐变。 在一些实施例中，1D处理引擎沿着测地森林数据结构中的树的分支执行1D处理，以形成经处理的图像。 例如，使用测地森林数据结构实现诸如水墨绘画，边缘感知纹理平整，对比度感知图像编辑，使用测地森林形成动画等效果。 在一些实施例中，测地森林引擎使用四部分光栅扫描过程来实现实时处理速度，并且在许多实施例中并行化是可能的。

公开(公告)号：US20100094800A1

公开(公告)日：2010-04-15

申请号：US12248536

申请日：2008-10-09

Applicant: Toby Sharp

Inventor： Toby Sharp

IPC: G06F17/00

CPC classification number: G06N99/005

Abstract: Methods and apparatus for evaluating decision trees on a GPU are described. In an embodiment, the structure of a decision tree is converted into a 2D “tree” array with each row representing a node in the tree. Each row comprises details of any child nodes and the parameters which are required to perform the binary test at the node. A pixel shader can then be used to evaluate the decision tree in parallel for each input data point in an input array by navigating through rows in the 2D tree array. For each row, data is read from the input array dependent upon the parameters in the row and the shader moves to another row dependent upon the result of the binary test. On reaching a row which represents a leaf node, the pixel shader outputs evaluation results, such as a leaf node index or a probability distribution over classes.

Abstract translation: 描述了用于评估GPU上的决策树的方法和装置。 在一个实施例中，将决策树的结构转换为2D“树”数组，每行表示树中的节点。 每行包括任何子节点的细节和在节点执行二进制测试所需的参数。 然后可以使用像素着色器通过在2D树数组中的行进行导航来并行计算输入数组中每个输入数据点的决策树。 对于每一行，取决于行中的参数，从输入数组读取数据，并且着色器根据二进制测试的结果移动到另一行。 在到达表示叶节点的行时，像素着色器输出评估结果，例如叶节点索引或类上的概率分布。

公开(公告)号：US08605992B2

公开(公告)日：2013-12-10

申请号：US13083271

申请日：2011-04-08

Applicant: Pushmeet Kohli ,  Toby Sharp ,  Carsten Curt Eckard Rother

Inventor： Pushmeet Kohli ,  Toby Sharp ,  Carsten Curt Eckard Rother

IPC: G06K9/00 ,  G06K9/40 ,  G06T15/00 ,  G06T15/40 ,  H04N5/89

CPC classification number: G06T5/005 ,  G06T2207/10004 ,  G06T2207/10024 ,  G06T2207/10028

Abstract: Image completion using scene geometry is described, for example, to remove marks from digital photographs or complete regions which are blank due to editing. In an embodiment an image depicting, from a viewpoint, a scene of textured objects has regions to be completed. In an example, geometry of the scene is estimated from a depth map and the geometry used to warp the image so that at least some surfaces depicted in the image are fronto-parallel to the viewpoint. An image completion process is guided using distortion applied during the warping. For example, patches used to fill the regions are selected on the basis of distortion introduced by the warping. In examples where the scene comprises regions having only planar surfaces the warping process comprises rotating the image. Where the scene comprises non-planar surfaces, geodesic distances between image elements may be scaled to flatten the non-planar surfaces.

Abstract translation: 描述使用场景几何的图像完成，例如，从数字照片或由于编辑而为空的完整区域中移除标记。 在一个实施例中，从视点描绘纹理对象的场景的图像具有要完成的区域。 在一个示例中，从深度图和用于扭曲图像的几何估计场景的几何形状，使得图像中描绘的至少一些表面与视点平行。 使用在翘曲期间施加的变形来指导图像完成处理。 例如，基于由翘曲引入的失真来选择用于填充区域的补丁。 在场景包括仅具有平面表面的区域的示例中，翘曲过程包括旋转图像。 在场景包括非平面表面的情况下，图像元素之间的测地距离可以被缩放以平坦化非平面表面。

公开(公告)号：US08290295B2

公开(公告)日：2012-10-16

申请号：US12396590

申请日：2009-03-03

Applicant: Antonio Criminisi ,  Evgeny Salnikov ,  Toby Sharp

Inventor： Antonio Criminisi ,  Evgeny Salnikov ,  Toby Sharp

IPC: G06K9/38

CPC classification number: G06K9/38 ,  G06T5/009 ,  G06T5/40 ,  G06T2207/10032 ,  G06T2207/10081 ,  G06T2207/20208 ,  G06T2207/30004 ,  G06T2207/30181

Abstract: A system for multi-modal mapping of images is described. Embodiments are described where the image mapping system is used for visualizing high dynamic range images such as medical images, satellite images, high dynamic range photographs and the like and also for compressing such images. In examples, high bit-depth images are tone-mapped for display on equipment of lower bit-depth without loss of detail. In embodiments, the image mapping system computes statistics describing an input image and fits a multi-modal model to those statistics efficiently. In embodiments, the multi-modal model is a Gaussian mixture model and a plurality of sigmoid functions corresponding to the multi-modal model are obtained. In an embodiment the sigmoid functions are added to form a tone-mapping function which is used to transform a high bit-depth image such as 16 or 12 bits per pixel to a low bit-depth image such as 8 bits per pixel.

Abstract translation: 描述了用于图像的多模态映射的系统。 描述实施例，其中图像映射系统用于可视化诸如医学图像，卫星图像，高动态范围照片等的高动态范围图像，并且还用于压缩这样的图像。 在示例中，高位深图像被色调映射以便在较低位深度的设备上显示而不损失细节。 在实施例中，图像映射系统计算描述输入图像的统计量，并将多模态模型有效地适应于这些统计。 在实施例中，多模态模型是高斯混合模型，并且获得对应于多模态模型的多个S形函数。 在一个实施例中，添加S形功能以形成色调映射功能，其用于将诸如每像素16或12位的高位深度图像变换为诸如每像素8位的低位深度图像。

公开(公告)号：US20110228055A1

公开(公告)日：2011-09-22

申请号：US12728921

申请日：2010-03-22

Applicant: Toby Sharp

Inventor： Toby Sharp

IPC: G06T15/10 ,  H04N13/04

CPC classification number: G06T15/06 ,  G06T15/08 ,  H04N13/275

Abstract: Space skipping for multi-dimensional image rendering is described. In an embodiment a ray-casting engine is used to form a two dimensional image from an at least three dimensional image volume by computing rays extending from a camera location, through the two dimensional image and into the volume. For example, a space skipping logic is used to clip the rays such that computationally expensive aspects of ray-casting only need to be performed along the clipped rays. For example a volume pyramid is formed by repeatedly reducing the resolution of the volume data. In an example, each ray is intersected with the lowest resolution volume of the pyramid and clipped using data from that volume. In examples, the clipping is then repeated at higher resolutions in order to clip the ray closely to non-transparent voxels in the volume and optimize the task of rendering the image.

Abstract translation: 描述了用于多维图像渲染的空间跳过。 在一个实施例中，射线铸造引擎用于通过计算从相机位置延伸通过二维图像并进入体积的从至少三维图像体积形成二维图像。 例如，空间跳过逻辑用于剪切光线，使得射线投射的计算上昂贵的方面仅需要沿着剪切的射线执行。 例如，通过重复地降低体数据的分辨率来形成体积金字塔。 在一个示例中，每个射线与金字塔的最低分辨率体积相交，并使用来自该卷的数据进行剪切。 在示例中，然后以更高分辨率重复剪辑，以将光线紧密地剪切到体积中的不透明体素，并优化渲染图像的任务。

公开(公告)号：US20110216975A1

公开(公告)日：2011-09-08

申请号：US12718232

申请日：2010-03-05

Applicant: Carsten Curt Eckard Rother ,  Toby Sharp

Inventor： Carsten Curt Eckard Rother ,  Toby Sharp

IPC: G06K9/34 ,  G06T17/00

CPC classification number: G06T7/0079 ,  G06K9/34 ,  G06T3/40 ,  G06T7/11 ,  G06T7/136 ,  G06T17/00

Abstract: A method of up-sampling binary images for segmentation is described. In an embodiment, digital images are down-sampled before segmentation. The resulting initial binary segmentation, which has a lower resolution than the original image, is then up-sampled and smoothed to generate an interim non-binary solution which has a higher resolution than the initial binary segmentation. The final binary segmentation for the image is then computed from the interim non-binary solution based on a threshold. This method does not use the original image data in inferring the final binary segmentation solution from the initial binary segmentation. In an embodiment, the method may be applied to all images and in another embodiment, the method may be used for images which comprise a large number of pixels in total or in single dimension and smaller images may not be down-sampled before segmentation.

Abstract translation: 描述了用于分割的二进制图像的上采样方法。 在一个实施例中，在分割之前对数字图像进行下采样。 然后，所得到的具有比原始图像更低分辨率的初始二进制分割被上采样和平滑以产生具有比初始二进制分割更高分辨率的临时非二进制解。 然后基于阈值从临时非二进制解决方案计算图像的最终二进制分割。 该方法不使用原始图像数据从最初的二进制分割推断最终的二进制分割解决方案。 在一个实施例中，该方法可以应用于所有图像，并且在另一个实施例中，该方法可以用于总共或单维度中包含大量像素的图像，并且在分割之前可能不会对较小的图像进行下采样。

公开(公告)号：US20100226547A1

公开(公告)日：2010-09-09

申请号：US12396590

申请日：2009-03-03

Applicant: Antonio Criminisi ,  Evgeny Salnikov ,  Toby Sharp

Inventor： Antonio Criminisi ,  Evgeny Salnikov ,  Toby Sharp

IPC: G06K9/00

CPC classification number: G06K9/38 ,  G06T5/009 ,  G06T5/40 ,  G06T2207/10032 ,  G06T2207/10081 ,  G06T2207/20208 ,  G06T2207/30004 ,  G06T2207/30181

Abstract: A system for multi-modal mapping of images is described. Embodiments are described where the image mapping system is used for visualizing high dynamic range images such as medical images, satellite images, high dynamic range photographs and the like and also for compressing such images. In examples, high bit-depth images are tone-mapped for display on equipment of lower bit-depth without loss of detail. In embodiments, the image mapping system computes statistics describing an input image and fits a multi-modal model to those statistics efficiently. In embodiments, the multi-modal model is a Gaussian mixture model and a plurality of sigmoid functions corresponding to the multi-modal model are obtained. In an embodiment the sigmoid functions are added to form a tone-mapping function which is used to transform a high bit-depth image such as 16 or 12 bits per pixel to a low bit-depth image such as 8 bits per pixel.

Abstract translation: 描述了用于图像的多模态映射的系统。 描述实施例，其中图像映射系统用于可视化诸如医学图像，卫星图像，高动态范围照片等的高动态范围图像，并且还用于压缩这样的图像。 在示例中，高位深图像被色调映射以便在较低位深度的设备上显示而不损失细节。 在实施例中，图像映射系统计算描述输入图像的统计量，并将多模态模型有效地适应于这些统计。 在实施例中，多模态模型是高斯混合模型，并且获得对应于多模态模型的多个S形函数。 在一个实施例中，添加S形功能以形成色调映射功能，其用于将诸如每像素16或12位的高位深度图像变换为诸如每像素8位的低位深度图像。