-
公开(公告)号:US08411948B2
公开(公告)日:2013-04-02
申请号:US12718232
申请日:2010-03-05
Applicant: Carsten Curt Eckard Rother , Toby Sharp
Inventor: Carsten Curt Eckard Rother , Toby Sharp
Abstract: A method of up-sampling binary images for segmentation is described. In an embodiment, digital images are down-sampled before segmentation. The resulting initial binary segmentation, which has a lower resolution than the original image, is then up-sampled and smoothed to generate an interim non-binary solution which has a higher resolution than the initial binary segmentation. The final binary segmentation for the image is then computed from the interim non-binary solution based on a threshold. This method does not use the original image data in inferring the final binary segmentation solution from the initial binary segmentation. In an embodiment, the method may be applied to all images and in another embodiment, the method may be used for images which comprise a large number of pixels in total or in single dimension and smaller images may not be down-sampled before segmentation.
Abstract translation: 描述了用于分割的二进制图像的上采样方法。 在一个实施例中,在分割之前对数字图像进行下采样。 然后,所得到的具有比原始图像更低分辨率的初始二进制分割被上采样和平滑以产生具有比初始二进制分割更高分辨率的临时非二进制解。 然后基于阈值从临时非二进制解决方案计算图像的最终二进制分割。 该方法不使用原始图像数据从最初的二进制分割推断最终的二进制分割解决方案。 在一个实施例中,该方法可以应用于所有图像,并且在另一个实施例中,该方法可以用于总共或单维度中包含大量像素的图像,并且在分割之前可能不会对较小的图像进行下采样。
-
公开(公告)号:US08351654B2
公开(公告)日:2013-01-08
申请号:US12431421
申请日:2009-04-28
Applicant: Antonio Criminisi , Toby Sharp
Inventor: Antonio Criminisi , Toby Sharp
CPC classification number: G06K9/6215 , G06T11/001
Abstract: Image processing using geodesic forests is described. In an example, a geodesic forest engine determines geodesic shortest-path distances between each image element and a seed region specified in the image in order to form a geodesic forest data structure. The geodesic distances take into account gradients in the image of a given image modality such as intensity, color, or other modality. In some embodiments, a 1D processing engine carries out 1D processing along the branches of trees in the geodesic forest data structure to form a processed image. For example, effects such as ink painting, edge-aware texture flattening, contrast-aware image editing, forming animations using geodesic forests and other effects are achieved using the geodesic forest data structure. In some embodiments the geodesic forest engine uses a four-part raster scan process to achieve real-time processing speeds and parallelization is possible in many of the embodiments.
Abstract translation: 描述了使用测地森林进行图像处理。 在一个示例中,测地森林引擎确定每个图像元素与图像中指定的种子区域之间的测距最短路径距离,以形成测地森林数据结构。 测距距离考虑了给定图像形态(如强度,颜色或其他形式)图像中的渐变。 在一些实施例中,1D处理引擎沿着测地森林数据结构中的树的分支执行1D处理,以形成经处理的图像。 例如,使用测地森林数据结构实现诸如水墨绘画,边缘感知纹理平整,对比度感知图像编辑,使用测地森林形成动画等效果。 在一些实施例中,测地森林引擎使用四部分光栅扫描过程来实现实时处理速度,并且在许多实施例中并行化是可能的。
-
公开(公告)号:US20120166462A1
公开(公告)日:2012-06-28
申请号:US12979362
申请日:2010-12-28
Applicant: Sayan D. Pathak , Antonio Criminisi , Steven J. White , Liqun Fu , Khan M. Siddiqui , Toby Sharp , Ender Konukoglu , Bryan Dove , Michael T. Gillam
Inventor: Sayan D. Pathak , Antonio Criminisi , Steven J. White , Liqun Fu , Khan M. Siddiqui , Toby Sharp , Ender Konukoglu , Bryan Dove , Michael T. Gillam
CPC classification number: G06F3/04845 , G06F3/04842 , G06F9/451 , G06F19/321 , G16H15/00 , G16H40/63
Abstract: The present discussion relates to automated image data processing and visualization. One example can facilitate generating a graphical user-interface (GUI) from image data that includes multiple semantically-labeled user-selectable anatomical structures. This example can receive a user selection of an individual semantically-labeled user-selectable anatomical structure. The example can locate a sub-set of the image data associated with the individual semantically-labeled user-selectable anatomical structure and can cause presentation of the sub-set of the image data on a subsequent GUI.
Abstract translation: 本发明涉及自动图像数据处理和可视化。 一个示例可以有助于从包括多个语义标记的用户可选解剖结构的图像数据生成图形用户界面(GUI)。 该示例可以接收用户选择单个语义标记的用户可选择的解剖结构。 该示例可以定位与单独的语义标记的用户可选择的解剖结构相关联的图像数据的子集,并且可以在随后的GUI上引起图像数据的子集的呈现。
-
公开(公告)号:US20110141121A1
公开(公告)日:2011-06-16
申请号:US12635861
申请日:2009-12-11
Applicant: Toby Sharp , Antonio Criminisi
Inventor: Toby Sharp , Antonio Criminisi
IPC: G06F15/80
CPC classification number: G06T17/10 , A63F2300/1087 , G06F17/10 , G06T5/30 , G06T2207/20041
Abstract: Parallel processing for distance transforms is described. In an embodiment a raster scan algorithm is used to compute a distance transform such that each image element of a distance image is assigned a distance value. This distance value is a shortest distance from the image element to the seed region. In an embodiment two threads execute in parallel with a first thread carrying out a forward raster scan over the distance image and a second thread carrying out a backward raster scan over the image. In an example, a thread pauses when a cross-over condition is met until the other thread meets the condition after which both threads continue. In embodiments distances may be computed in Euclidean space or along geodesics defined on a surface. In an example, four threads execute two passes in parallel with each thread carrying out a raster scan over a different quarter of the image.
Abstract translation: 描述了距离变换的并行处理。 在一个实施例中,光栅扫描算法用于计算距离变换,使得距离图像的每个图像元素被分配距离值。 该距离值是从图像元素到种子区域的最短距离。 在一个实施例中,两个线程与第一线程并行执行,该第一线程在距离图像上执行正向光栅扫描,而第二线程在图像上执行向后光栅扫描。 在一个示例中,当满足交叉条件时,线程将暂停,直到另一个线程满足两个线程继续的条件为止。 在实施例中,距离可以在欧氏距离空间中或沿着表面上定义的测地线计算。 在一个示例中,四个线程与在每个图像的不同四分之一处执行光栅扫描的每个线程并行执行两个遍。
-
公开(公告)号:US20090290795A1
公开(公告)日:2009-11-26
申请号:US12126302
申请日:2008-05-23
Applicant: Antonio Criminisi , Toby Sharp
Inventor: Antonio Criminisi , Toby Sharp
IPC: G06K9/34
CPC classification number: G06T5/002 , G06K9/342 , G06T7/11 , G06T7/155 , G06T2207/10016 , G06T2207/30212
Abstract: A method of geodesic image and video processing is proposed. In an embodiment, the method uses a geodesic distance transform to construct an image filter. The filter can be used in a variety of image editing operations such as segmentation, denoising, texture smoothing, image stitching and cartooning. In one embodiment, the method may be made efficient by utilizing parallelism of the algorithm to carry out processing steps on at least two processing cores concurrently. This efficiency may enable high-resolution images and video to be processed at ‘real time’ rates without the need for specialist hardware.
Abstract translation: 提出了一种测地图像和视频处理方法。 在一个实施例中,该方法使用测地距离变换来构造图像滤波器。 滤镜可用于各种图像编辑操作,如分割,去噪,纹理平滑,图像拼接和卡通。 在一个实施例中,可以通过利用算法的并行性来同时对至少两个处理核执行处理步骤来使该方法有效。 这种效率可以使得高分辨率图像和视频以“实时”速率被处理,而不需要专用硬件。
-
公开(公告)号:US20080178087A1
公开(公告)日:2008-07-24
申请号:US11625049
申请日:2007-01-19
Applicant: Andrew Fitzgibbon , Toby Sharp
Inventor: Andrew Fitzgibbon , Toby Sharp
CPC classification number: G06T13/20 , G06T19/20 , G06T2219/2016
Abstract: Using in-scene editing, an added title, or object, moves as the camera moves through the imaged scene. Previously this has been complex to achieve, requiring expert users to explicitly align 3D coordinate systems in the image sequence and on the added title or object. For example, this has been used to add 3D objects into live-action footage in big-budget movies or advertising. A simple, easy to use system is described for achieving in-scene editing. A user specifies projection constraints by making 2D actions on one or more images in the image sequence. A 3D motion trajectory is computed for a 3D object model on the basis of the specified projection constraints and a smoothness indicator. Using the computed trajectory the 3D object model is added to the image sequence. Projection constraints may be added, amended or deleted to position the 3D object model and/or to animate it.
Abstract translation: 使用场景编辑,添加的标题或对象,随着相机移动通过成像的场景而移动。 以前,这一点很复杂,要求专家用户明确地对齐图像序列中的3D坐标系和添加的标题或对象。 例如,这已被用于将3D对象添加到大型预算电影或广告中的实时影像中。 描述了一个简单易用的系统,用于实现现场编辑。 用户通过在图像序列中的一个或多个图像上进行2D动作来指定投影约束。 基于指定的投影约束和平滑指标,为3D对象模型计算3D运动轨迹。 使用计算的轨迹,将3D对象模型添加到图像序列中。 可以添加,修改或删除投影约束以定位3D对象模型和/或使其动画化。
-
公开(公告)号:US08605992B2
公开(公告)日:2013-12-10
申请号:US13083271
申请日:2011-04-08
Applicant: Pushmeet Kohli , Toby Sharp , Carsten Curt Eckard Rother
Inventor: Pushmeet Kohli , Toby Sharp , Carsten Curt Eckard Rother
CPC classification number: G06T5/005 , G06T2207/10004 , G06T2207/10024 , G06T2207/10028
Abstract: Image completion using scene geometry is described, for example, to remove marks from digital photographs or complete regions which are blank due to editing. In an embodiment an image depicting, from a viewpoint, a scene of textured objects has regions to be completed. In an example, geometry of the scene is estimated from a depth map and the geometry used to warp the image so that at least some surfaces depicted in the image are fronto-parallel to the viewpoint. An image completion process is guided using distortion applied during the warping. For example, patches used to fill the regions are selected on the basis of distortion introduced by the warping. In examples where the scene comprises regions having only planar surfaces the warping process comprises rotating the image. Where the scene comprises non-planar surfaces, geodesic distances between image elements may be scaled to flatten the non-planar surfaces.
Abstract translation: 描述使用场景几何的图像完成,例如,从数字照片或由于编辑而为空的完整区域中移除标记。 在一个实施例中,从视点描绘纹理对象的场景的图像具有要完成的区域。 在一个示例中,从深度图和用于扭曲图像的几何估计场景的几何形状,使得图像中描绘的至少一些表面与视点平行。 使用在翘曲期间施加的变形来指导图像完成处理。 例如,基于由翘曲引入的失真来选择用于填充区域的补丁。 在场景包括仅具有平面表面的区域的示例中,翘曲过程包括旋转图像。 在场景包括非平面表面的情况下,图像元素之间的测地距离可以被缩放以平坦化非平面表面。
-
公开(公告)号:US08290295B2
公开(公告)日:2012-10-16
申请号:US12396590
申请日:2009-03-03
Applicant: Antonio Criminisi , Evgeny Salnikov , Toby Sharp
Inventor: Antonio Criminisi , Evgeny Salnikov , Toby Sharp
IPC: G06K9/38
CPC classification number: G06K9/38 , G06T5/009 , G06T5/40 , G06T2207/10032 , G06T2207/10081 , G06T2207/20208 , G06T2207/30004 , G06T2207/30181
Abstract: A system for multi-modal mapping of images is described. Embodiments are described where the image mapping system is used for visualizing high dynamic range images such as medical images, satellite images, high dynamic range photographs and the like and also for compressing such images. In examples, high bit-depth images are tone-mapped for display on equipment of lower bit-depth without loss of detail. In embodiments, the image mapping system computes statistics describing an input image and fits a multi-modal model to those statistics efficiently. In embodiments, the multi-modal model is a Gaussian mixture model and a plurality of sigmoid functions corresponding to the multi-modal model are obtained. In an embodiment the sigmoid functions are added to form a tone-mapping function which is used to transform a high bit-depth image such as 16 or 12 bits per pixel to a low bit-depth image such as 8 bits per pixel.
Abstract translation: 描述了用于图像的多模态映射的系统。 描述实施例,其中图像映射系统用于可视化诸如医学图像,卫星图像,高动态范围照片等的高动态范围图像,并且还用于压缩这样的图像。 在示例中,高位深图像被色调映射以便在较低位深度的设备上显示而不损失细节。 在实施例中,图像映射系统计算描述输入图像的统计量,并将多模态模型有效地适应于这些统计。 在实施例中,多模态模型是高斯混合模型,并且获得对应于多模态模型的多个S形函数。 在一个实施例中,添加S形功能以形成色调映射功能,其用于将诸如每像素16或12位的高位深度图像变换为诸如每像素8位的低位深度图像。
-
公开(公告)号:US20110228055A1
公开(公告)日:2011-09-22
申请号:US12728921
申请日:2010-03-22
Applicant: Toby Sharp
Inventor: Toby Sharp
CPC classification number: G06T15/06 , G06T15/08 , H04N13/275
Abstract: Space skipping for multi-dimensional image rendering is described. In an embodiment a ray-casting engine is used to form a two dimensional image from an at least three dimensional image volume by computing rays extending from a camera location, through the two dimensional image and into the volume. For example, a space skipping logic is used to clip the rays such that computationally expensive aspects of ray-casting only need to be performed along the clipped rays. For example a volume pyramid is formed by repeatedly reducing the resolution of the volume data. In an example, each ray is intersected with the lowest resolution volume of the pyramid and clipped using data from that volume. In examples, the clipping is then repeated at higher resolutions in order to clip the ray closely to non-transparent voxels in the volume and optimize the task of rendering the image.
Abstract translation: 描述了用于多维图像渲染的空间跳过。 在一个实施例中,射线铸造引擎用于通过计算从相机位置延伸通过二维图像并进入体积的从至少三维图像体积形成二维图像。 例如,空间跳过逻辑用于剪切光线,使得射线投射的计算上昂贵的方面仅需要沿着剪切的射线执行。 例如,通过重复地降低体数据的分辨率来形成体积金字塔。 在一个示例中,每个射线与金字塔的最低分辨率体积相交,并使用来自该卷的数据进行剪切。 在示例中,然后以更高分辨率重复剪辑,以将光线紧密地剪切到体积中的不透明体素,并优化渲染图像的任务。
-
公开(公告)号:US20110216975A1
公开(公告)日:2011-09-08
申请号:US12718232
申请日:2010-03-05
Applicant: Carsten Curt Eckard Rother , Toby Sharp
Inventor: Carsten Curt Eckard Rother , Toby Sharp
Abstract: A method of up-sampling binary images for segmentation is described. In an embodiment, digital images are down-sampled before segmentation. The resulting initial binary segmentation, which has a lower resolution than the original image, is then up-sampled and smoothed to generate an interim non-binary solution which has a higher resolution than the initial binary segmentation. The final binary segmentation for the image is then computed from the interim non-binary solution based on a threshold. This method does not use the original image data in inferring the final binary segmentation solution from the initial binary segmentation. In an embodiment, the method may be applied to all images and in another embodiment, the method may be used for images which comprise a large number of pixels in total or in single dimension and smaller images may not be down-sampled before segmentation.
Abstract translation: 描述了用于分割的二进制图像的上采样方法。 在一个实施例中,在分割之前对数字图像进行下采样。 然后,所得到的具有比原始图像更低分辨率的初始二进制分割被上采样和平滑以产生具有比初始二进制分割更高分辨率的临时非二进制解。 然后基于阈值从临时非二进制解决方案计算图像的最终二进制分割。 该方法不使用原始图像数据从最初的二进制分割推断最终的二进制分割解决方案。 在一个实施例中,该方法可以应用于所有图像,并且在另一个实施例中,该方法可以用于总共或单维度中包含大量像素的图像,并且在分割之前可能不会对较小的图像进行下采样。
-
-
-
-
-
-
-
-
-