公开(公告)号：US20130266238A1

公开(公告)日：2013-10-10

申请号：US13725006

申请日：2012-12-21

Applicant: ADOBE SYSTEMS INCORPORATED

Inventor： Hailin Jin

IPC: G06T5/00

CPC classification number: G06T7/2033 ,  G06K9/3233 ,  G06K9/3241 ,  G06K9/3275 ,  G06K9/4652 ,  G06T5/001 ,  G06T7/246 ,  G06T7/579 ,  G06T7/70 ,  G06T2200/04 ,  G06T2207/10012 ,  G06T2207/10016 ,  G06T2207/20164 ,  G06T2207/30241 ,  G06T2207/30244 ,  H04N5/232 ,  H04N13/00 ,  H04N13/10 ,  H04N17/002

Abstract: A technique for selecting a particular reconstruction technique to be applied to an image sequence. The technique may analyze an input image sequence and, based on one or more characteristics of the image sequence, select a reconstruction technique as the appropriate technique for the image sequence from among a set of reconstruction techniques. For example, the set may include two or more of a rotation-based reconstruction technique, a plane-based reconstruction technique, and a general 3D reconstruction technique. The selection technique may be combined with the reconstruction techniques to produce a system that takes as input an image sequence or a set of point trajectories, selects an appropriate reconstruction technique, and applies the selected reconstruction technique to generate an estimate of camera motion and camera intrinsic parameters for the image sequence. The technique may be adapted to select among other types of techniques that may be applied to image sequences.

Abstract translation: 一种用于选择要应用于图像序列的特定重建技术的技术。 该技术可以分析输入图像序列，并且基于图像序列的一个或多个特征，从一组重建技术中选择重建技术作为图像序列的适当技术。 例如，该集合可以包括基于旋转的重建技术，基于平面的重建技术和一般的3D重建技术中的两个或更多个。 选择技术可以与重建技术组合以产生将图像序列或一组点轨迹作为输入的系统，选择适当的重建技术，并且应用所选择的重建技术来生成相机运动和相机内在的估计 图像序列的参数。 该技术可以适于选择可应用于图像序列的其它类型的技术。

公开(公告)号：US20130266180A1

公开(公告)日：2013-10-10

申请号：US13724906

申请日：2012-12-21

Applicant: ADOBE SYSTEMS INCORPORATED

Inventor： Hailin Jin

IPC: G06K9/32

CPC classification number: G06T7/2033 ,  G06K9/3233 ,  G06K9/3241 ,  G06K9/3275 ,  G06K9/4652 ,  G06T5/001 ,  G06T7/246 ,  G06T7/579 ,  G06T7/70 ,  G06T2200/04 ,  G06T2207/10012 ,  G06T2207/10016 ,  G06T2207/20164 ,  G06T2207/30241 ,  G06T2207/30244 ,  H04N5/232 ,  H04N13/00 ,  H04N13/10 ,  H04N17/002

Abstract: An adaptive technique is described for iteratively selecting and reconstructing keyframes to fully cover an image sequence that may, for example, be used in an adaptive reconstruction algorithm implemented by a structure from motion (SFM) technique. A next keyframe to process may be determined according to an adaptive keyframe selection technique. The determined keyframe may be reconstructed and added to the current reconstruction. A global optimization may be performed on the current reconstruction. One or more outlier points may be determined and removed from the reconstruction. One or more inlier points may be determined and recovered. If the number of inlier points that were added exceeds a threshold, then global optimization may again be performed. If the current reconstruction is a projective construction, self-calibration may be performed to upgrade the projective reconstruction to a Euclidean reconstruction.

Abstract translation: 描述了一种自适应技术，用于迭代地选择和重构关键帧以完全覆盖可以例如在由运动（SFM）技术的结构实现的自适应重建算法中使用的图像序列。 可以根据自适应关键帧选择技术来确定要处理的下一关键帧。 所确定的关键帧可以被重构并被添加到当前的重建中。 可以对当前重建执行全局优化。 可以确定一个或多个异常点，并从重建中移除。 可以确定和恢复一个或多个入口点。 如果添加的入口点数超过阈值，则可以再次执行全局优化。 如果目前的重建是投影建设，可以进行自我校准，将投影重建升级为欧几里得重建。

公开(公告)号：US20130266179A1

公开(公告)日：2013-10-10

申请号：US13724871

申请日：2012-12-21

Applicant: ADOBE SYSTEMS INCORPORATED

Inventor： Hailin Jin

IPC: G06K9/32

CPC classification number: G06T7/2033 ,  G06K9/3233 ,  G06K9/3241 ,  G06K9/3275 ,  G06K9/4652 ,  G06T5/001 ,  G06T7/246 ,  G06T7/579 ,  G06T7/70 ,  G06T2200/04 ,  G06T2207/10012 ,  G06T2207/10016 ,  G06T2207/20164 ,  G06T2207/30241 ,  G06T2207/30244 ,  H04N5/232 ,  H04N13/00 ,  H04N13/10 ,  H04N17/002

Abstract: An initialization technique that may, for example, be used in an adaptive reconstruction algorithm implemented by structure from motion (SFM) techniques. The initialization technique computes an initial reconstruction from a subset of frames in an image sequence. The initialization technique may be performed to determine and reconstruct a set of initial keyframes covering a portion of the image sequence according to the point trajectories. In the initialization technique, a set of temporally spaced keyframe candidates is determined and two initial keyframes are selected from the set of keyframe candidates. The two initial keyframes are reconstructed, and then one or more additional keyframes between the two initial keyframes are selected and reconstructed.

Abstract translation: 例如，可以用于通过运动（SFM）技术的结构实现的自适应重建算法中的初始化技术。 初始化技术从图像序列中的帧子集计算初始重建。 可以执行初始化技术以根据点轨迹来确定和重建覆盖图像序列的一部分的一组初始关键帧。 在初始化技术中，确定一组时间间隔的关键帧候选，并从该组关键帧候选中选择两个初始关键帧。 重建两个初始关键帧，然后选择和重建两个初始关键帧之间的一个或多个附加关键帧。

公开(公告)号：US20130265387A1

公开(公告)日：2013-10-10

申请号：US13724945

申请日：2012-12-21

Applicant: ADOBE SYSTEMS INCORPORATED

Inventor： Hailin Jin

IPC: H04N13/00

CPC classification number: G06T7/2033 ,  G06K9/3233 ,  G06K9/3241 ,  G06K9/3275 ,  G06K9/4652 ,  G06T5/001 ,  G06T7/246 ,  G06T7/579 ,  G06T7/70 ,  G06T2200/04 ,  G06T2207/10012 ,  G06T2207/10016 ,  G06T2207/20164 ,  G06T2207/30241 ,  G06T2207/30244 ,  H04N5/232 ,  H04N13/00 ,  H04N13/10 ,  H04N17/002

Abstract: An opt-keyframe reconstruction technique for selecting and reconstructing optimizing keyframes to provide a better reconstruction in a structure from motion (SFM) technique. The technique may, for example, be used in an adaptive reconstruction algorithm implemented by a general SFM technique. This technique may add and reconstruct optimizing frames to a set of keyframes already generated by an initialization technique and by an adaptive technique for iteratively selecting and reconstructing additional keyframes. In addition, the technique may determine and remove outlier points from the projection, and determine and recover inlier points in the projection. Adding the opt-keyframes and inlier points may result in additional, and possibly shorter, point trajectories being included in the reconstruction, thus providing a better reconstruction that may be more suited for later operations that may be applied to the image sequence.

Abstract translation: 一种选择关键帧重建技术，用于选择和重建优化关键帧，以在运动（SFM）技术的结构中提供更好的重建。 该技术可以例如用于通过一般SFM技术实现的自适应重建算法中。 该技术可以将已经由初始化技术生成的关键帧集合和通过用于迭代地选择和重建附加关键帧的自适应技术的优化帧添加和重建。 此外，该技术可以从投影中确定和去除异常值点，并且确定并恢复投影中的入射点。 添加选择关键帧和入站点可能导致重建中包含的额外的且可能更短的点轨迹，从而提供可以更适合于可应用于图像序列的后续操作的更好的重建。

公开(公告)号：US20130142431A1

公开(公告)日：2013-06-06

申请号：US13757518

申请日：2013-02-01

Applicant: ADOBE SYSTEMS INCORPORATED

Inventor： Hailin Jin

IPC: G06K9/32

CPC classification number: G06K9/3275 ,  H04N5/23238 ,  H04N5/247 ,  H04N5/3572

Abstract: A method for aligning and unwarping distorted images in which lens profiles for a variety of lens and camera combinations are precomputed. Metadata stored with images is used to automatically determine if a set of component images include an excessive amount of distortion, and if so the metadata is used to determine an appropriate lens profile and initial unwarping function. The initial unwarping function is applied to the coordinates of feature points of the component images to generate substantially rectilinear feature points, which are used to estimate focal lengths, centers, and relative rotations for pairs of the images. A global nonlinear optimization is applied to the initial unwarping function(s) and the relative rotations to generate optimized unwarping functions and rotations for the component images. The optimized unwarping functions and rotations may be used to render a panoramic image.

Abstract translation: 一种用于对准和扭曲失真图像的方法，其中预先计算用于各种镜头和相机组合的透镜轮廓。 使用存储有图像的元数据来自动确定一组分量图像是否包含过多的失真，如果是，则使用元数据来确定适当的透镜轮廓和初始不正确的功能。 将初始不正确函数应用于分量图像的特征点的坐标，以生成基本上直线的特征点，其用于估计图像对的焦距，中心和相对旋转。 全局非线性优化被应用于初始不平衡函数和相对旋转以产生用于分量图像的优化的不正确函数和旋转。 优化的不正确功能和旋转可用于渲染全景图像。

公开(公告)号：US20130089262A1

公开(公告)日：2013-04-11

申请号：US13683166

申请日：2012-11-21

Applicant: Adobe Systems Incorporated

Inventor： Simon Chen ,  Jen-Chan Chien ,  Hailin Jin

IPC: G06K9/62

CPC classification number: G06T5/002 ,  G06K9/6201 ,  G06T3/0093 ,  H04N1/32101 ,  H04N5/2173 ,  H04N5/23229 ,  H04N5/23238 ,  H04N5/2353 ,  H04N5/2355 ,  H04N2201/3252

Abstract: Methods and apparatus for constraining solution space in image processing techniques may use the metadata for a set of images to constrain an image processing solution to a smaller solution space. In one embodiment, a process may require N parameters for processing an image. A determination may be made from metadata that multiple images were captured with the same camera/lens and with the same settings. A set of values may be estimated for the N parameters from data in one or more of the images. The process may then be applied to each of images using the set of values. In one embodiment, a value for a parameter of a process may be estimated for an image. If the estimated value deviates substantially from a value for the parameter in the metadata, the metadata value is used in the process instead of the estimated value.

Abstract translation: 在图像处理技术中约束解空间的方法和装置可以使用一组图像的元数据来将图像处理解决方案约束到较小的解空间。 在一个实施例中，过程可能需要用于处理图像的N个参数。 可以从元数据确定使用相同的相机/镜头并以相同的设置捕获多个图像。 可以根据一个或多个图像中的数据为N个参数估计一组值。 然后可以使用该组值将该过程应用于每个图像。 在一个实施例中，可以针对图像估计处理的参数的值。 如果估计值实质上偏离元数据中的参数的值，则在过程中使用元数据值而不是估计值。

公开(公告)号：US10198590B2

公开(公告)日：2019-02-05

申请号：US14938724

申请日：2015-11-11

Applicant: Adobe Systems Incorporated

Inventor： Zeke Koch ,  Gavin Stuart Peter Miller ,  Jonathan W. Brandt ,  Nathan A. Carr ,  Radomir Mech ,  Walter Wei-Tuh Chang ,  Scott D. Cohen ,  Hailin Jin

IPC: G06F21/62 ,  G06F3/0484 ,  G06F17/30

Abstract: Content creation collection and navigation techniques and systems are described. In one example, a representative image is used by a content sharing service to interact with a collection of images provided as part of a search result. In another example, a user interface image navigation control is configured to support user navigation through images based on one or more metrics. In a further example, a user interface image navigation control is configured to support user navigation through images based on one or more metrics identified for an object selected from the image. In yet another example, collections of images are leveraged as part of content creation. In another example, data obtained from a content sharing service is leveraged to indicate suitability of images of a user for licensing as part of the service.

公开(公告)号：US20180357259A1

公开(公告)日：2018-12-13

申请号：US15619205

申请日：2017-06-09

Applicant: Adobe Systems Incorporated

Inventor： Hailin Jin ,  John Philip Collomosse

IPC: G06F17/30 ,  G06K9/22 ,  G06K9/46 ,  G06F3/0488

CPC classification number: G06F16/532 ,  G06K9/00684 ,  G06K9/4628 ,  G06K9/6253 ,  G06K9/6274 ,  G06N3/0427 ,  G06N3/0454 ,  G06N3/08 ,  G06N5/022

Abstract: Sketch and style based image retrieval in a digital medium environment is described. Initially, a user sketches an object (e.g., with a stylus) to be searched in connection with an image search. Styled images are selected to indicate a desired style of images to be returned by the search. A search request is generated based on the sketch and selected images. Responsive to the request, an image repository is searched to identify images having the desired object and styling. To search the image repository, a neural network is utilized that is capable of recognizing the desired object in images based on visual characteristics of the sketch and independently recognizing the desired styling in images based on visual characteristics of the selected images. This independent recognition allows desired styling to be specified by selecting images having the style but not the desired object. Images having the desired object and styling are returned.

公开(公告)号：US10140261B2

公开(公告)日：2018-11-27

申请号：US14286242

申请日：2014-05-23

Applicant: ADOBE SYSTEMS INCORPORATED

Inventor： Jianchao Yang ,  Hailin Jin ,  Jonathan Brandt

IPC: G06F17/21 ,  G06F3/0484 ,  G06F17/30 ,  G06T11/20

Abstract: Font graphs are defined having a finite set of nodes representing fonts and a finite set of undirected edges denoting similarities between fonts. The font graphs enable users to browse and identify similar fonts. Indications corresponding to a degree of similarity between connected nodes may be provided. A selection of a desired font or characteristics associated with one or more attributes of the desired font is received from a user interacting with the font graph. The font graph is dynamically redefined based on the selection.

公开(公告)号：US20180300592A1

公开(公告)日：2018-10-18

申请号：US16013791

申请日：2018-06-20

Applicant: Adobe Systems Incorporated

Inventor： Hailin Jin ,  Zhaowen Wang ,  Gavin Stuart Peter Miller

IPC: G06K9/68 ,  G06F17/21

CPC classification number: G06K9/6828 ,  G06F17/214 ,  G06N3/0454 ,  G06N3/08 ,  G06N5/025 ,  G06N7/005

Abstract: Font replacement based on visual similarity is described. In one or more embodiments, a font descriptor includes multiple font features derived from a visual appearance of a font by a font visual similarity model. The font visual similarity model can be trained using a machine learning system that recognizes similarity between visual appearances of two different fonts. A source computing device embeds a font descriptor in a document, which is transmitted to a destination computing device. The destination compares the embedded font descriptor to font descriptors corresponding to local fonts. Based on distances between the embedded and the local font descriptors, at least one matching font descriptor is determined. The local font corresponding to the matching font descriptor is deemed similar to the original font. The destination computing device controls presentations of the document using the similar local font. Computation of font descriptors can be outsourced to a remote location.