-
公开(公告)号:US20180350030A1
公开(公告)日:2018-12-06
申请号:US15784415
申请日:2017-10-16
Applicant: Adobe Systems Incorporated
Inventor: David Simons , Michal Lukac , Daniel Sykora , Elya Shechtman , Paul Asente , Jingwan Lu , Jakub Fiser , Ondrej Jamriska
IPC: G06T3/00 , G06T7/11 , G06T11/00 , G06T7/73 , G06T7/194 , G06T7/90 , G06T5/00 , G06T5/50 , G06T13/80
Abstract: Certain embodiments involve generating an appearance guide, a segmentation guide, and a positional guide and using one or more of the guides to synthesize a stylized image or animation. For example, a system obtains data indicating a target and a style exemplar image and generates a segmentation guide for segmenting the target image and the style exemplar image and identifying a feature of the target image and a corresponding feature of the style exemplar image. The system generates a positional guide for determining positions of the target feature and style feature relative to a common grid system. The system generates an appearance guide for modifying intensity levels and contrast values in the target image based on the style exemplar image. The system uses one or more of the guides to transfer a texture of the style feature to the corresponding target feature.
-
公开(公告)号:US20170358143A1
公开(公告)日:2017-12-14
申请号:US15178237
申请日:2016-06-09
Applicant: Adobe Systems Incorporated
Inventor: Jakub Fiser , Ondrej Jamriska , Michal Lukác , Elya Shechtman , Paul J. Asente , Jingwan Lu , Daniel Sýkora
CPC classification number: G06T19/20 , G06K9/6204 , G06T11/00 , G06T15/02 , G06T15/50 , G06T15/503 , G06T2219/2012 , G06T2219/2024
Abstract: Techniques for controlling patch-usage in image synthesis are described. In implementations, a curve is fitted to a set of sorted matching errors that correspond to potential source-to-target patch assignments between a source image and a target image. Then, an error budget is determined using the curve. In an example, the error budget is usable to identify feasible patch assignments from the potential source-to-target patch assignments. Using the error budget along with uniform patch-usage enforcement, source patches from the source image are assigned to target patches in the target image. Then, at least one of the assigned source patches is assigned to an additional target patch based on the error budget. Subsequently, an image is synthesized based on the source patches assigned to the target patches.
-
公开(公告)号:US09536327B2
公开(公告)日:2017-01-03
申请号:US14723884
申请日:2015-05-28
Applicant: Adobe Systems Incorporated
Inventor: Paul J. Asente , Jingwan Lu , Michal Luká{hacek over (c)} , Elya Schechtman
CPC classification number: G06T11/001 , G06F3/04845 , G06T7/13 , G06T7/529 , G06T11/40 , G06T11/60 , G06T2200/24
Abstract: Example-based edge-aware directional texture painting techniques are described. Inputs are received that define a target direction field and a plurality of edges as part of a target shape mask. A texture is synthesized from a source image by the computing device to be applied to the set of pixels of the target mask using a source shape mask and a source direction field. The source shape mask defines a plurality of edges of the source mask such that the synthesized texture applied to the plurality of edges of the target shape mask correspond to respective ones of the plurality of edges of the source shape mask. The source direction field is taken from the source image such that the synthesized texture applied to the target direction field corresponds to the source direction field. The pixels in the user interface are painted by the computing device using the synthesized texture.
Abstract translation: 描述基于示例的边缘感知定向纹理绘画技术。 接收定义目标方向场和多个边缘作为目标形状掩模的一部分的输入。 使用源形状掩模和源方向场,通过计算装置从源图像合成要施加到目标掩模的像素集合的纹理。 源形状掩模定义了源掩模的多个边缘,使得施加到目标形状掩模的多个边缘的合成纹理对应于源形掩模的多个边缘中的相应边缘。 源方向字段取自源图像,使得应用于目标方向字段的合成纹理对应于源方向字段。 使用合成纹理由计算设备画出用户界面中的像素。
-
公开(公告)号:US20160350942A1
公开(公告)日:2016-12-01
申请号:US14723884
申请日:2015-05-28
Applicant: Adobe Systems Incorporated
Inventor: Paul J. Asente , Jingwan Lu , Michal Lukác , Elya Schechtman
IPC: G06T11/00 , G06F3/0484 , G06T7/00 , G06T11/40 , G06T11/60
CPC classification number: G06T11/001 , G06F3/04845 , G06T7/13 , G06T7/529 , G06T11/40 , G06T11/60 , G06T2200/24
Abstract: Example based edge-aware directional texture painting techniques are described. Inputs are received that define a target direction field and a plurality of edges as part of a target shape mask. A texture is synthesized from a source image by the computing device to be applied to the set of pixels of the target mask using a source shape mask and a source direction field. The source shape mask defines a plurality of edges of the source mask such that the synthesized texture applied to the plurality of edges of the target shape mask correspond to respective ones of the plurality of edges of the source shape mask. The source direction field is taken from the source image such that the synthesized texture applied to the target direction field corresponds to the source direction field. The pixels in the user interface are painted by the computing device using the synthesized texture.
Abstract translation: 描述基于实例的边缘感知定向纹理绘画技术。 接收定义目标方向场和多个边缘作为目标形状掩模的一部分的输入。 使用源形状掩模和源方向场,通过计算装置从源图像合成要施加到目标掩模的像素集合的纹理。 源形状掩模定义了源掩模的多个边缘,使得施加到目标形状掩模的多个边缘的合成纹理对应于源形掩模的多个边缘中的相应边缘。 源方向字段取自源图像,使得应用于目标方向字段的合成纹理对应于源方向字段。 使用合成纹理由计算设备画出用户界面中的像素。
-
公开(公告)号:US10109083B2
公开(公告)日:2018-10-23
申请号:US15235718
申请日:2016-08-12
Applicant: ADOBE SYSTEMS INCORPORATED
Inventor: Stephen Joseph DiVerdi , Jingwan Lu
IPC: G06T11/20 , G06F3/0484 , G06F3/0488
Abstract: Systems and methods provide for on the fly creation of curvy, digital brush strokes using incremental, local optimization. Samples from a user's input stroke are detected and matched with exemplar brush stroke segments as the user proceeds to provide input. For each set of samples, a temporary segment is generated and displayed for the user, and the temporary segment is later replaced by a permanent segment as subsequent samples sets are matched. Additionally, this optimization allows for updated parameterization in corner regions to provide a more realistic curve in the digital brush stroke. Specifically, intersecting ribs in the corners may be collapsed to prevent the rendering of artifacts. Additionally, and corner structures may be inserted in a break in a corner structure. These corner structures may be extensions of samples around the break and may correct distortion that results from the rib collapsing.
-
公开(公告)号:US20170109900A1
公开(公告)日:2017-04-20
申请号:US15394121
申请日:2016-12-29
Applicant: Adobe Systems Incorporated
Inventor: Paul J. Asente , Jingwan Lu , Michal Lukác , Elya Schechtman
IPC: G06T11/00 , G06T11/40 , G06T7/529 , G06F3/0484 , G06T7/13
CPC classification number: G06T11/001 , G06F3/04845 , G06T7/13 , G06T7/529 , G06T11/40 , G06T11/60 , G06T2200/24
Abstract: Example-based edge-aware directional texture painting techniques are described. Inputs are received that define a target direction field and a plurality of edges as part of a target shape mask. A texture is synthesized from a source image by the computing device to be applied to the set of pixels of the target mask using a source shape mask and a source direction field. The source shape mask defines a plurality of edges of the source mask such that the synthesized texture applied to the plurality of edges of the target shape mask correspond to respective ones of the plurality of edges of the source shape mask. The source direction field is taken from the source image such that the synthesized texture applied to the target direction field corresponds to the source direction field. The pixels in the user interface are painted by the computing device using the synthesized texture.
-
公开(公告)号:US09881413B2
公开(公告)日:2018-01-30
申请号:US15178072
申请日:2016-06-09
Applicant: Adobe Systems Incorporated
Inventor: Jakub Fiser , Ondrej Jamri{hacek over (s)}ka , Michal Luká{hacek over (c)} , Elya Shechtman , Paul J. Asente , Jingwan Lu , Daniel Sýkora
CPC classification number: G06T15/503 , G06T11/60 , G06T15/02 , G06T15/60 , G06T15/80 , G06T19/20 , G06T2219/2024
Abstract: Techniques for illumination-guided example-based stylization of 3D renderings are described. In implementations, a source image and a target image are obtained, where each image includes a multi-channel image having at least a style channel and multiple light path expression (LPE) channels having light propagation information. Then, the style channel of the target image is synthesized to mimic a stylization of individual illumination effects from the style channel of the source image. As part of the synthesizing, the light propagation information is applied as guidance for synthesis of the style channel of the target image. Based on the guidance, the stylization of individual illumination effects from the style channel of the source image is transferred to the style channel of the target image. Based on the transfer, the style channel of the target image is then generated for display of the target image via a display device.
-
公开(公告)号:US20180150947A1
公开(公告)日:2018-05-31
申请号:US15457830
申请日:2017-03-13
Applicant: ADOBE SYSTEMS INCORPORATED
Inventor: Jingwan Lu , Patsorn Sangkloy , Chen Fang
CPC classification number: G06T5/20 , G06N3/0454 , G06N3/08 , G06T11/00 , G06T11/001 , G06T2207/20081 , G06T2207/20084
Abstract: Methods and systems are provided for transforming sketches into stylized electronic paintings. A neural network system is trained where the training includes training a first neural network that converts input sketches into output images and training a second neural network that converts images into output paintings. Similarity for the first neural network is evaluated between the output image and a reference image and similarity for the second neural network is evaluated between the output painting, the output image, and a reference painting. The neural network system is modified based on the evaluated similarity. The trained neural network is used to generate an output painting from an input sketch where the output painting maintains features from the input sketch utilizing an extrapolated intermediate image and reflects a designated style from the reference painting.
-
公开(公告)号:US09905054B2
公开(公告)日:2018-02-27
申请号:US15178237
申请日:2016-06-09
Applicant: Adobe Systems Incorporated
Inventor: Jakub Fiser , Ondrej Jamri{hacek over (s)}ka , Michal Luká{hacek over (c)} , Elya Shechtman , Paul J. Asente , Jingwan Lu , Daniel Sýkora
CPC classification number: G06T19/20 , G06K9/6204 , G06T11/00 , G06T15/02 , G06T15/50 , G06T15/503 , G06T2219/2012 , G06T2219/2024
Abstract: Techniques for controlling patch-usage in image synthesis are described. In implementations, a curve is fitted to a set of sorted matching errors that correspond to potential source-to-target patch assignments between a source image and a target image. Then, an error budget is determined using the curve. In an example, the error budget is usable to identify feasible patch assignments from the potential source-to-target patch assignments. Using the error budget along with uniform patch-usage enforcement, source patches from the source image are assigned to target patches in the target image. Then, at least one of the assigned source patches is assigned to an additional target patch based on the error budget. Subsequently, an image is synthesized based on the source patches assigned to the target patches.
-
公开(公告)号:US20190139308A1
公开(公告)日:2019-05-09
申请号:US15934000
申请日:2018-03-23
Applicant: ADOBE SYSTEMS INCORPORATED
Inventor: Qi Sun , Paul John Asente , Li-Yi Wei , Jingwan Lu
Abstract: Methods and systems are provided for performing dynamic mapping between a virtual environment and a real-world space. During dynamic mapping, a current virtual scene of the virtual environment that is within view of a user is prioritized over areas of the virtual environment that are out of view. The dynamic mapping between the virtual environment and the real-world space can be utilized to render a virtual scene for user in real-time. As a user interacts and/or moves within the virtual environment, dynamic mapping can be performed in real-time to capture any dynamic changes to the real-world space and/or the virtual environment.
-
-
-
-
-
-
-
-
-