IMAGE DOWN-SCALING WITH PIXEL SETS SELECTED VIA BLUE NOISE SAMPLING

    公开(公告)号:US20190355095A1

    公开(公告)日:2019-11-21

    申请号:US15980367

    申请日:2018-05-15

    申请人: Adobe Inc.

    发明人: Li-Yi Wei Xin Sun

    IPC分类号: G06T3/40 G06T5/00

    摘要: In some embodiments, a computing device uses a blue noise sampling operation to identify source pixels from an input image defining respective pixel sets. Each pixel set is associated with a respective weight matrix for a down-scaling operation. The blue noise sampling operation causes an overlap region between first and second pixel sets. The computing device assigns an overlap pixel in the overlap region to the first weight matrix based on the overlap pixel being closer to the first source pixel. The computing device modifies the second weight matrix to exclude the overlap pixel from a portion of the down-scaling operation involving the second weight matrix. The computing device performs the down-scaling operation on the input image by combining the first pixel set into a first target pixel with the first weight matrix and combining the second pixel set into a second target with the modified second weight matrix.

    Systems for Augmented Reality Sketching

    公开(公告)号:US20220148267A1

    公开(公告)日:2022-05-12

    申请号:US17511385

    申请日:2021-10-26

    申请人: Adobe Inc.

    摘要: In implementations of systems for augmented reality sketching, a computing device implements a sketch system to generate three-dimensional scene data describing a three-dimensional representation of a physical environment including a physical object. The sketch system displays a digital video in a user interface that depicts the physical environment and the physical object and the sketch system tracks movements of the physical object depicted in the digital video using two-dimensional coordinates of the user interface. These two-dimensional coordinates are projected into the three-dimensional representation of the physical environment. The sketch system receives a user input connecting a portion of a graphical element in the user interface to the physical object depicted in the digital video. The sketch system displays the portion of the graphical element as moving in the user interface corresponding to the movements of the physical object depicted in the digital video.

    Image down-scaling with pixel sets selected via blue noise sampling

    公开(公告)号:US11238560B2

    公开(公告)日:2022-02-01

    申请号:US16918649

    申请日:2020-07-01

    申请人: Adobe Inc.

    发明人: Li-Yi Wei Xin Sun

    IPC分类号: G06T5/00 G06T3/40

    摘要: In some embodiments, a computing device uses a blue noise sampling operation to identify source pixels from an input image defining respective pixel sets. Each pixel set is associated with a respective weight matrix for a down-scaling operation. The blue noise sampling operation causes an overlap region between first and second pixel sets. The computing device assigns an overlap pixel in the overlap region to the first weight matrix based on the overlap pixel being closer to the first source pixel. The computing device modifies the second weight matrix to exclude the overlap pixel from a portion of the down-scaling operation involving the second weight matrix. The computing device performs the down-scaling operation on the input image by combining the first pixel set into a first target pixel with the first weight matrix and combining the second pixel set into a second target with the modified second weight matrix.

    Classifying panoramic images
    14.
    发明授权

    公开(公告)号:US10991085B2

    公开(公告)日:2021-04-27

    申请号:US16372202

    申请日:2019-04-01

    申请人: ADOBE INC.

    IPC分类号: G06K9/62 G06T7/00 G06N3/04

    摘要: Embodiments herein describe a framework for classifying images. In some embodiments, it is determined whether an image includes synthetic image content. If it does, characteristics of the image are analyzed to determine if the image includes characteristics particular to panoramic images (e.g., possess a threshold equivalency of pixel values among the top and/or bottom boundaries of the image, or a difference between summed pixel values of the pixels comprising the right vertical boundary of the image and summed pixel values of the pixels comprising the left vertical boundary of the image being less than or equal to a threshold value). If the image includes characteristics particular to panoramic images, the image is classified as a synthetic panoramic image. If the image is determined to not include synthetic image content, a neural network is applied to the image and the image is classified as one of non-synthetic panoramic or non-synthetic non-panoramic.

    Stroke prediction for stylized drawings based on prior strokes and reference image

    公开(公告)号:US10970889B2

    公开(公告)日:2021-04-06

    申请号:US16368632

    申请日:2019-03-28

    申请人: ADOBE INC.

    发明人: Yilan Chen Li-Yi Wei

    IPC分类号: G06T11/20 G06K9/00

    摘要: Embodiments provide systems, methods, and computer storage media for generating stroke predictions based on prior strokes and a reference image. An interactive drawing interface can allow a user to sketch over, or with respect to, a reference image. A UI tool such as an autocomplete or workflow clone tool can access or identify a set of prior strokes and a target region, and stroke predictions can be generated using an iterative algorithm that minimizes an energy function considering stroke-to-stroke and image-patch-to-image-patch comparisons. For any particular future stroke, one or more stroke predictions may be initialized based on the set of prior strokes. Each initialized prediction can be improved by iteratively executing search and assignment steps to incrementally improve the prediction, and the best prediction can be selected and presented as a stroke prediction for the future stroke. The process can be repeated to predict any number of future strokes.

    CLASSIFYING PANORAMIC IMAGES
    16.
    发明申请

    公开(公告)号:US20200311901A1

    公开(公告)日:2020-10-01

    申请号:US16372202

    申请日:2019-04-01

    申请人: ADOBE INC.

    IPC分类号: G06T7/00 G06N3/04 G06K9/62

    摘要: Embodiments herein describe a framework for classifying images. In some embodiments, it is determined whether an image includes synthetic image content. If it does, characteristics of the image are analyzed to determine if the image includes characteristics particular to panoramic images (e.g., possess a threshold equivalency of pixel values among the top and/or bottom boundaries of the image, or a difference between summed pixel values of the pixels comprising the right vertical boundary of the image and summed pixel values of the pixels comprising the left vertical boundary of the image being less than or equal to a threshold value). If the image includes characteristics particular to panoramic images, the image is classified as a synthetic panoramic image. If the image is determined to not include synthetic image content, a neural network is applied to the image and the image is classified as one of non-synthetic panoramic or non-synthetic non-panoramic.

    Delivering a virtual environment with dynamic level of detail per object

    公开(公告)号:US11941747B2

    公开(公告)日:2024-03-26

    申请号:US17515079

    申请日:2021-10-29

    申请人: Adobe Inc.

    摘要: A method includes accessing a first object in a virtual environment, the first object representing a first asset at a first level of detail (LoD). A second object is generated to represent the first asset at a second LoD having decreased complexity. The method further includes determining a first importance value for the first asset and, based on the first importance value, selecting the first object to represent the first asset. Additionally, the method includes accessing a third object representing the second asset at the first LoD and generating a fourth object representing the second asset at the second LoD. The method further includes determining a second importance value, lower than the first importance value, for the second asset and selecting the fourth object to represent the second asset. The method further includes causing a client device to update a display of the virtual environment by transmitting the selected objects.

    VIRTUAL 3D POINTING AND MANIPULATION
    18.
    发明公开

    公开(公告)号:US20230252746A1

    公开(公告)日:2023-08-10

    申请号:US17666806

    申请日:2022-02-08

    申请人: Adobe Inc.

    摘要: Certain aspects and features of this disclosure relate to virtual 3D pointing and manipulation. For example, video communication is established between a presenter client device and a viewer client device. A presenter video image is captured. A 3D image of a 3D object is rendered on the client devices and a presenter avatar is rendered on at least the viewer client device. The presenter avatar includes at least a portion of the presenter video image. When a positional input is detected at the presenter client device, the system renders, on the viewer client device, an articulated virtual appurtenance associated with the positional input, the 3D image, and the presenter avatar. A virtual interaction between the articulated virtual appurtenance and the 3D image appear to a viewer as naturally positioned for the interaction with respect to the viewer.

    Systems for augmented reality sketching

    公开(公告)号:US11574450B2

    公开(公告)日:2023-02-07

    申请号:US17511385

    申请日:2021-10-26

    申请人: Adobe Inc.

    摘要: In implementations of systems for augmented reality sketching, a computing device implements a sketch system to generate three-dimensional scene data describing a three-dimensional representation of a physical environment including a physical object. The sketch system displays a digital video in a user interface that depicts the physical environment and the physical object and the sketch system tracks movements of the physical object depicted in the digital video using two-dimensional coordinates of the user interface. These two-dimensional coordinates are projected into the three-dimensional representation of the physical environment. The sketch system receives a user input connecting a portion of a graphical element in the user interface to the physical object depicted in the digital video. The sketch system displays the portion of the graphical element as moving in the user interface corresponding to the movements of the physical object depicted in the digital video.

    Generating suggested edits for three-dimensional graphics based on deformations of prior edits

    公开(公告)号:US11282290B1

    公开(公告)日:2022-03-22

    申请号:US16953227

    申请日:2020-11-19

    申请人: Adobe Inc.

    IPC分类号: G06T19/20 G06T17/20

    摘要: Using a prediction engine, generating, based on deformations of prior editing operations performed with a graphics editing tool, suggested editing operations that augment current editing operations applied to a graphical object. The prediction engine accesses first samples defining first positions along first paths of previous editing operations applied to a mesh object in a previous frame and second samples defining second positions along second paths of executed editing operations applied in a current frame. The prediction engine identifies, from a comparison of the first samples and the second samples, a matching component set from the previous editing operations that corresponds to the executed editing operations. The prediction engine deforms the first samples toward the second samples and determines suggested editing operations that comprise a non-matching component set as modified based on the deformed first samples. The prediction engine updates an interface to provide the suggested editing operations.