EFFICIENTLY INFERENCING DIGITAL VIDEOS UTILIZING MACHINE-LEARNING MODELS

    公开(公告)号:US20240362506A1

    公开(公告)日:2024-10-31

    申请号:US18771409

    申请日:2024-07-12

    Applicant: Adobe Inc.

    CPC classification number: G06N5/04 G06N20/00 G06T1/20 G06T3/40 G06V20/49 H04N19/13

    Abstract: This disclosure describes one or more implementations of a video inference system that utilizes machine-learning models to efficiently and flexibly process digital videos utilizing various improved video inference architectures. For example, the video inference system provides a framework for improving digital video processing by increasing the efficiency of both central processing units (CPUs) and graphics processing units (GPUs). In one example, the video inference system utilizes a first video inference architecture to reduce the number of computing resources needed to inference digital videos by analyzing multiple digital videos utilizing sets of CPU/GPU containers along with parallel pipeline processing. In a further example, the video inference system utilizes a second video inference architecture that facilitates multiple CPUs to preprocess multiple digital videos in parallel as well as a GPU to continuously, sequentially, and efficiently inference each of the digital videos.

    INCREASING EFFICIENCY OF INFERENCING DIGITAL VIDEOS UTILIZING MACHINE-LEARNING MODELS

    公开(公告)号:US20220138596A1

    公开(公告)日:2022-05-05

    申请号:US17087116

    申请日:2020-11-02

    Applicant: Adobe Inc.

    Abstract: This disclosure describes one or more implementations of a video inference system that utilizes machine-learning models to efficiently and flexibly process digital videos utilizing various improved video inference architectures. For example, the video inference system provides a framework for improving digital video processing by increasing the efficiency of both central processing units (CPUs) and graphics processing units (GPUs). In one example, the video inference system utilizes a first video inference architecture to reduce the number of computing resources needed to inference digital videos by analyzing multiple digital videos utilizing sets of CPU/GPU containers along with parallel pipeline processing. In a further example, the video inference system utilizes a second video inference architecture that facilitates multiple CPUs to preprocess multiple digital videos in parallel as well as a GPU to continuously, sequentially, and efficiently inference each of the digital videos.

    Media enhancement using discriminative and generative models with feedback

    公开(公告)号:US12136189B2

    公开(公告)日:2024-11-05

    申请号:US17172744

    申请日:2021-02-10

    Applicant: ADOBE INC.

    Abstract: The present disclosure describes systems and methods for image enhancement. Embodiments of the present disclosure provide an image enhancement system with a feedback mechanism that provides quantifiable image enhancement information. An image enhancement system may include a discriminator network that determines the quality of the media object. In cases where the discriminator network determines that the media object has a low image quality score (e.g., an image quality score below a quality threshold), the image enhancement system may perform enhancement on the media object using an enhancement network (e.g., using an enhancement network that includes a generative neural network or a generative adversarial network (GAN) model). The discriminator network may then generate an enhancement score for the enhanced media object that may be provided to the user as a feedback mechanism (e.g., where the enhancement score generated by the discriminator network quantifies the enhancement performed by the enhancement network).

    Increasing efficiency of inferencing digital videos utilizing machine-learning models

    公开(公告)号:US12067499B2

    公开(公告)日:2024-08-20

    申请号:US17087116

    申请日:2020-11-02

    Applicant: Adobe Inc.

    CPC classification number: G06N5/04 G06N20/00 G06T1/20 G06T3/40 G06V20/49 H04N19/13

    Abstract: This disclosure describes one or more implementations of a video inference system that utilizes machine-learning models to efficiently and flexibly process digital videos utilizing various improved video inference architectures. For example, the video inference system provides a framework for improving digital video processing by increasing the efficiency of both central processing units (CPUs) and graphics processing units (GPUs). In one example, the video inference system utilizes a first video inference architecture to reduce the number of computing resources needed to inference digital videos by analyzing multiple digital videos utilizing sets of CPU/GPU containers along with parallel pipeline processing. In a further example, the video inference system utilizes a second video inference architecture that facilitates multiple CPUs to preprocess multiple digital videos in parallel as well as a GPU to continuously, sequentially, and efficiently inference each of the digital videos.

    Interactive remote digital image editing utilizing a scalable containerized architecture

    公开(公告)号:US11762622B1

    公开(公告)日:2023-09-19

    申请号:US17663635

    申请日:2022-05-16

    Applicant: Adobe Inc.

    CPC classification number: G06F3/1462 G06F3/1407 G06F3/1415 G06T11/60

    Abstract: The present disclosure relates to systems, methods, and non-transitory computer readable media for remotely generating modified digital images utilizing an interactive image editing architecture. For example, the disclosed systems receive an image editing request for remotely editing a digital image utilizing an interactive image editing architecture. In some cases, the disclosed systems maintain, via a canvas worker container, a digital stream that reflects versions of the digital image. The disclosed systems determine, from the digital stream utilizing the canvas worker container, an image differential metric indicating a difference between a first version of the digital image and a second version of the digital image associated with the image editing request. Further, the disclosed systems provide the image differential metric to a client device for rendering the second version of the digital image to reflect a modification corresponding to the user interaction.

    Hierarchical multiclass exposure defects classification in images

    公开(公告)号:US11494886B2

    公开(公告)日:2022-11-08

    申请号:US16888473

    申请日:2020-05-29

    Applicant: ADOBE INC.

    Abstract: Embodiments of the present invention provide systems, methods, and computer storage media for detecting and classifying an exposure defect in an image using neural networks trained via a limited amount of labeled training images. An image may be applied to a first neural network to determine whether the images includes an exposure defect. Detected defective image may be applied to a second neural network to determine an exposure defect classification for the image. The exposure defect classification can includes severe underexposure, medium underexposure, mild underexposure, mild overexposure, medium overexposure, severe overexposure, and/or the like. The image may be presented to a user along with the exposure defect classification.

    HIERARCHICAL MULTICLASS EXPOSURE DEFECTS CLASSIFICATION IN IMAGES

    公开(公告)号:US20210374931A1

    公开(公告)日:2021-12-02

    申请号:US16888473

    申请日:2020-05-29

    Applicant: ADOBE INC.

    Abstract: Embodiments of the present invention provide systems, methods, and computer storage media for detecting and classifying an exposure defect in an image using neural networks trained via a limited amount of labeled training images. An image may be applied to a first neural network to determine whether the images includes an exposure defect. Detected defective image may be applied to a second neural network to determine an exposure defect classification for the image. The exposure defect classification can includes severe underexposure, medium underexposure, mild underexposure, mild overexposure, medium overexposure, severe overexposure, and/or the like. The image may be presented to a user along with the exposure defect classification.

Patent Agency Ranking