公开(公告)号：US20230319327A1

公开(公告)日：2023-10-05

申请号：US18021636

申请日：2022-06-08

Applicant: Google LLC

Inventor： Yilin Wang ,  Balineedu Adsumilli ,  Junjie Ke ,  Hossein Talebi ,  Joong Yim ,  Neil Birkbeck ,  Peyman Milanfar ,  Feng Yang

IPC: H04N21/234 ,  H04N19/154 ,  H04N21/466

CPC classification number: H04N21/23418 ,  H04N19/154 ,  H04N21/4668

Abstract: Methods, systems, and media for determining perceptual quality indicators of video content items are provided. In some embodiments, the method comprises: receiving a video content item; extracting a plurality of frames from the video content item; determining, using a first subnetwork of a deep neural network, a content quality indicator for each frame of the plurality of frames of the video content item; determining, using a second subnetwork of the deep neural network, a video distortion indicator for each frame of the plurality of frames of the video content item; determining, using a third subnetwork of the deep neural network, a compression sensitivity indicator for each frame of the plurality of frames of the video content item; generating a quality level for each frame of the plurality of frames of the video content item that concatenates the content quality indicator, the video distortion indicator, and the compression sensitivity indicator for that frame of the video content item; generating an overall quality level for video content item by aggregating the quality level of each frame of the plurality of frames; and causing a video recommendation to be presented based on the overall quality level of the video content item.

公开(公告)号：US20210241426A1

公开(公告)日：2021-08-05

申请号：US16613932

申请日：2017-12-04

Applicant: Google LLC

Inventor： Damien Kelly ,  Neil Birkbeck ,  Balineedu Adsumilli ,  Mohammad Izadi

IPC: G06T5/00

Abstract: A method for denoising video content includes identifying a first frame block associated with a first frame of the video content. The method also includes estimating a first noise model that represents characteristics of the first frame block. The method also includes identifying at least one frame block adjacent to the first frame block. The method also includes generating a second noise model that represents characteristics of the at least one frame block adjacent to the first frame block by adjusting the first noise model based on at least one characteristic of the at least one frame block adjacent to the first frame block. The method also includes denoising the at least one frame block adjacent to the first frame block using the second noise model.

公开(公告)号：US11308585B2

公开(公告)日：2022-04-19

申请号：US16613945

申请日：2017-12-05

Applicant: Google LLC

Inventor： Neil Birkbeck ,  Balineedu Adsumilli ,  Mohammad Izadi

IPC: G06T5/00

Abstract: A method for denoising video content includes identifying a first frame block of a plurality of frame blocks associated with a first frame of the video content. The method also includes determining an average intensity value for the first frame block. The method also includes determining a first noise model that represents characteristics of the first frame block. The method also includes generating a denoising function using the average intensity value and the first noise model for the first frame block. The method further includes denoising the plurality of frame blocks using the denoising function.

公开(公告)号：US20220237749A1

公开(公告)日：2022-07-28

申请号：US17722720

申请日：2022-04-18

Applicant: Google LLC

Inventor： Neil Birkbeck ,  Balineedu Adsumilli ,  Mohammad Izadi

IPC: G06T5/00

Abstract: Denoising video content includes identifying a three-dimensional flat frame block of multiple frames of the video content, wherein the three-dimensional flat frame block comprises flat frame blocks, each flat frame block is located within a respective frame of the multiple frames, and the flat frame blocks have a spatial and temporal intensity variance that is less than a threshold. Denoising video content also includes determining an average intensity value of the three-dimensional flat frame block, determining a noise model that represents noise characteristics of the three-dimensional flat frame block, generating a denoising function using the average intensity value and the noise model, and denoising the multiple frames using the denoising function.

公开(公告)号：US20210392392A1

公开(公告)日：2021-12-16

申请号：US17462286

申请日：2021-08-31

Applicant: Google LLC

Inventor： Neil Birkbeck ,  Balineedu Adsumilli ,  Damien Kelly

IPC: H04N21/2662 ,  H04N21/233 ,  H04N21/234 ,  H04N21/4728 ,  H04N21/81

Abstract: Signals of an immersive multimedia item are jointly considered for optimizing the quality of experience for the immersive multimedia item. During encoding, portions of available bitrate are allocated to the signals (e.g., a video signal and an audio signal) according to the overall contribution of those signals to the immersive experience for the immersive multimedia item. For example, in the spatial dimension, multimedia signals are processed to determine spatial regions of the immersive multimedia item to render using greater bitrate allocations, such as based on locations of audio content of interest, video content of interest, or both. In another example, in the temporal dimension, multimedia signals are processed in time intervals to adjust allocations of bitrate between the signals based on the relative importance of such signals during those time intervals. Other techniques for bitrate optimizations for immersive multimedia streaming are also described herein.

公开(公告)号：US11122314B2

公开(公告)日：2021-09-14

申请号：US16613961

申请日：2017-12-12

Applicant: Google LLC

Inventor： Neil Birkbeck ,  Balineedu Adsumilli ,  Damien Kelly

IPC: H04N21/2662 ,  H04N21/233 ,  H04N21/234 ,  H04N21/4728 ,  H04N21/81

Abstract: Signals of an immersive multimedia item are jointly considered for optimizing the quality of experience for the immersive multimedia item. During encoding, portions of available bitrate are allocated to the signals (e.g., a video signal and an audio signal) according to the overall contribution of those signals to the immersive experience for the immersive multimedia item. For example, in the spatial dimension, multimedia signals are processed to determine spatial regions of the immersive multimedia item to render using greater bitrate allocations, such as based on locations of audio content of interest, video content of interest, or both. In another example, in the temporal dimension, multimedia signals are processed in time intervals to adjust allocations of bitrate between the signals based on the relative importance of such signals during those time intervals. Other techniques for bitrate optimizations for immersive multimedia streaming are also described herein.

公开(公告)号：US11816310B1

公开(公告)日：2023-11-14

申请号：US17000885

申请日：2020-08-24

Applicant: Google LLC

Inventor： Neil Birkbeck ,  Isasi Inguva ,  Damien Kelly ,  Andrew Crawford ,  Hugh Denman ,  Perry Tobin ,  Steve Benting ,  Anil Kokaram ,  Jeremy Doig

IPC: G06F3/0484 ,  H04N21/845 ,  H04N21/8549 ,  G11B27/34 ,  H04N21/45 ,  H04N21/2387 ,  G11B27/10 ,  H04N21/242

CPC classification number: G06F3/0484 ,  G11B27/10 ,  G11B27/34 ,  H04N21/2387 ,  H04N21/242 ,  H04N21/45 ,  H04N21/8455 ,  H04N21/8456 ,  H04N21/8549

Abstract: An interactive multi-view module identifies a plurality of media items associated with one or more real-world events. Each of the plurality of media items is created by capturing the real-world events from a particular geographic location. The interactive multi-view module determines a geographic position associated with each of the media items and presents the media items in an interactive multi-view player interface based at least on the geographic positions. The interactive multi-view player interface allows a user to switch between of media items, and indicates at least one of a video density indicating a number of media items available at a given point in time or an event highlight indicating a popularity of the media items at a given point in time. The popularity of the respective media items is determined using one or more factors comprising a number of views of the media items at a given point in time.

公开(公告)号：US20220222784A1

公开(公告)日：2022-07-14

申请号：US17708983

申请日：2022-03-30

Applicant: Google LLC

Inventor： Damien Kelly ,  Neil Birkbeck ,  Balineedu Adsumilli ,  Mohammad Izadi

IPC: G06T5/00

Abstract: Processing a spherical video using denoising is described. Video content comprising the spherical video is received. Whether a camera geometry or a map projection, or both, used to generate the spherical video is available is then determined. The spherical video is denoised using a first technique responsive to a determination that the camera geometry, the map projection, or both is available. Otherwise, the spherical video is denoised using a second technique. At least some steps of the second technique can be different from steps of the first technique. The denoised spherical video can be encoded for transmission or storage using less data than encoding the spherical video without denoising.

公开(公告)号：US11308584B2

公开(公告)日：2022-04-19

申请号：US16613932

申请日：2017-12-04

Applicant: Google LLC

Inventor： Damien Kelly ,  Neil Birkbeck ,  Balineedu Adsumilli ,  Mohammad Izadi

IPC: G06T5/00

Abstract: A method for denoising video content includes identifying a first frame block associated with a first frame of the video content. The method also includes estimating a first noise model that represents characteristics of the first frame block. The method also includes identifying at least one frame block adjacent to the first frame block. The method also includes generating a second noise model that represents characteristics of the at least one frame block adjacent to the first frame block by adjusting the first noise model based on at least one characteristic of the at least one frame block adjacent to the first frame block. The method also includes denoising the at least one frame block adjacent to the first frame block using the second noise model.

公开(公告)号：US20210287341A1

公开(公告)日：2021-09-16

申请号：US16613945

申请日：2017-12-05

Applicant: Google LLC

Inventor： Neil Birkbeck ,  Balineedu Adsumilli ,  Mohammad Izadi

IPC: G06T5/00

Abstract: A method for denoising video content includes identifying a first frame block of a plurality of frame blocks associated with a first frame of the video content. The method also includes determining an average intensity value for the first frame block. The method also includes determining a first noise model that represents characteristics of the first frame block. The method also includes generating a denoising function using the average intensity value and the first noise model for the first frame block. The method further includes denoising the plurality of frame blocks using the denoising function.