公开(公告)号：US20230199250A1

公开(公告)日：2023-06-22

申请号：US17701243

申请日：2022-03-22

申请人： DISNEY ENTERPRISES, INC.

发明人： Romann Matthew WEBER ,  Graziana MIGNONE ,  Jacek Krzysztof NARUNIEC ,  Aaron Michael BAKER ,  Farnood SALEHI ,  Dennis LI

IPC分类号： H04N21/442 ,  H04N21/466

CPC分类号： H04N21/44218 ,  H04N21/4662

摘要： Techniques are disclosed for characterizing audience engagement with one or more characters in a media content item. In some embodiments, an audience engagement characterization application processes sensor data, such as video data capturing the faces of one or more audience members consuming a media content item, to generate an audience emotion signal. The characterization application also processes the media content item to generate a character emotion signal associated with one or more characters in the media content item. Then, the characterization application determines an audience engagement score based on an amount of alignment and/or misalignment between the audience emotion signal and the character emotion signal.

公开(公告)号：US20230334612A1

公开(公告)日：2023-10-19

申请号：US17720660

申请日：2022-04-14

申请人： Disney Enterprises, Inc.

发明人： Marios PAPAS ,  Gerhard RÖTHLIN ,  Henrik D. DAHLBERG ,  Farnood SALEHI ,  David M. ADLER ,  Mark A. MEYER ,  Andre C. MAZZONE ,  Christopher R. SCHROERS ,  Marco MANZI ,  Thijs VOGELS ,  Per H. CHRISTENSEN

IPC分类号： G06T1/20 ,  G06T5/00 ,  G06N3/08

CPC分类号： G06T1/20 ,  G06T5/002 ,  G06N3/08 ,  G06T2207/20084 ,  G06T2207/20081

摘要： Certain aspects of the present disclosure provide techniques for adaptive sampling for rendering using deep learning. This includes receiving, at a sampler in a rendering pipeline, a plurality of rendered pixel data, wherein the sampler includes a first machine learning (ML) model. It further includes generating a sampling map for the rendering pipeline using the first ML model and the plurality of rendered pixel data, including predicting a plurality of pixel values in the sampling map based on a generated distribution of pixel values. It further includes rendering an image using the sampler, the sampling map, and a denoiser in the rendering pipeline.

公开(公告)号：US20230377093A1

公开(公告)日：2023-11-23

申请号：US18320496

申请日：2023-05-19

申请人： DISNEY ENTERPRISES, INC. ,  ETH Zürich (Eidgenössische Technische Hochschule Zürich)

发明人： Abdelaziz DJELOUAH ,  Michael Yves BERNASCONI ,  Farnood SALEHI ,  Christopher Richard SCHROERS

IPC分类号： G06T3/00 ,  G06T3/40

CPC分类号： G06T3/0093 ,  G06T3/0012 ,  G06T3/4046

摘要： Techniques are disclosed for resampling images. In some embodiments, a resampling model includes (1) one or more feature extraction layers that extract features from an input image and a degradation map; (2) one or more resampling layers that generate warped features from the extracted features and a warp grid; and (3) one or more prediction layers that generate, from the warped features, an output image or resampling kernels that can be applied to the input image to generate an output image. In some embodiments, the resampling model can be trained by applying degradation maps to output images in a training data set to generate corresponding input images, and training the resampling model using the input images and the corresponding output images.