-
公开(公告)号:US11202103B1
公开(公告)日:2021-12-14
申请号:US17157871
申请日:2021-01-25
Applicant: NETFLIX, INC.
Inventor: Zhi Li
IPC: H04N19/86
Abstract: In various embodiments, a tunable VMAF application reduces an amount of influence that image enhancement operations have on perceptual video quality estimates. In operation, the tunable VMAF application computes a first value for a first visual quality metric based on reconstructed video content and a first enhancement gain limit. The tunable VMAF application computes a second value for a second visual quality metric based on the reconstructed video content and a second enhancement gain limit. Subsequently, the tunable VMAF application generates a feature value vector based on the first value for the first visual quality metric and the second value for the second visual quality metric. The tunable VMAF application executes a VMAF model based on the feature value vector to generate a tuned VMAF score that accounts, at least in part, for at least one image enhancement operation used to generate the reconstructed video content.
-
12.
公开(公告)号:US10911513B2
公开(公告)日:2021-02-02
申请号:US16036600
申请日:2018-07-16
Applicant: NETFLIX, INC.
Inventor: Zhi Li , Te-Yuan Huang
IPC: H04L29/06
Abstract: In various embodiments, a hindsight application computes a hindsight metric value for evaluation of a video rate selection algorithm. The hindsight application determines a first encoding option associated with a source chunk of a media title based on a network throughput trace and a buffer trellis. The hindsight application determines that the first encoding option is associated with a buffered duration range. The buffered duration range is also associated with a second encoding option that is stored in the buffer trellis. After determining that the first encoding option is associated with a higher visual quality than the second encoding option, the hindsight application stores the first encoding option instead of the second encoding option in the buffer trellis to generate a modified buffer trellis. Finally, the hindsight application computes a hindsight metric value associated with a sequence of encoded chunks of the media title based on the modified buffer trellis.
-
公开(公告)号:US10827185B2
公开(公告)日:2020-11-03
申请号:US15207468
申请日:2016-07-11
Applicant: NETFLIX, Inc.
Inventor: Anne Aaron , Zhi Li , Todd Goodall
IPC: H04N19/156 , H04N19/86 , H04N19/149 , H04N19/154 , H04N19/00 , G06K9/00 , H04N17/00
Abstract: In various embodiments, a quality trainer trains a model that computes a value for a perceptual video quality metric for encoded video content. During a pre-training phase, the quality trainer partitions baseline values for metrics that describe baseline encoded video content into partitions based on genre. The quality trainer then performs cross-validation operations on the partitions to optimize hyperparameters associated with the model. Subsequently, during a training phase, the quality trainer performs training operations on the model that includes the optimized hyperparameters based on the baseline values for the metrics to generate a trained model. The trained model accurately tracks the video quality for the baseline encoded video content. Further, because the cross-validation operations minimize any potential overfitting, the trained model accurately and consistently predicts perceived video quality for non-baseline encoded video content across a wide range of genres.
-
公开(公告)号:US11758148B2
公开(公告)日:2023-09-12
申请号:US17093449
申请日:2020-11-09
Applicant: NETFLIX, INC.
Inventor: Zhi Li , Anne Aaron , Anush Moorthy , Christos Bampis
IPC: H04N19/154 , H04N19/59 , H04N21/647 , H04N19/146 , H04N21/234 , H04N21/2343 , H04N17/00 , H04N19/00 , H04N19/593
CPC classification number: H04N19/154 , H04N17/004 , H04N19/00 , H04N19/146 , H04N19/59 , H04N19/593 , H04N21/23418 , H04N21/23439 , H04N21/647
Abstract: In various embodiments, a perceptual quality application determines an absolute quality score for encoded video content viewed on a target viewing device. In operation, the perceptual quality application determines a baseline absolute quality score for the encoded video content viewed on a baseline viewing device. Subsequently, the perceptual quality application determines that a target value for a type of the target viewing device does not match a base value for the type of the baseline viewing device. The perceptual quality application computes an absolute quality score for the encoded video content viewed on the target viewing device based on the baseline absolute quality score and the target value. Because the absolute quality score is independent of the viewing device, the absolute quality score accurately reflects the perceived quality of a wide range of encoded video content when decoded and viewed on a viewing device.
-
公开(公告)号:US10862942B2
公开(公告)日:2020-12-08
申请号:US16036606
申请日:2018-07-16
Applicant: NETFLIX, INC.
Inventor: Te-Yuan Huang , Chaitanya Ekanadham , Andrew J. Berglund , Zhi Li
Abstract: In various embodiments, a hindsight application computes a total download size for a sequence of encoded chunks associated with a media title for evaluation of at least one aspect of a video streaming service. The hindsight application computes a feasible download end time associated with a source chunk of the media title based on a network throughput trace and a subsequent feasible download end time associated with a subsequent source chunk of the media title. The hindsight application then selects an encoded chunk associated with the source chunk based on the network throughput trace, the feasible download end time, and a preceding download end time associated with a preceding source chunk of the media title. Subsequently, the hindsight application computes the total download size based on the number of encoded bits included in the first encoded chunk. The total download size correlates to an upper bound on visual quality.
-
16.
公开(公告)号:US10721477B2
公开(公告)日:2020-07-21
申请号:US15890710
申请日:2018-02-07
Applicant: NETFLIX, INC.
Inventor: Zhi Li , Christos Bampis
IPC: H04N19/154 , H04N21/235 , G06N20/20 , G06K9/00 , G06K9/03 , H04N19/136 , G06T7/00 , G06N3/08 , G06K9/62 , H04N19/91
Abstract: In various embodiments, an ensemble prediction application computes a quality score for re-constructed visual content that is derived from visual content. The ensemble prediction application computes a first quality score for the re-constructed video content based on a first set of values for a first set of features and a first model that associates the first set of values with the first quality score. The ensemble prediction application computes a second quality score for the re-constructed video content based on a second set of values for a second set of features and a second model that associates the second set of values with the second quality score. Subsequently, the ensemble prediction application determines an overall quality score for the re-constructed video content based on the first quality score and the second quality score. The overall quality score indicates a level of visual quality associated with streamed video content.
-
公开(公告)号:US12075104B2
公开(公告)日:2024-08-27
申请号:US16352755
申请日:2019-03-13
Applicant: NETFLIX, INC.
Inventor: Christos Bampis , Zhi Li , Lavanya Sharan , Julie Novak , Martin Tingley
IPC: G06T7/00 , G06F18/214 , G06N20/20 , G06V10/774 , H04N19/154 , H04N21/25 , H04N17/00 , H04N19/147
CPC classification number: H04N21/252 , G06F18/214 , G06N20/20 , G06T7/0002 , G06V10/774 , H04N19/154 , G06T2207/10016 , G06T2207/20081 , G06T2207/30168 , H04N17/004 , H04N19/147
Abstract: In various embodiments, a bootstrapping training subsystem performs sampling operation(s) on a training database that includes subjective scores to generate resampled dataset. For each resampled dataset, the bootstrapping training subsystem performs machine learning operation(s) to generate a different bootstrap perceptual quality model. The bootstrapping training subsystem then uses the bootstrap perceptual quality models to quantify the accuracy of a perceptual quality score generated by a baseline perceptual quality model for a portion of encoded video content. Advantageously, relative to prior art solutions in which the accuracy of a perceptual quality score is unknown, the bootstrap perceptual quality models enable developers and software applications to draw more valid conclusions and/or more reliably optimize encoding operations based on the perceptual quality score.
-
公开(公告)号:US11949919B2
公开(公告)日:2024-04-02
申请号:US17549793
申请日:2021-12-13
Applicant: NETFLIX, INC.
Inventor: Zhi Li
IPC: H04N19/86
CPC classification number: H04N19/86
Abstract: In various embodiments, a tunable VMAF application reduces an amount of influence that image enhancement operations have on perceptual video quality estimates. In operation, the tunable VMAF application computes a first value for a first visual quality metric based on reconstructed video content and a first enhancement gain limit. The tunable VMAF application computes a second value for a second visual quality metric based on the reconstructed video content and a second enhancement gain limit. Subsequently, the tunable VMAF application generates a feature value vector based on the first value for the first visual quality metric and the second value for the second visual quality metric. The tunable VMAF application executes a VMAF model based on the feature value vector to generate a tuned VMAF score that accounts, at least in part, for at least one image enhancement operation used to generate the reconstructed video content.
-
公开(公告)号:US11363275B2
公开(公告)日:2022-06-14
申请号:US16945737
申请日:2020-07-31
Applicant: NETFLIX, INC.
Inventor: Zhi Li
IPC: H04N19/149 , H04N19/154 , H04L65/80
Abstract: In various embodiments, a data optimization application mitigates scoring inaccuracies in subjective quality experiments. In operation, the data optimization application generates a model that includes a first set of individual scores and a first set of parameters. The first set of parameters includes a first subjective score set and a first set of subjective factor sets. The data optimization application performs one or more optimization operations on the first set of parameters to generate a second set of parameters. The second set of parameters includes a second subjective score set and a second set of subjective factor sets, wherein the second subjective score set compensates for at least a first subjective factor set included in the second set of subjective factor sets. The data optimization application also computes a participant evaluation report based on at least a second subjective factor sets included in the second set of subjective factor sets.
-
公开(公告)号:US10834406B2
公开(公告)日:2020-11-10
申请号:US15782590
申请日:2017-10-12
Applicant: NETFLIX, INC.
Inventor: Zhi Li , Anne Aaron , Anush Moorthy , Christos Bampis
IPC: H04N19/154 , H04N19/59 , H04N21/647 , H04N19/146 , H04N21/234 , H04N21/2343 , H04N17/00 , H04N19/00 , H04N19/593
Abstract: In various embodiments, a perceptual quality application determines an absolute quality score for encoded video content viewed on a target viewing device. In operation, the perceptual quality application determines a baseline absolute quality score for the encoded video content viewed on a baseline viewing device. Subsequently, the perceptual quality application determines that a target value for a type of the target viewing device does not match a base value for the type of the baseline viewing device. The perceptual quality application computes an absolute quality score for the encoded video content viewed on the target viewing device based on the baseline absolute quality score and the target value. Because the absolute quality score is independent of the viewing device, the absolute quality score accurately reflects the perceived quality of a wide range of encoded video content when decoded and viewed on a viewing device.
-
-
-
-
-
-
-
-
-