公开(公告)号：US20230308657A1

公开(公告)日：2023-09-28

申请号：US17706095

申请日：2022-03-28

申请人： Bitmovin GmbH

发明人： Vignesh V. Menon ,  Hadi Amirpour ,  Christian Timmerer

IPC分类号： H04N19/149 ,  H04N19/30 ,  H04N19/172 ,  H04N19/179

CPC分类号： H04N19/149 ,  H04N19/30 ,  H04N19/172 ,  H04N19/179

摘要： The technology described herein relates to variable framerate encoding. A method for variable framerate encoding includes receiving shots, as segmented from a video input, extracting features for each of the shots, the features including at least a spatial energy feature and an average temporal energy, predicting a frame dropping factor for each of the shots based on the spatial energy feature and the average temporal energy, predicting an optimized framerate for each of the shots based on the frame dropping factor, downscaling and encoding each of the shots using the optimized framerate. The encoded shots may then be decoded and upscaled back to their original framerates.

公开(公告)号：US20240098247A1

公开(公告)日：2024-03-21

申请号：US18367234

申请日：2023-09-12

申请人： Bitmovin GmbH

发明人： Vignesh V. Menon ,  Hadi Amirpour ,  Christian Timmerer

IPC分类号： H04N19/103 ,  H04N19/14 ,  H04N19/42 ,  H04N21/2187 ,  H04N21/234 ,  H04N21/845

CPC分类号： H04N19/103 ,  H04N19/14 ,  H04N19/42 ,  H04N21/2187 ,  H04N21/23418 ,  H04N21/8456

摘要： Techniques for content-adaptive encoder preset prediction for adaptive live streaming are described herein. A method for content-adaptive encoder preset prediction for adaptive live streaming includes performing video complexity feature extraction on a video segment to extract complexity features such as an average texture energy, an average temporal energy, and an average lumiscence. These inputs may be provided to an encoding time prediction model, along with a bitrate ladder, a resolution set, a target video encoding speed, and a number of CPU threads for the video segment, to predict an encoding time, and an optimized encoding preset may be selected for the video segment by a preset selection function using the predicted encoding time. The video segment may be encoded according to the optimized encoding preset.

公开(公告)号：US20240121400A1

公开(公告)日：2024-04-11

申请号：US18371830

申请日：2023-09-22

申请人： Bitmovin GmbH

发明人： Vignesh V. Menon ,  Hadi Amirpour ,  Christian Timmerer

IPC分类号： H04N19/14 ,  G06V10/44 ,  G06V10/60 ,  G06V10/82 ,  H04N19/124

CPC分类号： H04N19/14 ,  G06V10/44 ,  G06V10/60 ,  G06V10/82 ,  H04N19/124

摘要： Techniques for predicting video encoding complexity are described herein. A method for predicting video encoding complexity includes performing video complexity feature extraction on a video segment to extract low-complexity frame-based features, predicting video encoding complexity for the video segment using the low-complexity frame-based features, and outputting a predicted encoding bitrate and a predicted encoding time. An embodiment may include implementing a hybrid model using a CNN, wherein a latent vector from a frame of the video segment is extracted and also may be used to predict video encoding complexity. The predicted encoding bitrates and encoding times may be provided to encoding infrastructure for use in optimizing a schedule of encodings.

公开(公告)号：US20240114183A1

公开(公告)日：2024-04-04

申请号：US18371852

申请日：2023-09-22

申请人： Bitmovin GmbH

发明人： Vignesh V. Menon ,  Hadi Amirpour ,  Christian Timmerer

IPC分类号： H04N21/2343 ,  H04N21/234

CPC分类号： H04N21/2343 ,  H04N21/23418 ,  H04N21/2187

摘要： Techniques for efficient two-pass encoding for live streaming are described herein. A method for efficient two-pass encoding may include extracting low-complexity features of a video segment, predicting an optimized constant rate factor (CRF) for the video segment using the low-complexity features, and encoding the video segment with the optimized CRF at a target bitrate. A system for efficient two-pass encoding may include a feature extraction module configured to extract low-complexity features from a video segment, a neural network configured to predict an optimized CRF as a function of the low-complexity features and a target bitrate, and an encoder configured to encode the video segment using the optimized CRF at the target bitrate.

公开(公告)号：US11924437B2

公开(公告)日：2024-03-05

申请号：US17706095

申请日：2022-03-28

申请人： Bitmovin GmbH

发明人： Vignesh V. Menon ,  Hadi Amirpour ,  Christian Timmerer

IPC分类号： H04N19/00 ,  H04N19/149 ,  H04N19/172 ,  H04N19/179 ,  H04N19/30

CPC分类号： H04N19/149 ,  H04N19/172 ,  H04N19/179 ,  H04N19/30

摘要： The technology described herein relates to variable framerate encoding. A method for variable framerate encoding includes receiving shots, as segmented from a video input, extracting features for each of the shots, the features including at least a spatial energy feature and an average temporal energy, predicting a frame dropping factor for each of the shots based on the spatial energy feature and the average temporal energy, predicting an optimized framerate for each of the shots based on the frame dropping factor, downscaling and encoding each of the shots using the optimized framerate. The encoded shots may then be decoded and upscaled back to their original framerates.

公开(公告)号：US20230388511A1

公开(公告)日：2023-11-30

申请号：US18140015

申请日：2023-04-27

申请人： Bitmovin GmbH

发明人： Vignesh V. Menon ,  Hadi Amirpour ,  Christian Timmerer

IPC分类号： H04N19/136 ,  H04N19/105 ,  H04N19/30 ,  H04N19/12 ,  H04N19/61 ,  H04N19/625 ,  H04N19/42 ,  H04N19/154 ,  H04N19/184 ,  H04N21/2187

CPC分类号： H04N19/136 ,  H04N19/105 ,  H04N19/30 ,  H04N19/12 ,  H04N19/61 ,  H04N19/625 ,  H04N19/42 ,  H04N19/154 ,  H04N19/184 ,  H04N21/2187

摘要： Techniques for implementing perceptually aware per-title encoding may include receiving an input video, a set of resolutions, a maximum target bitrate and a minimum target bitrate, extracting content aware features for each segment of the input video, predicting a perceptually aware bitrate-resolution pair for each segment using a model configured to optimize for a quality metric using constants trained for each of the set of resolutions, generating a target encoding set including a set of perceptually aware bitrate-resolution pairs, and encoding the target encoding set. The content aware features may include a spatial energy feature and an average temporal energy. According to these methods only a subset of bitrates and resolutions, less than a full set of bitrates and resolutions, are encoded to provide high quality video content for streaming.