Real time processing and streaming of spliced encoded MPEG video and associated audio
    2.
    发明授权
    Real time processing and streaming of spliced encoded MPEG video and associated audio 有权
    拼接编码MPEG视频及相关音频的实时处理和流式传输

    公开(公告)号:US06792047B1

    公开(公告)日:2004-09-14

    申请号:US09539747

    申请日:2000-03-31

    IPC分类号: H04N712

    摘要: Time stamps in an encoded digital motion video data stream (such as an MPEG Transport Stream) are re-stamped for seamless splicing. The re-stamping includes attainment of Presentation Time Stamp (PTS) agreement in the video stream, alignment of audio stream and video stream Presentation Time Stamps, and re-stamping of the Program Clock Reference (PCR) to eliminate jitter and to comply with MPEG standards. The MPEG compliance is achieved by padding, stuffing and insertion of freeze B and P frames and pre-encoded black I frames. Freeze frame insertion can be also achieved by replacing B and P frames by, smaller in size, freeze B and P frames respectively. No frames are discarded such that both spatial and temporal frame accuracy (no extra frame insertion assumed) is achieved. Moreover, padding is inserted into the data stream to compensate for irregularities in the decoder buffer level, and the audio and video buffer levels are managed dynamically to recover from data miss-delivery to minimize secondary effects, including prediction of errors, inducing freeze or skip, and insertion of padding. The start of the play of the second MPEG stream spliced to the first one is frame accurate and starts as scheduled based on the use of an external clock signal in a stream server computer.

    摘要翻译: 经编码的数字运动视频数据流(例如MPEG传输流)中的时间戳被重新标记以用于无缝拼接。 重新标记包括在视频流中实现呈现时间戳(PTS)协议,音频流和视频流呈现时间戳的对准以及程序时钟参考(PCR)的重新标记以消除抖动并遵守MPEG 标准。 通过填充,填充和插入冻结B和P​​帧以及预编码的黑色I帧来实现MPEG符合性。 也可以通过将B和P帧分别代替较小的B帧和P帧来实现冻结帧插入。 不丢弃任何帧,从而实现空间和时间帧精度(不考虑额外的帧插入)。 此外,将填充插入到数据流中以补偿解码器缓冲器级别中的不规则性,并且动态地管理音频和视频缓冲器级别以从数据未命中传送恢复以最小化次要效应,包括误差预测,诱导冻结或跳过 ,并插入填充。 拼接到第一MPEG的第二MPEG流的播放的开始是帧精确的,并且基于流服务器计算机中的外部时钟信号的使用而按照调度开始。

    Seamless splicing of encoded MPEG video and audio
    3.
    发明授权
    Seamless splicing of encoded MPEG video and audio 有权
    编码MPEG视频和音频的无缝拼接

    公开(公告)号:US06678332B1

    公开(公告)日:2004-01-13

    申请号:US09540347

    申请日:2000-03-31

    IPC分类号: H04B166

    摘要: Predictive analysis is performed upon encoded digital motion video (such as an MPEG Transport Stream) to facilitate real-time splicing. The predictive analysis includes estimation of upper and lower bounds of the data levels in a decoder's video and audio buffers for splicing in such a way as to prevent buffer overflow and underflow. This enables buffer management techniques including padding or stuffing, micro-restamping, freeze or repeat of frames, skip or drop of frames, alignment of audio with video. The predictive analysis also includes analysis of the structure of the encoded audio including audio access units (AAUs) and compression windows (AFs), prediction in the compressed domain of initial conditions of the decoder buffer levels for every single Elementary Stream (ES) component of a Transport Stream (TS), and identification of valid splicing In Points and Out Points based on the predicted buffer levels without any special encoder. This permits splicing of different compressed audio types without consideration of the details of the compression mechanism. The predictive analysis may also include recommendations or marking. The analysis is performed on ingest of the data as a pre-processing in preparation for splicing of a new file on early queuing in a data storage system before streaming.

    摘要翻译: 在编码的数字运动视频(例如MPEG传输流)上执行预测分析以便于实时拼接。 预测分析包括在解码器的视频和音频缓冲器中估计数据电平的上限和下限以进行拼接,以防止缓冲器溢出和下溢。 这使得能够实现缓冲器管理技术,包括填充或填充,微型停止,帧的冻结或重复,帧的跳过或掉落,音频与视频的对齐。 预测分析还包括对包括音频访问单元(AAU)和压缩窗口(AF)的编码音频的结构的分析,在压缩域中对每个单个基本流(ES)分量的解码器缓冲器级别的初始条件的预测 传输流(TS),以及基于没有任何特殊编码器的预测缓冲器级别来识别有效拼接点和点。 这允许不考虑压缩机构的细节来剪接不同的压缩音频类型。 预测分析还可能包括建议或标记。 对数据进行分析,作为预处理,准备在流媒体之前在数据存储系统的早期排队中拼接新文件。

    Preparation of metadata for splicing of encoded MPEG video and audio
    4.
    发明授权
    Preparation of metadata for splicing of encoded MPEG video and audio 有权
    准备用于拼接编码MPEG视频和音频的元数据

    公开(公告)号:US07096481B1

    公开(公告)日:2006-08-22

    申请号:US09540306

    申请日:2000-03-31

    IPC分类号: H04N7/12

    摘要: Metadata for splicing of an encoded digital motion video stream (such as an MPEG Transport Stream) is prepared in real time while recording at the encoding bit rate and faster than encoded bit rate for off line encoding independent of the bit rate and mechanisms for ingestion of the data stream into data storage. Preprocessing is performed during a metered file transfer protocol (FTP) and includes pseudo real-time encoding. The preprocessing includes Group of Pictures (GOP) level pre-processing of splicing In Points and results in an intimate linkage between metadata and the file system in which the video data is stored. The preferred file system enables access to metadata in parallel to writing the data on disk. The pre-processing is performed simultaneous to writing the data to the disk using a carousel type buffer mechanism.

    摘要翻译: 用于编码的数字运动视频流(例如MPEG传输流)的拼接的元数据是以编码比特率记录并且比编码的比特率更快地编码,用于离线编码,独立于比特率和摄取的机制 将数据流转换成数据存储。 预处理在计量文件传输协议(FTP)期间执行,并包括伪实时编码。 预处理包括拼接In点的图像组(GOP)级预处理,并且导致元数据和存储视频数据的文件系统之间的密切连接。 首选文件系统可以并行访问元数据以将数据写入磁盘。 使用轮播式缓冲机制将数据同时写入到磁盘上进行预处理。

    Method of pausing an MPEG coded video stream
    5.
    发明授权
    Method of pausing an MPEG coded video stream 有权
    暂停MPEG编码视频流的方法

    公开(公告)号:US07023924B1

    公开(公告)日:2006-04-04

    申请号:US09750554

    申请日:2000-12-28

    IPC分类号: H04N7/12

    摘要: To produce a paused MPEG coded video stream from an original MPEG coded video stream, an I frame is extracted from the original stream, and a Group of Pictures for a “pause” (a pause GOP) is constructed containing the extracted I frame, some “frozen” frames, and padding. Each “frozen” frame is a P frame that repeats the I frame. When a pause is requested in the original stream, a seamless transition is made from the I frame to the pause GOP, and the pause GOP is played in a loop until a resume is requested. To resume, the pause GOP is completed and a seamless transition is made to continue in the original stream from the I frame where the pause had begun.

    摘要翻译: 为了从原始MPEG编码视频流产生暂停的MPEG编码视频流,从原始流中提取I帧,并且构造一组用于“暂停”(暂停GOP)的图像,其包含提取的I帧,一些 “冻结”帧和填充。 每个“冻结”帧是重复I帧的P帧。 当在原始流中请求暂停时,从I帧到暂停GOP进行无缝转换,并且循环播放暂停GOP直到请求恢复。 要恢复,暂停GOP完成,并且从暂停开始的I帧继续原始流中的无缝转换。

    Generation of MPEG slow motion playout
    6.
    发明授权
    Generation of MPEG slow motion playout 有权
    生成MPEG慢动作播放

    公开(公告)号:US06980594B2

    公开(公告)日:2005-12-27

    申请号:US09951853

    申请日:2001-09-11

    摘要: MPEG coded video data includes groups of pictures (GOPs). Each group of pictures includes one or more I-frames and a plurality of B- or P-frames. To produce an MPEG slow-forward coded video stream, the coding type of each frame in the MPEG coded video data is identified, and freeze frames are inserted as a predefined function of the identified coding type and as a predefined function of a desired slow down factor. In a preferred implementation, for a slow-down factor of n, for each original I- or P-frame, (n−1) backward-predicted freeze frames are inserted, and for each original B-frame, (n−1) copies of the original B-frames are added, and a selected amount of padding is added to each copy of each original B-frame in order to obtain a normal play bit rate and avoid video buffer overflow or underflow.

    摘要翻译: MPEG编码的视频数据包括图像组(GOP)。 每组图像包括一个或多个I帧和多个B帧或P帧。 为了产生MPEG慢速编码视频流,识别MPEG编码视频数据中的每一帧的编码类型,并且将冻结帧作为所识别的编码类型的预定函数插入,并作为期望的减速的预定义函数 因子。 在优选的实施方案中,对于每个原始I或P帧的减速因子n,插入(n-1)个反向预测的冻结帧,并且对于每个原始B帧,(n-1) 添加原始B帧的副本,并且为每个原始B帧的每个副本添加所选择的填充量,以便获得正常的播放比特率并避免视频缓冲器溢出或下溢。