-
公开(公告)号:US20120250772A1
公开(公告)日:2012-10-04
申请号:US13078852
申请日:2011-04-01
申请人: Wenfeng Gao , Yongjun Wu , Shyam Sadhwani
发明人: Wenfeng Gao , Yongjun Wu , Shyam Sadhwani
IPC分类号: H04N7/26
CPC分类号: H04N19/865 , H04N19/117 , H04N19/127 , H04N19/157 , H04N19/159 , H04N19/16 , H04N19/172 , H04N19/436 , H04N19/82 , H04N19/86
摘要: Multi-threaded implementations of deblock filtering improve encoding and/or decoding efficiency. For example, a video encoder or decoder partitions a video picture into multiple segments. The encoder/decoder selects between multiple different patterns for splitting operations of deblock filtering into multiple passes. The encoder/decoder organizes the deblock filtering as multiple tasks, where a given task includes the operations of one of the passes for one of the segments. The encoder/decoder then performs the tasks with multiple threads. The performance of the tasks is constrained by task dependencies which, in general, are based at least in part on which lines of the picture are in the respective segments and which deblock filtering operations are in the respective passes. The task dependencies can include a cross-pass, cross-segment dependency between a given pass of a given segment and an adjacent pass of an adjacent segment.
摘要翻译: 去块滤波的多线程实现提高了编码和/或解码效率。 例如,视频编码器或解码器将视频图像分割成多个段。 编码器/解码器在多个不同的模式之间进行选择,用于将去块滤波的分割操作分成多个通道。 编码器/解码器将去块滤波器组织为多个任务,其中给定任务包括其中一个段的一个通路的操作。 然后,编码器/解码器使用多个线程执行任务。 任务的执行受到任务依赖性的约束,通常,至少部分地基于图片的哪些行在相应的段中,以及哪些去块过滤操作在相应的遍历中。 任务依赖性可以包括给定段的给定遍和相邻段的相邻段之间的交叉遍,跨段依赖性。
-
公开(公告)号:US20120320967A1
公开(公告)日:2012-12-20
申请号:US13163632
申请日:2011-06-17
申请人: Wenfeng Gao , Shyam Sadhwani
发明人: Wenfeng Gao , Shyam Sadhwani
IPC分类号: H04N7/26
CPC分类号: H04N19/156 , G10L25/69 , H04N19/103 , H04N19/127 , H04N19/147 , H04N19/40 , H04N19/46 , H04N21/2365 , H04N21/238 , H04W28/18
摘要: Disclosed herein are tools and techniques for storing and using video processing tool configuration information that can identify combinations of video processing tools to be used for processing video. In one exemplary embodiment, video processing tools of a computing system are identified. The performance of a combination of the video processing tools is measured. The performance measurement is compared with another performance measurement of another combination of the video processing tools. Based on the comparison, video processing tool configuration information is set. In another exemplary embodiment, video processing tool configuration information indicating a combination of video processing tools is accessed, and video data is processed using the combination of video processing tools based on the video processing tool configuration information.
摘要翻译: 本文公开了用于存储和使用视频处理工具配置信息的工具和技术,其可以识别要用于处理视频的视频处理工具的组合。 在一个示例性实施例中,识别计算系统的视频处理工具。 测量视频处理工具的组合的性能。 将性能测量与视频处理工具的另一组合的另一性能测量进行比较。 根据比较,设置视频处理工具配置信息。 在另一个示例性实施例中,访问指示视频处理工具的组合的视频处理工具配置信息,并且使用基于视频处理工具配置信息的视频处理工具的组合来处理视频数据。
-
公开(公告)号:US09042458B2
公开(公告)日:2015-05-26
申请号:US13078852
申请日:2011-04-01
申请人: Wenfeng Gao , Yongjun Wu , Shyam Sadhwani
发明人: Wenfeng Gao , Yongjun Wu , Shyam Sadhwani
IPC分类号: H04N7/26 , H04N19/86 , H04N19/159 , H04N19/172 , H04N19/127 , H04N19/16 , H04N19/436 , H04N19/82
CPC分类号: H04N19/865 , H04N19/117 , H04N19/127 , H04N19/157 , H04N19/159 , H04N19/16 , H04N19/172 , H04N19/436 , H04N19/82 , H04N19/86
摘要: Multi-threaded implementations of deblock filtering improve encoding and/or decoding efficiency. For example, a video encoder or decoder partitions a video picture into multiple segments. The encoder/decoder selects between multiple different patterns for splitting operations of deblock filtering into multiple passes. The encoder/decoder organizes the deblock filtering as multiple tasks, where a given task includes the operations of one of the passes for one of the segments. The encoder/decoder then performs the tasks with multiple threads. The performance of the tasks is constrained by task dependencies which, in general, are based at least in part on which lines of the picture are in the respective segments and which deblock filtering operations are in the respective passes. The task dependencies can include a cross-pass, cross-segment dependency between a given pass of a given segment and an adjacent pass of an adjacent segment.
摘要翻译: 去块滤波的多线程实现提高了编码和/或解码效率。 例如,视频编码器或解码器将视频图像分割成多个段。 编码器/解码器在多个不同的模式之间进行选择,用于将去块滤波的分割操作分成多个通道。 编码器/解码器将去块滤波器组织为多个任务,其中给定任务包括其中一个段的一个通路的操作。 然后,编码器/解码器使用多个线程执行任务。 任务的执行受到任务依赖性的约束,通常,至少部分地基于图片的哪些行在相应的段中以及哪些去块过滤操作在相应的遍历中。 任务依赖性可以包括给定段的给定遍和相邻段的相邻段之间的交叉,跨段依赖性。
-
公开(公告)号:US08982942B2
公开(公告)日:2015-03-17
申请号:US13163632
申请日:2011-06-17
申请人: Wenfeng Gao , Shyam Sadhwani
发明人: Wenfeng Gao , Shyam Sadhwani
IPC分类号: H04N7/26 , G10L25/69 , H04N21/2365 , H04N21/238 , H04W28/18
CPC分类号: H04N19/156 , G10L25/69 , H04N19/103 , H04N19/127 , H04N19/147 , H04N19/40 , H04N19/46 , H04N21/2365 , H04N21/238 , H04W28/18
摘要: Disclosed herein are tools and techniques for storing and using video processing tool configuration information that can identify combinations of video processing tools to be used for processing video. In one exemplary embodiment, video processing tools of a computing system are identified. The performance of a combination of the video processing tools is measured. The performance measurement is compared with another performance measurement of another combination of the video processing tools. Based on the comparison, video processing tool configuration information is set. In another exemplary embodiment, video processing tool configuration information indicating a combination of video processing tools is accessed, and video data is processed using the combination of video processing tools based on the video processing tool configuration information.
摘要翻译: 本文公开了用于存储和使用视频处理工具配置信息的工具和技术,其可以识别要用于处理视频的视频处理工具的组合。 在一个示例性实施例中,识别计算系统的视频处理工具。 测量视频处理工具的组合的性能。 将性能测量与视频处理工具的另一组合的另一性能测量进行比较。 根据比较,设置视频处理工具配置信息。 在另一个示例性实施例中,访问指示视频处理工具的组合的视频处理工具配置信息,并且使用基于视频处理工具配置信息的视频处理工具的组合来处理视频数据。
-
公开(公告)号:US20120147973A1
公开(公告)日:2012-06-14
申请号:US12966914
申请日:2010-12-13
申请人: Yongjun Wu , Gang Ji , Shyam Sadhwani
发明人: Yongjun Wu , Gang Ji , Shyam Sadhwani
IPC分类号: H04N7/26
CPC分类号: H04N19/188 , H04N19/103 , H04N19/156 , H04N19/1883 , H04N19/42 , H04N19/44 , H04N19/70
摘要: Techniques and tools for reducing latency in video decoding for real-time communication applications that emphasize low delay. For example, a tool such as a video decoder selects a low-latency decoding mode. Based on the selected decoding mode, the tool adjusts output timing determination, picture boundary detection, number of pictures in flight and/or jitter buffer utilization. For low-latency decoding, the tool can use a frame count syntax element to set initial output delay for a decoded picture buffer, and the tool can use auxiliary delimiter syntax elements to detect picture boundaries. To further reduce delay in low-latency decoding, the tool can reduce number of pictures in flight for multi-threaded decoding and reduce or remove jitter buffers. The tool receives encoded data, performs decoding according to the selected decoding mode to reconstruct pictures, and outputs the pictures for display.
摘要翻译: 用于减少视频解码中延迟延迟的技术和工具,用于强调低延迟的实时通信应用。 例如,诸如视频解码器的工具选择低延迟解码模式。 基于选择的解码模式,该工具调整输出定时确定,图像边界检测,飞行中的图像数和/或抖动缓冲器利用率。 对于低延迟解码,该工具可以使用帧计数语法元素为解码图像缓冲区设置初始输出延迟,并且该工具可以使用辅助分隔符语法元素来检测图像边界。 为了进一步减少低延迟解码的延迟,该工具可以减少飞行中用于多线程解码的图片数量,并减少或删除抖动缓冲区。 该工具接收编码数据,根据选择的解码模式执行解码以重构图像,并输出用于显示的图像。
-
公开(公告)号:US08885729B2
公开(公告)日:2014-11-11
申请号:US12966914
申请日:2010-12-13
申请人: Yongjun Wu , Gang Ji , Shyam Sadhwani
发明人: Yongjun Wu , Gang Ji , Shyam Sadhwani
IPC分类号: H04N11/02 , H04N19/103 , H04N19/44 , H04N19/42 , H04N19/70 , H04N19/156
CPC分类号: H04N19/188 , H04N19/103 , H04N19/156 , H04N19/1883 , H04N19/42 , H04N19/44 , H04N19/70
摘要: Techniques and tools for reducing latency in video decoding for real-time communication applications that emphasize low delay. For example, a tool such as a video decoder selects a low-latency decoding mode. Based on the selected decoding mode, the tool adjusts output timing determination, picture boundary detection, number of pictures in flight and/or jitter buffer utilization. For low-latency decoding, the tool can use a frame count syntax element to set initial output delay for a decoded picture buffer, and the tool can use auxiliary delimiter syntax elements to detect picture boundaries. To further reduce delay in low-latency decoding, the tool can reduce number of pictures in flight for multi-threaded decoding and reduce or remove jitter buffers. The tool receives encoded data, performs decoding according to the selected decoding mode to reconstruct pictures, and outputs the pictures for display.
摘要翻译: 用于减少视频解码中延迟延迟的技术和工具,用于强调低延迟的实时通信应用。 例如,诸如视频解码器的工具选择低延迟解码模式。 基于选择的解码模式,该工具调整输出定时确定,图像边界检测,飞行中的图像数和/或抖动缓冲器利用率。 对于低延迟解码,该工具可以使用帧计数语法元素为解码图像缓冲区设置初始输出延迟,并且该工具可以使用辅助分隔符语法元素来检测图像边界。 为了进一步减少低延迟解码的延迟,该工具可以减少飞行中用于多线程解码的图片数量,并减少或删除抖动缓冲区。 该工具接收编码数据,根据选择的解码模式执行解码以重构图像,并输出用于显示的图像。
-
公开(公告)号:US20130051478A1
公开(公告)日:2013-02-28
申请号:US13223079
申请日:2011-08-31
申请人: Yongjun Wu , Shyam Sadhwani
发明人: Yongjun Wu , Shyam Sadhwani
IPC分类号: H04N7/26
CPC分类号: H04N19/423 , H04N19/0049 , H04N19/127 , H04N19/136 , H04N19/159 , H04N19/172 , H04N19/176 , H04N19/426 , H04N19/44
摘要: Techniques and tools described herein help manage memory efficiently during video decoding, especially when multiple video clips are concurrently decoded. For example, with clip-adaptive memory usage, a decoder determines first memory usage settings expected to be sufficient for decoding of a video clip. The decoder also determines second memory usage settings known to be sufficient for decoding of the clip. During decoding, memory usage is initially set according to the first settings. Memory usage is adaptively increased during decoding, subject to theoretical limits in the second settings. With adaptive early release of side information, the decoder can release side information memory for a picture earlier than the decoder releases image plane memory for the picture. The decoder can also adapt memory usage for decoded transform coefficients depending on whether the coefficients are for intra-coded blocks or inter-coded blocks, and also exploit the relative sparseness of non-zero coefficient values.
摘要翻译: 这里描述的技术和工具有助于在视频解码期间有效地管理存储器,特别是当多个视频片段被同时解码时。 例如,利用剪辑自适应存储器使用,解码器确定预期对视频剪辑的解码足够的第一存储器使用设置。 解码器还确定已知足以解码剪辑的第二存储器使用设置。 在解码期间,最初根据第一个设置设置内存使用。 存储器使用在解码期间自适应地增加,受到第二设置中的理论限制。 利用辅助信息的适应性早期释放,解码器可以在解码器释放用于图像的图像平面存储器之前释放用于图像的侧信息存储器。 解码器还可以根据系数是用于帧内编码块还是帧间编码块来适应解码变换系数的存储器使用,并且还利用非零系数值的相对稀疏度。
-
公开(公告)号:US07929599B2
公开(公告)日:2011-04-19
申请号:US11276336
申请日:2006-02-24
申请人: Anand Ganesh , Donald J Munsil , Gary J. Sullivan , Glenn F. Evans , Shyam Sadhwani , Stephen J. Estrop
发明人: Anand Ganesh , Donald J Munsil , Gary J. Sullivan , Glenn F. Evans , Shyam Sadhwani , Stephen J. Estrop
IPC分类号: H04B1/66
CPC分类号: G06F9/5044 , H04N19/12 , H04N19/124 , H04N19/127 , H04N19/154 , H04N19/156 , H04N19/42 , H04N19/61 , H04N21/242 , H04N21/4302 , H04N21/64784
摘要: A video encoding acceleration service to increase one or more of the speed and quality of video encoding is described. The service acts as an intermediary between an arbitrary video encoder computer program application and arbitrary video acceleration hardware. The service receives one or more queries from the video encoder to identify implementation specifics of the video acceleration hardware. The service interfaces with the video acceleration hardware to obtain the implementation specifics. The service communicates the implementation specifics to the video encoder. The implementation specifics enable the video encoder to: (a) determine whether one or more of speed and quality of software encoding operations associated with the video encoder can be increased with implementation of a pipeline of one or more supported encoding pipeline configurations and capabilities, and (b) implement the pipeline by interfacing with the service.
摘要翻译: 描述了增加视频编码的速度和质量中的一个或多个的视频编码加速服务。 该服务充当任意视频编码器计算机程序应用程序和任意视频加速硬件之间的中介。 该服务从视频编码器接收一个或多个查询以识别视频加速硬件的实现细节。 该服务与视频加速硬件接口获取实现细节。 该服务将实现细节传达给视频编码器。 实施细节使得视频编码器能够:(a)确定是否可以通过实现一个或多个支持的编码流水线配置和能力的流水线来增加与视频编码器相关联的软件编码操作的速度和质量的一个或多个,以及 (b)通过与服务接口实施管道。
-
公开(公告)号:US20110018889A1
公开(公告)日:2011-01-27
申请号:US12507875
申请日:2009-07-23
申请人: Firoz Dalal , Shyam Sadhwani
发明人: Firoz Dalal , Shyam Sadhwani
CPC分类号: G06F3/048 , H04N5/91 , H04N9/8205
摘要: A media processing comparison system (“MPCS”) and techniques facilitate concurrent, subjective quality comparisons between media presentations produced by different instances of media processing components performing the same functions (for example, instances of media processing components in the form of hardware, software, and/or firmware, such as parsers, codecs, decryptors, and/or demultiplexers, supplied by the same or different entities) in a particular media content player. The MPCS receives an ordered stream of encoded media samples from a media source, and decodes a particular encoded media sample using two or more different instances of media processing components. A single renderer renders and/or coordinates the synchronous presentation of decoded media samples from each instance of media processing component(s) as separate media presentations. The media presentations may be subjectively compared and/or selected for storage by a user in a sample-by-sample manner.
摘要翻译: 媒体处理比较系统(“MPCS”)和技术促进了由执行相同功能的媒体处理组件的不同实例产生的媒体呈现之间的并发的主观质量比较(例如,以硬件,软件, 和/或固件,例如由相同或不同实体提供的解析器,编解码器,解密器和/或解复用器)。 MPCS从媒体源接收编码媒体样本的有序流,并使用两个或更多个不同的媒体处理组件实例解码特定的编码媒体样本。 单个渲染器渲染和/或协调来自媒体处理组件的每个实例的解码的媒体样本的同步呈现作为单独的媒体呈现。 可以主观地比较和/或选择媒体呈现以供用户以逐个样本的方式存储。
-
公开(公告)号:US20070204318A1
公开(公告)日:2007-08-30
申请号:US11276336
申请日:2006-02-24
申请人: Anand Ganesh , Donald Munsil , Gary Sullivan , Glenn Evans , Shyam Sadhwani , Stephen Estrop
发明人: Anand Ganesh , Donald Munsil , Gary Sullivan , Glenn Evans , Shyam Sadhwani , Stephen Estrop
IPC分类号: H04N7/173
CPC分类号: G06F9/5044 , H04N19/12 , H04N19/124 , H04N19/127 , H04N19/154 , H04N19/156 , H04N19/42 , H04N19/61 , H04N21/242 , H04N21/4302 , H04N21/64784
摘要: A video encoding acceleration service to increase one or more of the speed and quality of video encoding is described. The service acts as an intermediary between an arbitrary video encoder computer program application and arbitrary video acceleration hardware. The service receives one or more queries from the video encoder to identify implementation specifics of the video acceleration hardware. The service interfaces with the video acceleration hardware to obtain the implementation specifics. The service communicates the implementation specifics to the video encoder. The implementation specifics enable the video encoder to: (a) determine whether one or more of speed and quality of software encoding operations associated with the video encoder can be increased with implementation of a pipeline of one or more supported encoding pipeline configurations and capabilities, and (b) implement the pipeline by interfacing with the service.
摘要翻译: 描述了增加视频编码的速度和质量中的一个或多个的视频编码加速服务。 该服务充当任意视频编码器计算机程序应用程序和任意视频加速硬件之间的中介。 该服务从视频编码器接收一个或多个查询以识别视频加速硬件的实现细节。 该服务与视频加速硬件接口获取实现细节。 该服务将实现细节传达给视频编码器。 实施细节使得视频编码器能够:(a)确定是否可以通过实现一个或多个支持的编码流水线配置和能力的流水线来增加与视频编码器相关联的软件编码操作的速度和质量的一个或多个,以及 (b)通过与服务接口实施管道。
-
-
-
-
-
-
-
-
-