公开(公告)号：US20130033612A1

公开(公告)日：2013-02-07

申请号：US13195776

申请日：2011-08-01

申请人： Yongjun Wu ,  Matthew Wozniak ,  Shyam Sadhwani ,  Naveen Thumpudi

发明人： Yongjun Wu ,  Matthew Wozniak ,  Shyam Sadhwani ,  Naveen Thumpudi

IPC分类号： H04N5/228

CPC分类号： G06T5/002 ,  G06T2207/20182 ,  H04N5/23254 ,  H04N5/23267

摘要： Reduced latency video stabilization methods and tools generate truncated filters for use in the temporal smoothing of global motion transforms representing jittery motion in captured video. The truncated filters comprise future and past tap counts that can be different from each other and are typically less than those of a baseline filter providing a baseline of video stabilization quality. The truncated filter future tap count can be determined experimentally by comparing a smoothed global motion transform set generated by applying a baseline filter to a video segment to those generated by multiple test filter with varying future tap counts, then settings the truncated filter future tap count based on an inflection point on an error-future tap count curve. A similar approach can be used to determine the truncated filter past tap count.

摘要翻译： 减少延迟视频稳定方法和工具生成截断的滤波器，用于表示捕获视频中的抖动运动的全局运动变换的时间平滑。 截断的滤波器包括可以彼此不同的未来和过去的分接计数，并且通常小于提供视频稳定质量基准线的基线滤波器。 可以通过将通过将基线滤波器应用于视频段而产生的平滑的全局运动变换集合与由具有变化的未来抽头计数的多个测试滤波器生成的平滑的全局运动变换集进行比较来确定截断过滤器未来抽头计数，然后设置截断的过滤器未来抽头计数 在错误 - 未来抽头计数曲线上的拐点上。 可以使用类似的方法来确定截断过滤器通过抽头计数。

公开(公告)号：US20120154526A1

公开(公告)日：2012-06-21

申请号：US12972292

申请日：2010-12-17

申请人： Gang Ji ,  Shijun Sun ,  Yongjun Wu ,  Shyam Sadhwani

发明人： Gang Ji ,  Shijun Sun ,  Yongjun Wu ,  Shyam Sadhwani

IPC分类号： H04N13/04 ,  H04N13/00

CPC分类号： H04N13/334 ,  H04N13/106 ,  H04N13/15 ,  H04N13/341

摘要： Methods are disclosed for supporting stereo 3D video in computing devices. A computing device can receive stereo 3D video data employing a YUV color space and chroma subsampling, and can generate anaglyph video data therefrom. The anaglyph video data can be generated by unpacking the stereo 3D video data to left and right views and combining the left and right views into a single view via matrix transformation. The combining uses transform matrices that correspond to a video pipeline configuration. The transform matrix coefficients can depend on characteristics of the video pipeline components. Modified transform matrix coefficients can be used in response to changes in the video pipeline configuration. Video encoded in stereo 3D video data can be selected to be displayed in stereo 3D, anaglyph or monoscopic form, depending on user input and/or characteristics of video pipeline components.

摘要翻译： 公开了用于在计算设备中支持立体3D视频的方法。 计算设备可以使用YUV颜色空间和色度子采样来接收立体3D视频数据，并且可以从其生成浮雕视频数据。 可以通过将立体3D视频数据解包为左视图和右视图并通过矩阵变换将左视图和右视图组合成单个视图来生成浮雕视频数据。 组合使用对应于视频流水线配置的变换矩阵。 变换矩阵系数可以取决于视频管线组件的特性。 修改后的变换矩阵系数可用于响应视频流水线配置的变化。 可以根据用户输入和/或视频流水线部件的特性，选择以立体3D，浮雕形式或单视角形式显示立体3D视频数据编码的视频。

公开(公告)号：US20100128778A1

公开(公告)日：2010-05-27

申请号：US12323055

申请日：2008-11-25

申请人： Gang Ji ,  Naveen Thumpudi ,  Shyam Sadhwani ,  Yongjun Wu

发明人： Gang Ji ,  Naveen Thumpudi ,  Shyam Sadhwani ,  Yongjun Wu

IPC分类号： H04N7/30 ,  H04N7/26

CPC分类号： H04N19/42 ,  H04N19/44 ,  H04N19/61 ,  H04N19/89 ,  H04N19/93

摘要： Adjustment of hardware acceleration level in a video decoder utilizing hardware acceleration is described. Errors are detected in a bitstream as it is decoded using different levels of error detection based on decoding characteristics. A statistical analysis is performed on the error values as they are detected. In one technique, if the bitstream is categorized as fitting a high error rate state in a bitstream model, then hardware acceleration is dropped. In another technique, error statistics based on run-lengths of good and bad bitstream units are kept, and compared to predetermined thresholds. If the thresholds are exceeded, the hardware acceleration level is dropped. The level is dropped in order to take advantage of superior error handing abilities of software-based decoding over hardware-accelerated decoding.

摘要翻译： 描述了利用硬件加速度调整视频解码器中的硬件加速度水平。 在比特流中检测到错误，因为它使用基于解码特性的不同级别的错误检测被解码。 在检测到误差值时进行统计分析。 在一种技术中，如果比特流被分类为在比特列模型中拟合高错误率状态，则硬件加速度下降。 在另一种技术中，保持基于良好和不良比特流单元的游程长度的误差统计，并与预定阈值进行比较。 如果超过阈值，则硬件加速等级会下降。 为了利用基于硬件加速解码的基于软件的解码的优异的错误处理能力，该级别被丢弃。

公开(公告)号：US09824426B2

公开(公告)日：2017-11-21

申请号：US13195776

申请日：2011-08-01

申请人： Yongjun Wu ,  Matthew Wozniak ,  Shyam Sadhwani ,  Naveen Thumpudi

发明人： Yongjun Wu ,  Matthew Wozniak ,  Shyam Sadhwani ,  Naveen Thumpudi

IPC分类号： H04N5/228 ,  H04N5/232 ,  G06T5/00

CPC分类号： G06T5/002 ,  G06T2207/20182 ,  H04N5/23254 ,  H04N5/23267

摘要： Reduced latency video stabilization methods and tools generate truncated filters for use in the temporal smoothing of global motion transforms representing jittery motion in captured video. The truncated filters comprise future and past tap counts that can be different from each other and are typically less than those of a baseline filter providing a baseline of video stabilization quality. The truncated filter future tap count can be determined experimentally by comparing a smoothed global motion transform set generated by applying a baseline filter to a video segment to those generated by multiple test filter with varying future tap counts, then settings the truncated filter future tap count based on an inflection point on an error-future tap count curve. A similar approach can be used to determine the truncated filter past tap count.

公开(公告)号：US20160277751A1

公开(公告)日：2016-09-22

申请号：US14663364

申请日：2015-03-19

申请人： Patrick J. Sweeney ,  Yongjun Wu ,  Shyam Sadhwani

发明人： Patrick J. Sweeney ,  Yongjun Wu ,  Shyam Sadhwani

IPC分类号： H04N19/169 ,  H04N19/12 ,  H04N19/70 ,  H04N19/172

CPC分类号： H04N19/188 ,  H04N19/12 ,  H04N19/172 ,  H04N19/20 ,  H04N19/25 ,  H04N19/46 ,  H04N19/70

摘要： Technologies are described herein for providing enhanced packaging, coding, decoding and unpackaging of geometric data. In some configurations, geometric data is obtained by a device. The geometric data is partitioned into data partitions representing reconstruction information for video frames. The data partitions representing frames are then converted and integrated into a network abstraction layer of a bit stream. Geometric data may be obtained from the bit stream by accessing the data partitions from the network abstraction layer. The data partitions can be then processed into geometric data for further processing, such as the reconstruction, generation, display or processing of a three dimensional (3D) object modeled by the geometric data.

摘要翻译： 本文描述了技术，用于提供增强的封装，编码，解码和拆封几何数据。 在某些配置中，几何数据由设备获得。 几何数据被分割成表示视频帧的重建信息的数据分区。 然后将表示帧的数据分区转换并集成到位流的网络抽象层中。 可以通过从网络抽象层访问数据分区从比特流获得几何数据。 然后可以将数据分区处理成用于进一步处理的几何数据，例如由几何数据建模的三维（3D）对象的重建，生成，显示或处理。

公开(公告)号：US09241167B2

公开(公告)日：2016-01-19

申请号：US13399769

申请日：2012-02-17

申请人： Yongjun Wu ,  Shyam Sadhwani ,  Naveen Thumpudi

发明人： Yongjun Wu ,  Shyam Sadhwani ,  Naveen Thumpudi

IPC分类号： H04N7/26 ,  H04N19/157 ,  H04N19/12 ,  H04N19/46

CPC分类号： H04N19/44 ,  H04N19/103 ,  H04N19/12 ,  H04N19/129 ,  H04N19/157 ,  H04N19/174 ,  H04N19/176 ,  H04N19/46 ,  H04N19/70

摘要： A video decoder is disclosed that uses metadata in order to make optimization decisions. In one embodiment, metadata is used to choose which of multiple available decoder engines should receive a video sequence. In another embodiment, the optimization decisions can be based on length and location metadata information associated with a video sequence. Using such metadata information, a decoder engine can skip start-code scanning to make the decoding process more efficient. Also based on the choice of decoder engine, it can decide whether emulation prevention byte removal shall happen together with start code scanning or not.

摘要翻译： 公开了使用元数据以进行优化决定的视频解码器。 在一个实施例中，使用元数据来选择多个可用解码器引擎应当接收视频序列中的哪一个。 在另一个实施例中，优化决定可以基于与视频序列相关联的长度和位置元数据信息。 使用这样的元数据信息，解码器引擎可以跳过起始码扫描，以使解码过程更有效率。 同样基于解码器引擎的选择，它可以决定是否与启动代码扫描一起发生仿真预防字节删除。

公开(公告)号：US09131241B2

公开(公告)日：2015-09-08

申请号：US12323055

申请日：2008-11-25

申请人： Gang Ji ,  Naveen Thumpudi ,  Shyam Sadhwani ,  Yongjun Wu

发明人： Gang Ji ,  Naveen Thumpudi ,  Shyam Sadhwani ,  Yongjun Wu

IPC分类号： H04N5/85 ,  H04N19/42 ,  H04N19/61 ,  H04N19/44 ,  H04N19/89 ,  H04N19/93

CPC分类号： H04N19/42 ,  H04N19/44 ,  H04N19/61 ,  H04N19/89 ,  H04N19/93

摘要： Adjustment of hardware acceleration level in a video decoder utilizing hardware acceleration is described. Errors are detected in a bitstream as it is decoded using different levels of error detection based on decoding characteristics. A statistical analysis is performed on the error values as they are detected. In one technique, if the bitstream is categorized as fitting a high error rate state in a bitstream model, then hardware acceleration is dropped. In another technique, error statistics based on run-lengths of good and bad bitstream units are kept, and compared to predetermined thresholds. If the thresholds are exceeded, the hardware acceleration level is dropped. The level is dropped in order to take advantage of superior error handing abilities of software-based decoding over hardware-accelerated decoding.

摘要翻译： 描述了利用硬件加速度调整视频解码器中的硬件加速度水平。 在比特流中检测到错误，因为它使用基于解码特性的不同级别的错误检测被解码。 在检测到错误值时进行统计分析。 在一种技术中，如果比特流被分类为在比特列模型中拟合高错误率状态，则硬件加速度下降。 在另一种技术中，保持基于良好和不良比特流单元的游程长度的误差统计，并与预定阈值进行比较。 如果超过阈值，则硬件加速等级会下降。 为了利用基于硬件加速解码的基于软件的解码的优异的错误处理能力，该级别被丢弃。

公开(公告)号：US08982942B2

公开(公告)日：2015-03-17

申请号：US13163632

申请日：2011-06-17

申请人： Wenfeng Gao ,  Shyam Sadhwani

发明人： Wenfeng Gao ,  Shyam Sadhwani

IPC分类号： H04N7/26 ,  G10L25/69 ,  H04N21/2365 ,  H04N21/238 ,  H04W28/18

CPC分类号： H04N19/156 ,  G10L25/69 ,  H04N19/103 ,  H04N19/127 ,  H04N19/147 ,  H04N19/40 ,  H04N19/46 ,  H04N21/2365 ,  H04N21/238 ,  H04W28/18

摘要： Disclosed herein are tools and techniques for storing and using video processing tool configuration information that can identify combinations of video processing tools to be used for processing video. In one exemplary embodiment, video processing tools of a computing system are identified. The performance of a combination of the video processing tools is measured. The performance measurement is compared with another performance measurement of another combination of the video processing tools. Based on the comparison, video processing tool configuration information is set. In another exemplary embodiment, video processing tool configuration information indicating a combination of video processing tools is accessed, and video data is processed using the combination of video processing tools based on the video processing tool configuration information.

摘要翻译： 本文公开了用于存储和使用视频处理工具配置信息的工具和技术，其可以识别要用于处理视频的视频处理工具的组合。 在一个示例性实施例中，识别计算系统的视频处理工具。 测量视频处理工具的组合的性能。 将性能测量与视频处理工具的另一组合的另一性能测量进行比较。 根据比较，设置视频处理工具配置信息。 在另一个示例性实施例中，访问指示视频处理工具的组合的视频处理工具配置信息，并且使用基于视频处理工具配置信息的视频处理工具的组合来处理视频数据。

公开(公告)号：US08860785B2

公开(公告)日：2014-10-14

申请号：US12972292

申请日：2010-12-17

申请人： Gang Ji ,  Shijun Sun ,  Yongjun Wu ,  Shyam Sadhwani

发明人： Gang Ji ,  Shijun Sun ,  Yongjun Wu ,  Shyam Sadhwani

IPC分类号： H04N13/04 ,  H04N13/00

CPC分类号： H04N13/334 ,  H04N13/106 ,  H04N13/15 ,  H04N13/341

摘要： Methods are disclosed for supporting stereo 3D video in computing devices. A computing device can receive stereo 3D video data employing a YUV color space and chroma subsampling, and can generate anaglyph video data therefrom. The anaglyph video data can be generated by unpacking the stereo 3D video data to left and right views and combining the left and right views into a single view via matrix transformation. The combining uses transform matrices that correspond to a video pipeline configuration. The transform matrix coefficients can depend on characteristics of the video pipeline components. Modified transform matrix coefficients can be used in response to changes in the video pipeline configuration. Video encoded in stereo 3D video data can be selected to be displayed in stereo 3D, anaglyph or monoscopic form, depending on user input and/or characteristics of video pipeline components.

摘要翻译： 公开了用于在计算设备中支持立体3D视频的方法。 计算设备可以使用YUV颜色空间和色度子采样来接收立体3D视频数据，并且可以从其生成浮雕视频数据。 可以通过将立体3D视频数据解包为左视图和右视图并通过矩阵变换将左视图和右视图组合成单个视图来生成浮雕视频数据。 组合使用对应于视频流水线配置的变换矩阵。 变换矩阵系数可以取决于视频管线组件的特性。 修改后的变换矩阵系数可用于响应视频流水线配置的变化。 可以根据用户输入和/或视频流水线部件的特性，选择以立体3D，浮雕形式或单视角形式显示立体3D视频数据编码的视频。

公开(公告)号：US08731067B2

公开(公告)日：2014-05-20

申请号：US13223079

申请日：2011-08-31

申请人： Yongjun Wu ,  Shyam Sadhwani

发明人： Yongjun Wu ,  Shyam Sadhwani

IPC分类号： H04N7/12 ,  H04N11/02 ,  H04N11/04

CPC分类号： H04N19/423 ,  H04N19/0049 ,  H04N19/127 ,  H04N19/136 ,  H04N19/159 ,  H04N19/172 ,  H04N19/176 ,  H04N19/426 ,  H04N19/44

摘要： Techniques and tools described herein help manage memory efficiently during video decoding, especially when multiple video clips are concurrently decoded. For example, with clip-adaptive memory usage, a decoder determines first memory usage settings expected to be sufficient for decoding of a video clip. The decoder also determines second memory usage settings known to be sufficient for decoding of the clip. During decoding, memory usage is initially set according to the first settings. Memory usage is adaptively increased during decoding, subject to theoretical limits in the second settings. With adaptive early release of side information, the decoder can release side information memory for a picture earlier than the decoder releases image plane memory for the picture. The decoder can also adapt memory usage for decoded transform coefficients depending on whether the coefficients are for intra-coded blocks or inter-coded blocks, and also exploit the relative sparseness of non-zero coefficient values.

摘要翻译： 这里描述的技术和工具有助于在视频解码期间有效地管理存储器，特别是当多个视频片段被同时解码时。 例如，利用剪辑自适应存储器使用，解码器确定预期对视频剪辑的解码足够的第一存储器使用设置。 解码器还确定已知足以解码剪辑的第二存储器使用设置。 在解码期间，最初根据第一个设置设置内存使用。 存储器使用在解码期间自适应地增加，受到第二设置中的理论限制。 利用辅助信息的适应性早期释放，解码器可以在解码器释放用于图像的图像平面存储器之前释放用于图像的侧信息存储器。 解码器还可以根据系数是用于帧内编码块还是帧间编码块来适应解码变换系数的存储器使用，并且还利用非零系数值的相对稀疏度。