公开(公告)号：US20120154526A1

公开(公告)日：2012-06-21

申请号：US12972292

申请日：2010-12-17

申请人： Gang Ji ,  Shijun Sun ,  Yongjun Wu ,  Shyam Sadhwani

发明人： Gang Ji ,  Shijun Sun ,  Yongjun Wu ,  Shyam Sadhwani

IPC分类号： H04N13/04 ,  H04N13/00

CPC分类号： H04N13/334 ,  H04N13/106 ,  H04N13/15 ,  H04N13/341

摘要： Methods are disclosed for supporting stereo 3D video in computing devices. A computing device can receive stereo 3D video data employing a YUV color space and chroma subsampling, and can generate anaglyph video data therefrom. The anaglyph video data can be generated by unpacking the stereo 3D video data to left and right views and combining the left and right views into a single view via matrix transformation. The combining uses transform matrices that correspond to a video pipeline configuration. The transform matrix coefficients can depend on characteristics of the video pipeline components. Modified transform matrix coefficients can be used in response to changes in the video pipeline configuration. Video encoded in stereo 3D video data can be selected to be displayed in stereo 3D, anaglyph or monoscopic form, depending on user input and/or characteristics of video pipeline components.

摘要翻译： 公开了用于在计算设备中支持立体3D视频的方法。 计算设备可以使用YUV颜色空间和色度子采样来接收立体3D视频数据，并且可以从其生成浮雕视频数据。 可以通过将立体3D视频数据解包为左视图和右视图并通过矩阵变换将左视图和右视图组合成单个视图来生成浮雕视频数据。 组合使用对应于视频流水线配置的变换矩阵。 变换矩阵系数可以取决于视频管线组件的特性。 修改后的变换矩阵系数可用于响应视频流水线配置的变化。 可以根据用户输入和/或视频流水线部件的特性，选择以立体3D，浮雕形式或单视角形式显示立体3D视频数据编码的视频。

公开(公告)号：US20100128778A1

公开(公告)日：2010-05-27

申请号：US12323055

申请日：2008-11-25

申请人： Gang Ji ,  Naveen Thumpudi ,  Shyam Sadhwani ,  Yongjun Wu

发明人： Gang Ji ,  Naveen Thumpudi ,  Shyam Sadhwani ,  Yongjun Wu

IPC分类号： H04N7/30 ,  H04N7/26

CPC分类号： H04N19/42 ,  H04N19/44 ,  H04N19/61 ,  H04N19/89 ,  H04N19/93

摘要： Adjustment of hardware acceleration level in a video decoder utilizing hardware acceleration is described. Errors are detected in a bitstream as it is decoded using different levels of error detection based on decoding characteristics. A statistical analysis is performed on the error values as they are detected. In one technique, if the bitstream is categorized as fitting a high error rate state in a bitstream model, then hardware acceleration is dropped. In another technique, error statistics based on run-lengths of good and bad bitstream units are kept, and compared to predetermined thresholds. If the thresholds are exceeded, the hardware acceleration level is dropped. The level is dropped in order to take advantage of superior error handing abilities of software-based decoding over hardware-accelerated decoding.

摘要翻译： 描述了利用硬件加速度调整视频解码器中的硬件加速度水平。 在比特流中检测到错误，因为它使用基于解码特性的不同级别的错误检测被解码。 在检测到误差值时进行统计分析。 在一种技术中，如果比特流被分类为在比特列模型中拟合高错误率状态，则硬件加速度下降。 在另一种技术中，保持基于良好和不良比特流单元的游程长度的误差统计，并与预定阈值进行比较。 如果超过阈值，则硬件加速等级会下降。 为了利用基于硬件加速解码的基于软件的解码的优异的错误处理能力，该级别被丢弃。

公开(公告)号：US20070201562A1

公开(公告)日：2007-08-30

申请号：US11673423

申请日：2007-02-09

申请人： Anand Ganesh ,  Donald J. Munsil ,  Gary J. Sullivan ,  Glenn F. Evans ,  Shyam Sadhwani ,  Stephen J. Estrop

发明人： Anand Ganesh ,  Donald J. Munsil ,  Gary J. Sullivan ,  Glenn F. Evans ,  Shyam Sadhwani ,  Stephen J. Estrop

IPC分类号： H04N7/12

CPC分类号： G06F9/5044 ,  H04N19/12 ,  H04N19/124 ,  H04N19/127 ,  H04N19/154 ,  H04N19/156 ,  H04N19/42 ,  H04N19/61 ,  H04N21/242 ,  H04N21/4302 ,  H04N21/64784

摘要： A video encoding acceleration service to increase one or more of the speed and quality of video encoding is described. The service acts as an intermediary between an arbitrary video encoder computer program application and arbitrary video acceleration hardware. The service receives one or more queries from the video encoder to identify implementation specifics of the video acceleration hardware. The service interfaces with the video acceleration hardware to obtain the implementation specifics. The service communicates the implementation specifics to the video encoder. The implementation specifics enable the video encoder to: (a) determine whether one or more of speed and quality of software encoding operations associated with the video encoder can be increased with implementation of a pipeline of one or more supported encoding pipeline configurations and capabilities, and (b) implement the pipeline by interfacing with the service.

公开(公告)号：US09824426B2

公开(公告)日：2017-11-21

申请号：US13195776

申请日：2011-08-01

申请人： Yongjun Wu ,  Matthew Wozniak ,  Shyam Sadhwani ,  Naveen Thumpudi

发明人： Yongjun Wu ,  Matthew Wozniak ,  Shyam Sadhwani ,  Naveen Thumpudi

IPC分类号： H04N5/228 ,  H04N5/232 ,  G06T5/00

CPC分类号： G06T5/002 ,  G06T2207/20182 ,  H04N5/23254 ,  H04N5/23267

摘要： Reduced latency video stabilization methods and tools generate truncated filters for use in the temporal smoothing of global motion transforms representing jittery motion in captured video. The truncated filters comprise future and past tap counts that can be different from each other and are typically less than those of a baseline filter providing a baseline of video stabilization quality. The truncated filter future tap count can be determined experimentally by comparing a smoothed global motion transform set generated by applying a baseline filter to a video segment to those generated by multiple test filter with varying future tap counts, then settings the truncated filter future tap count based on an inflection point on an error-future tap count curve. A similar approach can be used to determine the truncated filter past tap count.

公开(公告)号：US20160277751A1

公开(公告)日：2016-09-22

申请号：US14663364

申请日：2015-03-19

申请人： Patrick J. Sweeney ,  Yongjun Wu ,  Shyam Sadhwani

发明人： Patrick J. Sweeney ,  Yongjun Wu ,  Shyam Sadhwani

IPC分类号： H04N19/169 ,  H04N19/12 ,  H04N19/70 ,  H04N19/172

CPC分类号： H04N19/188 ,  H04N19/12 ,  H04N19/172 ,  H04N19/20 ,  H04N19/25 ,  H04N19/46 ,  H04N19/70

摘要： Technologies are described herein for providing enhanced packaging, coding, decoding and unpackaging of geometric data. In some configurations, geometric data is obtained by a device. The geometric data is partitioned into data partitions representing reconstruction information for video frames. The data partitions representing frames are then converted and integrated into a network abstraction layer of a bit stream. Geometric data may be obtained from the bit stream by accessing the data partitions from the network abstraction layer. The data partitions can be then processed into geometric data for further processing, such as the reconstruction, generation, display or processing of a three dimensional (3D) object modeled by the geometric data.

摘要翻译： 本文描述了技术，用于提供增强的封装，编码，解码和拆封几何数据。 在某些配置中，几何数据由设备获得。 几何数据被分割成表示视频帧的重建信息的数据分区。 然后将表示帧的数据分区转换并集成到位流的网络抽象层中。 可以通过从网络抽象层访问数据分区从比特流获得几何数据。 然后可以将数据分区处理成用于进一步处理的几何数据，例如由几何数据建模的三维（3D）对象的重建，生成，显示或处理。

公开(公告)号：US09241167B2

公开(公告)日：2016-01-19

申请号：US13399769

申请日：2012-02-17

申请人： Yongjun Wu ,  Shyam Sadhwani ,  Naveen Thumpudi

发明人： Yongjun Wu ,  Shyam Sadhwani ,  Naveen Thumpudi

IPC分类号： H04N7/26 ,  H04N19/157 ,  H04N19/12 ,  H04N19/46

CPC分类号： H04N19/44 ,  H04N19/103 ,  H04N19/12 ,  H04N19/129 ,  H04N19/157 ,  H04N19/174 ,  H04N19/176 ,  H04N19/46 ,  H04N19/70

摘要： A video decoder is disclosed that uses metadata in order to make optimization decisions. In one embodiment, metadata is used to choose which of multiple available decoder engines should receive a video sequence. In another embodiment, the optimization decisions can be based on length and location metadata information associated with a video sequence. Using such metadata information, a decoder engine can skip start-code scanning to make the decoding process more efficient. Also based on the choice of decoder engine, it can decide whether emulation prevention byte removal shall happen together with start code scanning or not.

摘要翻译： 公开了使用元数据以进行优化决定的视频解码器。 在一个实施例中，使用元数据来选择多个可用解码器引擎应当接收视频序列中的哪一个。 在另一个实施例中，优化决定可以基于与视频序列相关联的长度和位置元数据信息。 使用这样的元数据信息，解码器引擎可以跳过起始码扫描，以使解码过程更有效率。 同样基于解码器引擎的选择，它可以决定是否与启动代码扫描一起发生仿真预防字节删除。

公开(公告)号：US09131241B2

公开(公告)日：2015-09-08

申请号：US12323055

申请日：2008-11-25

申请人： Gang Ji ,  Naveen Thumpudi ,  Shyam Sadhwani ,  Yongjun Wu

发明人： Gang Ji ,  Naveen Thumpudi ,  Shyam Sadhwani ,  Yongjun Wu

IPC分类号： H04N5/85 ,  H04N19/42 ,  H04N19/61 ,  H04N19/44 ,  H04N19/89 ,  H04N19/93

CPC分类号： H04N19/42 ,  H04N19/44 ,  H04N19/61 ,  H04N19/89 ,  H04N19/93

摘要： Adjustment of hardware acceleration level in a video decoder utilizing hardware acceleration is described. Errors are detected in a bitstream as it is decoded using different levels of error detection based on decoding characteristics. A statistical analysis is performed on the error values as they are detected. In one technique, if the bitstream is categorized as fitting a high error rate state in a bitstream model, then hardware acceleration is dropped. In another technique, error statistics based on run-lengths of good and bad bitstream units are kept, and compared to predetermined thresholds. If the thresholds are exceeded, the hardware acceleration level is dropped. The level is dropped in order to take advantage of superior error handing abilities of software-based decoding over hardware-accelerated decoding.

摘要翻译： 描述了利用硬件加速度调整视频解码器中的硬件加速度水平。 在比特流中检测到错误，因为它使用基于解码特性的不同级别的错误检测被解码。 在检测到错误值时进行统计分析。 在一种技术中，如果比特流被分类为在比特列模型中拟合高错误率状态，则硬件加速度下降。 在另一种技术中，保持基于良好和不良比特流单元的游程长度的误差统计，并与预定阈值进行比较。 如果超过阈值，则硬件加速等级会下降。 为了利用基于硬件加速解码的基于软件的解码的优异的错误处理能力，该级别被丢弃。

公开(公告)号：US08860785B2

公开(公告)日：2014-10-14

申请号：US12972292

申请日：2010-12-17

申请人： Gang Ji ,  Shijun Sun ,  Yongjun Wu ,  Shyam Sadhwani

发明人： Gang Ji ,  Shijun Sun ,  Yongjun Wu ,  Shyam Sadhwani

IPC分类号： H04N13/04 ,  H04N13/00

CPC分类号： H04N13/334 ,  H04N13/106 ,  H04N13/15 ,  H04N13/341

摘要： Methods are disclosed for supporting stereo 3D video in computing devices. A computing device can receive stereo 3D video data employing a YUV color space and chroma subsampling, and can generate anaglyph video data therefrom. The anaglyph video data can be generated by unpacking the stereo 3D video data to left and right views and combining the left and right views into a single view via matrix transformation. The combining uses transform matrices that correspond to a video pipeline configuration. The transform matrix coefficients can depend on characteristics of the video pipeline components. Modified transform matrix coefficients can be used in response to changes in the video pipeline configuration. Video encoded in stereo 3D video data can be selected to be displayed in stereo 3D, anaglyph or monoscopic form, depending on user input and/or characteristics of video pipeline components.

摘要翻译： 公开了用于在计算设备中支持立体3D视频的方法。 计算设备可以使用YUV颜色空间和色度子采样来接收立体3D视频数据，并且可以从其生成浮雕视频数据。 可以通过将立体3D视频数据解包为左视图和右视图并通过矩阵变换将左视图和右视图组合成单个视图来生成浮雕视频数据。 组合使用对应于视频流水线配置的变换矩阵。 变换矩阵系数可以取决于视频管线组件的特性。 修改后的变换矩阵系数可用于响应视频流水线配置的变化。 可以根据用户输入和/或视频流水线部件的特性，选择以立体3D，浮雕形式或单视角形式显示立体3D视频数据编码的视频。

公开(公告)号：US08731067B2

公开(公告)日：2014-05-20

申请号：US13223079

申请日：2011-08-31

申请人： Yongjun Wu ,  Shyam Sadhwani

发明人： Yongjun Wu ,  Shyam Sadhwani

IPC分类号： H04N7/12 ,  H04N11/02 ,  H04N11/04

CPC分类号： H04N19/423 ,  H04N19/0049 ,  H04N19/127 ,  H04N19/136 ,  H04N19/159 ,  H04N19/172 ,  H04N19/176 ,  H04N19/426 ,  H04N19/44

摘要： Techniques and tools described herein help manage memory efficiently during video decoding, especially when multiple video clips are concurrently decoded. For example, with clip-adaptive memory usage, a decoder determines first memory usage settings expected to be sufficient for decoding of a video clip. The decoder also determines second memory usage settings known to be sufficient for decoding of the clip. During decoding, memory usage is initially set according to the first settings. Memory usage is adaptively increased during decoding, subject to theoretical limits in the second settings. With adaptive early release of side information, the decoder can release side information memory for a picture earlier than the decoder releases image plane memory for the picture. The decoder can also adapt memory usage for decoded transform coefficients depending on whether the coefficients are for intra-coded blocks or inter-coded blocks, and also exploit the relative sparseness of non-zero coefficient values.

摘要翻译： 这里描述的技术和工具有助于在视频解码期间有效地管理存储器，特别是当多个视频片段被同时解码时。 例如，利用剪辑自适应存储器使用，解码器确定预期对视频剪辑的解码足够的第一存储器使用设置。 解码器还确定已知足以解码剪辑的第二存储器使用设置。 在解码期间，最初根据第一个设置设置内存使用。 存储器使用在解码期间自适应地增加，受到第二设置中的理论限制。 利用辅助信息的适应性早期释放，解码器可以在解码器释放用于图像的图像平面存储器之前释放用于图像的侧信息存储器。 解码器还可以根据系数是用于帧内编码块还是帧间编码块来适应解码变换系数的存储器使用，并且还利用非零系数值的相对稀疏度。

公开(公告)号：US08654842B2

公开(公告)日：2014-02-18

申请号：US11673423

申请日：2007-02-09

申请人： Anand Ganesh ,  Donald J. Munsil ,  Gary J. Sullivan ,  Glenn F. Evans ,  Shyam Sadhwani ,  Stephen J. Estrop

发明人： Anand Ganesh ,  Donald J. Munsil ,  Gary J. Sullivan ,  Glenn F. Evans ,  Shyam Sadhwani ,  Stephen J. Estrop

IPC分类号： H04N7/12

CPC分类号： G06F9/5044 ,  H04N19/12 ,  H04N19/124 ,  H04N19/127 ,  H04N19/154 ,  H04N19/156 ,  H04N19/42 ,  H04N19/61 ,  H04N21/242 ,  H04N21/4302 ,  H04N21/64784

摘要： A video encoding acceleration service to increase one or more of the speed and quality of video encoding is described. The service acts as an intermediary between an arbitrary video encoder computer program application and arbitrary video acceleration hardware. The service receives one or more queries from the video encoder to identify implementation specifics of the video acceleration hardware. The service interfaces with the video acceleration hardware to obtain the implementation specifics. The service communicates the implementation specifics to the video encoder. The implementation specifics enable the video encoder to: (a) determine whether one or more of speed and quality of software encoding operations associated with the video encoder can be increased with implementation of a pipeline of one or more supported encoding pipeline configurations and capabilities, and (b) implement the pipeline by interfacing with the service.

摘要翻译： 描述了增加视频编码的速度和质量中的一个或多个的视频编码加速服务。 该服务充当任意视频编码器计算机程序应用程序和任意视频加速硬件之间的中介。 该服务从视频编码器接收一个或多个查询以识别视频加速硬件的实现细节。 该服务与视频加速硬件接口获取实现细节。 该服务将实现细节传达给视频编码器。 实施细节使得视频编码器能够：（a）确定是否可以通过实现一个或多个支持的编码流水线配置和能力的流水线来增加与视频编码器相关联的软件编码操作的速度和质量的一个或多个，以及 （b）通过与服务接口实施管道。