公开(公告)号：US09398310B2

公开(公告)日：2016-07-19

申请号：US13182856

申请日：2011-07-14

申请人： Hong Jiang ,  Paul A. Wilford

发明人： Hong Jiang ,  Paul A. Wilford

IPC分类号： H04N7/26 ,  H04N19/59 ,  H04N19/46

CPC分类号： H04N19/59 ,  H04N19/46

摘要： Embodiments relate to a method and apparatus for super resolution video coding using compressive measurements. The method includes receiving, by a decoder, a set of measurements, where the set of measurements represents encoded video data having original video data with an original display resolution. The method further includes determining, by the decoder, a display resolution, where the display resolution is higher than the original display resolution, and determining a reduction matrix based on at least a number of pixels for the determined display resolution, where the reduction matrix includes a pattern of values. The method further includes reconstructing, by the decoder, the video data or a portion of the video data using the determined reduction matrix and the received set of measurements such that the original display resolution is enlarged to the determined display resolution.

摘要翻译： 实施例涉及使用压缩测量的用于超分辨率视频编码的方法和装置。 该方法包括由解码器接收一组测量，其中该组测量表示具有原始显示分辨率的原始视频数据的经编码的视频数据。 该方法还包括由解码器确定显示分辨率高于原始显示分辨率的显示分辨率，以及基于所确定的显示分辨率的至少一些像素来确定缩小矩阵，其中缩小矩阵包括 一种价值模式。 该方法还包括使用所确定的减小矩阵和所接收的测量集合，由解码器重建视频数据或视频数据的一部分，使得原始显示分辨率被放大到所确定的显示分辨率。

公开(公告)号：US20140112594A1

公开(公告)日：2014-04-24

申请号：US13658904

申请日：2012-10-24

申请人： Hong Jiang ,  Gang Huang ,  Kim N. Matthews ,  Paul A. Wilford

发明人： Hong Jiang ,  Gang Huang ,  Kim N. Matthews ,  Paul A. Wilford

IPC分类号： G06K9/40

CPC分类号： H04N5/23212 ,  G06T5/003 ,  H04N5/23229 ,  H04N5/23235

摘要： An exemplary system includes at least one detector configured to provide an output based on a detected input. A plurality of input control elements control the input detected by the detector. A processor is configured to determine at least one point spread function based on a condition of the detector, a condition of the input control elements and a selected distance associated with the output. The controller is configured to generate data based on the output and the at least one point spread function, the generated data having at least one aspect

摘要翻译： 示例性系统包括至少一个检测器，其被配置为基于检测到的输入提供输出。 多个输入控制元件控制由检测器检测到的输入。 处理器被配置为基于检测器的条件，输入控制元件的条件和与输出相关联的选定距离来确定至少一个点扩展函数。 控制器被配置为基于输出和至少一个点扩展函数生成数据，所生成的数据具有至少一个方面

公开(公告)号：US20120075531A1

公开(公告)日：2012-03-29

申请号：US12923592

申请日：2010-09-29

申请人： Martin D. Carroll ,  Paul A. Wilford

发明人： Martin D. Carroll ,  Paul A. Wilford

IPC分类号： H04N9/74

CPC分类号： H04N5/445 ,  H04N21/4312 ,  H04N21/44012 ,  H04N21/8543

摘要： The present invention relates to an apparatus and method for client-side compositing of video streams. The method includes receiving, by the video display device, a multiplexed data stream from a remote video server. The multiplexed data stream includes substreams, where the substreams includes a descriptor substream, at least one media substream, and a compositing-instruction substream. The method further includes demultiplexing, by the video display device, the multiplexed data stream into the substreams according to the descriptor substream and displaying, by the video display device, the at least one media substream on a display screen according to the compositing-instruction substream, where the compositing-instruction substream includes instructions on a composition of the at least one media substream.

摘要翻译： 本发明涉及用于视频流的客户端合成的装置和方法。 该方法包括由视频显示设备从远程视频服务器接收多路复用的数据流。 复用数据流包括子流，其中子流包括描述符子流，至少一个媒体子流和合成指令子流。 该方法还包括由视频显示设备将多路复用的数据流解复用为根据描述子流的子流，并且由视频显示设备根据合成指令子流在显示屏幕上显示至少一个媒体子流 ，其中所述合成指令子流包括关于所述至少一个媒体子流的组合的指令。

公开(公告)号：US20110164672A1

公开(公告)日：2011-07-07

申请号：US12652390

申请日：2010-01-05

申请人： Hong Jiang ,  Kim N. Matthews ,  Zulfiquar Sayeed ,  Paul A. Wilford ,  Lesley J. Wu

发明人： Hong Jiang ,  Kim N. Matthews ,  Zulfiquar Sayeed ,  Paul A. Wilford ,  Lesley J. Wu

IPC分类号： H04B1/66

CPC分类号： H04J11/003 ,  H04N19/39

摘要： In one aspect, an orthogonal multiple description encoder comprises orthogonal multiple description generation circuitry configured to produce multiple descriptions of a given signal by processing the signal using respective ones of a plurality of orthogonal matrices. Each of the multiple descriptions is generated as a function of the signal and a corresponding one of the plurality of orthogonal matrices. Other aspects include an orthogonal multiple description decoder, orthogonal multiple description encoding and decoding methods, and associated computer program products.

摘要翻译： 一方面，正交多重描述编码器包括正交多描述生成电路，其被配置为通过使用多个正交矩阵中的相应矩阵处理信号来产生给定信号的多个描述。 多个描述中的每一个作为信号的函数和多个正交矩阵中的相应一个生成。 其他方面包括正交多重描述解码器，正交多重描述编码和解码方法以及相关联的计算机程序产品。

公开(公告)号：US09131254B2

公开(公告)日：2015-09-08

申请号：US13552800

申请日：2012-07-19

申请人： Hong Jiang ,  Zulfiquar Sayeed ,  Paul A. Wilford

发明人： Hong Jiang ,  Zulfiquar Sayeed ,  Paul A. Wilford

IPC分类号： H04N19/39 ,  H04N19/124 ,  H04N21/2383 ,  H04N21/61 ,  H04N21/63 ,  H04N19/65

CPC分类号： H04N21/2383 ,  H04N19/124 ,  H04N19/39 ,  H04N19/65 ,  H04N21/6131 ,  H04N21/6143 ,  H04N21/631

摘要： Methods and apparatus providing error protection in multicast-broadcast service by encoding multimedia content according to a first protocol to provide a plurality of distinct video streams, coding each of the distinct video streams using respective coding protocols, wherein each coding protocol has associated with it corresponding descriptors and coefficients, and multiplexing the coded video streams toward a wireless network.

摘要翻译： 一种方法和装置，通过根据第一协议对多媒体内容进行编码以提供多个不同的视频流来提供多播广播服务中的错误保护，使用相应的编码协议来对每个不同的视频流进行编码，其中每个编码协议与其相关联 描述符和系数，并且将编码的视频流多路复用到无线网络。

公开(公告)号：US08640180B2

公开(公告)日：2014-01-28

申请号：US12923592

申请日：2010-09-29

申请人： Martin D. Carroll ,  Paul A. Wilford

发明人： Martin D. Carroll ,  Paul A. Wilford

IPC分类号： H04N7/173

CPC分类号： H04N5/445 ,  H04N21/4312 ,  H04N21/44012 ,  H04N21/8543

摘要： The present invention relates to an apparatus and method for client-side compositing of video streams. The method includes receiving, by the video display device, a multiplexed data stream from a remote video server. The multiplexed data stream includes substreams, where the substreams includes a descriptor substream, at least one media substream, and a compositing-instruction substream. The method further includes demultiplexing, by the video display device, the multiplexed data stream into the substreams according to the descriptor substream and displaying, by the video display device, the at least one media substream on a display screen according to the compositing-instruction substream, where the compositing-instruction substream includes instructions on a composition of the at least one media substream.

摘要翻译： 本发明涉及用于视频流的客户端合成的装置和方法。 该方法包括由视频显示设备从远程视频服务器接收多路复用的数据流。 复用数据流包括子流，其中子流包括描述符子流，至少一个媒体子流和合成指令子流。 该方法还包括由视频显示设备将多路复用的数据流解复用为根据描述子流的子流，并且由视频显示设备根据合成指令子流在显示屏幕上显示至少一个媒体子流 ，其中所述合成指令子流包括关于所述至少一个媒体子流的组合的指令。

公开(公告)号：US20130227106A1

公开(公告)日：2013-08-29

申请号：US13731791

申请日：2012-12-31

申请人： Edward Grinshpun ,  David Faucher ,  Sameerkumar V. Sharma ,  Paul A. Wilford

发明人： Edward Grinshpun ,  David Faucher ,  Sameerkumar V. Sharma ,  Paul A. Wilford

IPC分类号： H04L12/24

CPC分类号： H04L41/32 ,  H04L65/1069 ,  H04L67/303 ,  H04N21/2385 ,  H04N21/25825 ,  H04N21/44209 ,  H04N21/6131 ,  H04W4/18

摘要： A video session management capability provides network-directed, client-assisted management of real-time mobile video sessions of video clients of mobile devices. The video session management capability is provided using a mobile device accessing a Wireless Service Provider (WSP) network and a video management server associated with the WSP network. The mobile device includes a video client and a video control engine. The video control engine collects client information at the mobile device and provides the client information to the video management server. The video management server receives the client information, obtains network information associated with the WSP network, determines video session management information, and propagates the video session management information toward the mobile device. The mobile device receives the video session management information and the video control engine uses the video session management information to manage a real-time mobile video session of the video client of the mobile device.

摘要翻译： 视频会话管理功能为移动设备的视频客户端的实时移动视频会话提供面向网络的客户端辅助管理。 使用访问无线服务提供商（WSP）网络的移动设备和与WSP网络相关联的视频管理服务器来提供视频会话管理能力。 移动设备包括视频客户端和视频控制引擎。 视频控制引擎在移动设备处收集客户信息，并向视频管理服务器提供客户端信息。 视频管理服务器接收客户端信息，获取与WSP网络相关联的网络信息，确定视频会话管理信息，并将视频会话管理信息传播给移动设备。 移动设备接收视频会话管理信息，并且视频控制引擎使用视频会话管理信息来管理移动设备的视频客户端的实时移动视频会话。

公开(公告)号：US20100293213A1

公开(公告)日：2010-11-18

申请号：US12454229

申请日：2009-05-14

申请人： Hong Jiang ,  Paul A. Wilford

发明人： Hong Jiang ,  Paul A. Wilford

IPC分类号： G06F1/02

CPC分类号： H03F1/3247 ,  G06F17/17 ,  H03F2201/3224

摘要： Embodiments described herein provide techniques for computing an approximation of a function. These embodiments provide an iterative method that avoids the computation of the normal matrix and/or the coefficients, as is typical in the prior art. (See diagram 600, for example.) The iterative method works on the functions directly. At each iteration, the approximating function is computed directly. (See diagram 200.) Since there is no need to compute the normal matrix or the coefficients of the basis functions, this approach avoids the overhead associated with them, and therefore, increases the speed of computation and reduces resource requirements. For example, various embodiments are suitable for implementation on hardware devices such as on an FPGA or an ASIC.

摘要翻译： 本文描述的实施例提供了用于计算功能的近似的技术。 这些实施例提供了避免正常矩阵和/或系数的计算的迭代方法，如现有技术中典型的那样。 （例如，参见图600）。迭代方法直接用于函数。 在每次迭代中，直接计算近似函数。 （见图200.）由于不需要计算正常矩阵或基函数的系数，因此该方法避免了与它们相关的开销，因此提高了计算速度，降低了资源需求。 例如，各种实施例适合于在诸如FPGA或ASIC的硬件设备上实现。

公开(公告)号：US20180115766A1

公开(公告)日：2018-04-26

申请号：US15298580

申请日：2016-10-20

申请人： Xin Yuan ,  Hong Jiang ,  Gang Huang ,  Paul A. Wilford

发明人： Xin Yuan ,  Hong Jiang ,  Gang Huang ,  Paul A. Wilford

IPC分类号： H04N13/02 ,  G06T7/50 ,  G06K9/62 ,  H04N13/00

CPC分类号： H04N13/20 ,  G06T7/50 ,  H04N5/2226 ,  H04N5/2254 ,  H04N5/2258 ,  H04N13/128 ,  H04N13/243 ,  H04N13/254 ,  H04N13/271 ,  H04N2013/0081

摘要： The present disclosure generally discloses a three-dimensional (3D) image reconstruction capability. The 3D image reconstruction capability may be configured to support reconstruction of a 3D image of a scene. The 3D image reconstruction capability may be configured to support reconstruction of a 3D image of a scene based on lensless compressive image acquisition performed using a lensless compressive camera having a single aperture and a set of multiple sensors. The reconstructed 3D image of a scene may include (1) image data indicative of a set of multiple two-dimensional (2D) images reconstructed based on the set of multiple sensors of the lensless compressive camera (which may be represented as images) and (2) depth information indicative of depths at points or areas of an overlapping portion of the multiple images reconstructed based on the set of multiple sensors of the lensless compressive camera (which may be represented as a depth map).

公开(公告)号：US20130201343A1

公开(公告)日：2013-08-08

申请号：US13658900

申请日：2012-10-24

申请人： Hong Jiang ,  Gang Huang ,  Kim N. Matthews ,  Paul A. Wilford

发明人： Hong Jiang ,  Gang Huang ,  Kim N. Matthews ,  Paul A. Wilford

IPC分类号： H04N5/225 ,  H04N5/33

CPC分类号： H04N5/335 ,  G02B26/0833 ,  H04N5/2254

摘要： An exemplary lensless compressive imaging device may include a micro mirror array having a plurality of mirror elements that are individually controllable for selectively directing light reflecting from the micro mirror array. A detector detects light reflected from at least one of the mirror elements. A processor provides compressive image information based on the detected light.

摘要翻译： 示例性的无镜片压缩成像装置可以包括微镜阵列，该微镜阵列具有可独立控制的多个反射镜元件，用于选择性地引导从微反射镜阵列反射的光。 检测器检测从至少一个反射镜元件反射的光。 处理器基于检测到的光提供压缩图像信息。