-
公开(公告)号:US10390039B2
公开(公告)日:2019-08-20
申请号:US15253568
申请日:2016-08-31
Applicant: Microsoft Technology Licensing, LLC
Inventor: Lihua Zhu , B. Anil Kumar , Olof L. E. Mases
Abstract: Innovations in motion estimation adapted for screen remoting scenarios are described herein. For example, as part of motion estimation for a current picture, a video encoder finds a pivot point in the current picture, calculates a hash value for the pivot point, and searches for a matching area in a previous picture. In doing so, the video encoder can calculate a hash index from the hash value and look up the hash index in a data structure to find candidate pivot points in the previous picture. The video encoder can compare the hash value for the pivot point in the current picture to a hash value for a candidate pivot point in the previous picture and, when the hash values match, compare sample values around the respective pivot points. In this way, the video encoder can quickly detect large areas of exact-match blocks having uniform motion.
-
公开(公告)号:US10157480B2
公开(公告)日:2018-12-18
申请号:US15192827
申请日:2016-06-24
Applicant: Microsoft Technology Licensing, LLC
Inventor: Lihua Zhu , B. Anil Kumar , Guosheng Sun , Olof L. E. Mases
IPC: G06T9/00 , H04N19/433 , H04N19/587 , H04N19/513 , H04N19/436 , H04N19/42 , G06T15/80 , G06T15/04
Abstract: Innovations in video decoding and rendering operations for inter-coded blocks in a graphics pipeline, in which at least some of the operations are performed using a graphics processing unit (“GPU”), are described. For example, a video playback tool receives encoded data for a current picture and performs operations to decode the encoded data and reconstruct the current picture. For a given inter-coded block of the current picture, a graphics primitive represents texture values as a point for processing by the GPU. The graphics primitive can have one or more attributes, including a motion vector, a block size, a display index value (indicating a location in a display buffer), and/or a residual index value (indicating a location of residual values). The operations performed by the video playback tool can include interpolation of sample values at fractional-sample offsets and motion compensation performed for inter-coded blocks in multiple passes for different block sizes.
-
公开(公告)号:US11095877B2
公开(公告)日:2021-08-17
申请号:US15365927
申请日:2016-11-30
Applicant: Microsoft Technology Licensing, LLC
Inventor: B. Anil Kumar , Winston M. Johnston , Olof L. E. Mases , Shir Aharon , Lihua Zhu
IPC: H04N11/02 , H04N19/105 , H04N19/537 , H04N19/527 , H04N19/103 , H04N19/174 , H04N19/43 , H04N19/136 , H04N19/139 , H04N19/176 , H04N19/55 , G06K9/32
Abstract: Innovations in motion estimation adapted for screen remoting scenarios are described. For example, a video encoder calculates a hash value for a current block in a current picture. The video encoder searches, subject to a spatial constraint, for a matching block in a reference picture (e.g., the previous picture in display order) based at least in part on the hash value for the current block. The spatial constraint defines a search area in the reference picture within which hash values for candidate blocks in the reference picture may be compared to the hash value for the current block. By using a spatial constraint to limit the range of the local hash-based motion estimation, the video encoder can speed up the motion estimation process while still considering the candidate blocks in the reference picture that are most likely to match the current block.
-
公开(公告)号:US11197010B2
公开(公告)日:2021-12-07
申请号:US15289111
申请日:2016-10-07
Applicant: Microsoft Technology Licensing, LLC
Inventor: Jingyaw Sun , Winston M. P. Johnston , Jayashree Sadagopan , Lihua Zhu , Michael E. Seydl , Olof L. E. Mases , B. Anil Kumar
IPC: H04N19/44 , H04N19/127 , H04N19/42 , H04N19/436 , H04N19/124 , H04N19/51 , H04N19/60 , G06T1/20
Abstract: Innovations in video playback using a browser-based video decoder are described. In a computer system that includes multiple central processing units (“CPUs”), a browser-based video decoder performs operations with multiple threads that may execute simultaneously on different CPUs. The video decoder can perform decoding operations in parallel for different sections of a picture. For example, with a main CPU thread associated with a browser, the video decoder performs a first decoding workload (e.g., bitstream parsing) for a picture. With auxiliary CPU threads associated with Web workers and simultaneously executing on different CPUs, the video decoder performs a second decoding workload (e.g., entropy decoding, decoding of side information) for different sections of the picture, one section per auxiliary CPU thread. If the computer system also includes a graphics processing unit (“GPU”), the video decoder can perform additional decoding workloads with shader routines executable on the GPU.
-
公开(公告)号:US10575007B2
公开(公告)日:2020-02-25
申请号:US15097143
申请日:2016-04-12
Applicant: Microsoft Technology Licensing, LLC
Inventor: Guosheng Sun , Olof L. E. Mases , Lihua Zhu , B. Anil Kumar
IPC: H04N7/12 , H04N19/44 , G06T15/04 , G06T15/00 , H04N19/436
Abstract: Innovations in video decoding and rendering operations in a graphics pipeline, in which at least some of the operations are performed using a graphics processing unit (“GPU”), are described. For example, a video playback tool aggregates texture values for intra-coded blocks of a picture in central processing unit (“CPU”) memory, then transfers the texture values for the intra-coded blocks from the CPU memory to GPU memory. The video playback tool performs operations to decode the encoded data and reconstruct the picture. For a given block (e.g., of a macroblock, coding unit) of the picture, a graphics primitive represents texture values for the given block as a point for processing by the GPU. The video playback tool uses one or more shader routines, executable by the GPU, to transfer texture values to a display buffer. In some cases, the video playback tool also performs decoding operations with the shader routines.
-
-
-
-