公开(公告)号：US20080187053A1

公开(公告)日：2008-08-07

申请号：US11703613

申请日：2007-02-06

申请人： Weidong Zhao ,  Yaming He

发明人： Weidong Zhao ,  Yaming He

IPC分类号： H04B1/66

CPC分类号： H04N19/436 ,  H04N19/43 ,  H04N19/439 ,  H04N19/44 ,  H04N19/513

摘要： Decoding tasks are identified for decoding encoded video. Decoding tasks may include entropy decoding tasks, motion compensation tasks, inverse frequency transform tasks, inverse quantization tasks, intra decoding tasks, loop filtering tasks, or other tasks. Task dependencies are identified for the video decoding tasks. For example, one or more decoding tasks may depend on prior completion of entropy decoding tasks. The decoding tasks are prioritized based at least in part on the task dependencies. For example, a higher priority may be assigned to tasks that must be completed before other tasks that depend on them can begin. Prioritized decoding tasks are selected to be performed by hardware threads. For example, a first hardware thread may perform a first decoding task that does not depend on any uncompleted tasks while a second hardware thread performs a second decoding task that does not depend on any uncompleted tasks.

摘要翻译： 识别解码编码视频的任务。 解码任务可以包括熵解码任务，运动补偿任务，逆频变换任务，逆量化任务，帧内解码任务，环路过滤任务或其他任务。 确定视频解码任务的任务依赖关系。 例如，一个或多个解码任务可以取决于先前完成的熵解码任务。 解码任务至少部分地基于任务依赖性进行优先排序。 例如，可以将较高优先级分配给必须在依赖于它们的其他任务开始之前必须完成的任务。 优先解码任务选择由硬件线程执行。 例如，第一硬件线程可以执行不依赖于任何未完成任务的第一解码任务，而第二硬件线程执行不依赖于任何未完成任务的第二解码任务。

公开(公告)号：US08411734B2

公开(公告)日：2013-04-02

申请号：US11703613

申请日：2007-02-06

申请人： Weidong Zhao ,  Yaming He

发明人： Weidong Zhao ,  Yaming He

IPC分类号： G06F21/00

CPC分类号： H04N19/436 ,  H04N19/43 ,  H04N19/439 ,  H04N19/44 ,  H04N19/513

摘要： Decoding tasks are identified for decoding encoded video. Decoding tasks may include entropy decoding tasks, motion compensation tasks, inverse frequency transform tasks, inverse quantization tasks, intra decoding tasks, loop filtering tasks, or other tasks. Task dependencies are identified for the video decoding tasks. For example, one or more decoding tasks may depend on prior completion of entropy decoding tasks. The decoding tasks are prioritized based at least in part on the task dependencies. For example, a higher priority may be assigned to tasks that must be completed before other tasks that depend on them can begin. Prioritized decoding tasks are selected to be performed by hardware threads. For example, a first hardware thread may perform a first decoding task that does not depend on any uncompleted tasks while a second hardware thread performs a second decoding task that does not depend on any uncompleted tasks.

公开(公告)号：US20110305273A1

公开(公告)日：2011-12-15

申请号：US12814060

申请日：2010-06-11

申请人： Yaming He ,  Florin Folta ,  Chun-Wei Chan ,  Stacey Spears ,  Chuang Gu

发明人： Yaming He ,  Florin Folta ,  Chun-Wei Chan ,  Stacey Spears ,  Chuang Gu

IPC分类号： H04N7/26

CPC分类号： H04N19/436 ,  H04N19/30

摘要： A multiple bitrate (MBR) video encoding management tool utilizes available processing units for parallel MBR video encoding. For example, instead of focusing only on multi-threading of encoding tasks for a single picture or group of pictures (GOP), the management tool parallelizes the encoding of multiple GOPs between different processing units and/or different computing systems. With this parallel MBR video encoding architecture, different GOPs can be encoded in parallel. To facilitate such parallel encoding, data dependencies between GOPs are removed. The management tool can adjust the number of GOPs to encode in parallel on a computing system so as to favor parallelism of encoding for different GOPs at the expense of parallelism of encoding inside a GOP, or vice versa, and thereby set a suitable balance between encoding latency and throughput.

摘要翻译： 多位比特率（MBR）视频编码管理工具利用可用的处理单元进行并行MBR视频编码。 例如，管理工具不是专注于单个图像或图像组（GOP）的编码任务的多线程，而是在不同的处理单元和/或不同的计算系统之间并行化多个GOP的编码。 利用这种并行MBR视频编码架构，可以并行编码不同的GOP。 为了促进这种并行编码，GOP之间的数据依赖性被去除。 管理工具可以在计算系统上调节GOP并行编码的数量，从而以牺牲GOP内编码并行性为代价的优点，对不同的GOP进行编码的平行化，反之亦然，从而在编码之间设置适当的平衡 延迟和吞吐量。

公开(公告)号：US08494231B2

公开(公告)日：2013-07-23

申请号：US12916895

申请日：2010-11-01

申请人： Florin O. Folta ,  Yaming He ,  King Wei Hor ,  Minesh G. Shilotri ,  Stacey Spears ,  Chuang Gu

发明人： Florin O. Folta ,  Yaming He ,  King Wei Hor ,  Minesh G. Shilotri ,  Stacey Spears ,  Chuang Gu

IPC分类号： G06K9/00

CPC分类号： G06K9/00295 ,  G06K2009/00328

摘要： The subject disclosure relates to face recognition in video. Face detection data in frames of input data are used to generate face galleries, which are labeled and used in recognizing faces throughout the video. Metadata that associates the video frame and the face are generated and maintained for subsequent identification. Faces other than those found by face detection may be found by face tracking, in which facial landmarks found by the face detection are used to track a face over previous and/or subsequent video frames. Once generated, the maintained metadata may be accessed to efficiently determine the identity of a person corresponding to a viewer-selected face.

摘要翻译： 本公开涉及视频中的面部识别。 输入数据帧中的脸部检测数据用于生成面部画廊，这些画廊被标记并用于识别整个视频中的脸部。 生成并维护与视频帧和脸部相关联的元数据，以便后续识别。 面部检测以外的脸部可以通过脸部跟踪来发现，其中通过面部检测发现的面部地标用于跟踪先前和/或后续视频帧的面部。 一旦生成，可以访问维护的元数据以有效地确定与观众选择的面对应的人的身份。

公开(公告)号：US20120281886A1

公开(公告)日：2012-11-08

申请号：US13102740

申请日：2011-05-06

申请人： Yaming He ,  Chuang Gu

发明人： Yaming He ,  Chuang Gu

IPC分类号： G06K9/00

CPC分类号： G06K9/00288 ,  G06K9/00677 ,  G06K9/6807

摘要： Various examples are disclosed herein that relate to staged element classification. For example, one disclosed example provides a method of classifying elements by forming elements for classification into a plurality of first-level sets in a first stage, generating primary groups within the first-level sets based on element similarity, forming a plurality of second-level sets from the first-level sets in a second stage, generating secondary groups within the second-level sets based on element similarity, and merging a plurality of the primary and/or secondary groups based on element similarity.

摘要翻译： 本文公开了与分段元素分类相关的各种示例。 例如，一个公开的示例提供了一种通过在第一阶段中形成用于分类为多个第一级集合的元素来对元素进行分类的方法，基于元素相似性在第一级集合内生成主组，形成多个第二级组， 基于元素相似度在第二级集合内生成二级组，并且基于元素相似度合并多个主组和/或辅助组。

公开(公告)号：US08588534B2

公开(公告)日：2013-11-19

申请号：US13102740

申请日：2011-05-06

申请人： Yaming He ,  Chuang Gu

发明人： Yaming He ,  Chuang Gu

IPC分类号： G06K9/68

CPC分类号： G06K9/00288 ,  G06K9/00677 ,  G06K9/6807

摘要： Various examples are disclosed herein that relate to staged element classification. For example, one disclosed example provides a method of classifying elements by forming elements for classification into a plurality of first-level sets in a first stage, generating primary groups within the first-level sets based on element similarity, forming a plurality of second-level sets from the first-level sets in a second stage, generating secondary groups within the second-level sets based on element similarity, and merging a plurality of the primary and/or secondary groups based on element similarity.

摘要翻译： 本文公开了与分段元素分类相关的各种示例。 例如，一个公开的示例提供了一种通过在第一阶段中形成用于分类为多个第一级集合的元素来对元素进行分类的方法，基于元素相似性在第一级集合内生成主组，形成多个第二级组， 基于元素相似度在第二级集合内生成二级组，并且基于元素相似度合并多个主组和/或辅助组。

公开(公告)号：US08270473B2

公开(公告)日：2012-09-18

申请号：US12483577

申请日：2009-06-12

申请人： William Chen ,  Chun-Wei Chan ,  Stacey Spears ,  Yaming He ,  Florin Folta ,  Chuang Gu ,  King Wei Hor

发明人： William Chen ,  Chun-Wei Chan ,  Stacey Spears ,  Yaming He ,  Florin Folta ,  Chuang Gu ,  King Wei Hor

IPC分类号： H04B1/66

CPC分类号： H04N19/587 ,  H04N19/124 ,  H04N19/132 ,  H04N19/139 ,  H04N19/14 ,  H04N19/142 ,  H04N19/149 ,  H04N19/164 ,  H04N19/172 ,  H04N19/177 ,  H04N19/194 ,  H04N19/57 ,  H04N19/61

摘要： A video encoding system encodes video streams for multiple bit rate video streaming using an approach that permits the encoded resolution to vary based, at least in part, on motion complexity. The video encoding system dynamically decides an encoding resolution for segments of the multiple bit rate video streams that varies with video complexity so as to achieve a better visual experience for multiple bit rate streaming. Motion complexity may be considered separately, or along with spatial complexity, in making the resolution decision.

摘要翻译： 视频编码系统使用允许编码分辨率至少部分地基于运动复杂度而变化的方法对多个比特率视频流的视频流进行编码。 视频编码系统动态地决定随着视频复杂度而变化的多个比特率视频流的片段的编码分辨率，以便为多个比特率流媒体实现更好的视觉体验。 运动复杂度可以单独考虑，也可以与空间复杂性一起考虑在决策中。

公开(公告)号：US20100316126A1

公开(公告)日：2010-12-16

申请号：US12483577

申请日：2009-06-12

申请人： William Chen ,  Chun-Wei Chan ,  Stacey Spears ,  Yaming He ,  Florin Folta ,  Chuang Gu ,  King Wei Hor

发明人： William Chen ,  Chun-Wei Chan ,  Stacey Spears ,  Yaming He ,  Florin Folta ,  Chuang Gu ,  King Wei Hor

IPC分类号： H04N7/26

CPC分类号： H04N19/587 ,  H04N19/124 ,  H04N19/132 ,  H04N19/139 ,  H04N19/14 ,  H04N19/142 ,  H04N19/149 ,  H04N19/164 ,  H04N19/172 ,  H04N19/177 ,  H04N19/194 ,  H04N19/57 ,  H04N19/61

摘要： A video encoding system encodes video streams for multiple bit rate video streaming using an approach that permits the encoded resolution to vary based, at least in part, on motion complexity. The video encoding system dynamically decides an encoding resolution for segments of the multiple bit rate video streams that varies with video complexity so as to achieve a better visual experience for multiple bit rate streaming. Motion complexity may be considered separately, or along with spatial complexity, in making the resolution decision.

摘要翻译： 视频编码系统使用允许编码分辨率至少部分地基于运动复杂度而变化的方法对多个比特率视频流的视频流进行编码。 视频编码系统动态地决定随着视频复杂度而变化的多个比特率视频流的片段的编码分辨率，以便为多个比特率流媒体实现更好的视觉体验。 运动复杂度可以单独考虑，也可以与空间复杂性一起考虑在决策中。

公开(公告)号：US08705616B2

公开(公告)日：2014-04-22

申请号：US12814060

申请日：2010-06-11

申请人： Yaming He ,  Florin Folta ,  Chun-Wei Chan ,  Stacey Spears ,  Chuang Gu

发明人： Yaming He ,  Florin Folta ,  Chun-Wei Chan ,  Stacey Spears ,  Chuang Gu

IPC分类号： H04N11/02

CPC分类号： H04N19/436 ,  H04N19/30

摘要： A multiple bitrate (MBR) video encoding management tool utilizes available processing units for parallel MBR video encoding. Instead of focusing only on multi-threading of encoding tasks for a single picture or group of pictures (GOP), the management tool parallelizes the encoding of multiple GOPs between different processing units and/or different computing systems. With this parallel MBR video encoding architecture, different GOPs can be encoded in parallel. To facilitate such parallel encoding, data dependencies between GOPs are removed. The management tool can adjust the number of GOPs to encode in parallel on a computing system so as to favor parallelism of encoding for different GOPs at the expense of parallelism of encoding inside a GOP, or vice versa, and thereby set a suitable balance between encoding latency and throughput.

摘要翻译： 多位比特率（MBR）视频编码管理工具利用可用的处理单元进行并行MBR视频编码。 管理工具不是专注于单个图像或图像组（GOP）的编码任务的多线程，而是在不同的处理单元和/或不同的计算系统之间并行化多个GOP的编码。 利用这种并行MBR视频编码架构，可以并行编码不同的GOP。 为了促进这种并行编码，GOP之间的数据依赖性被去除。 管理工具可以在计算系统上调节GOP并行编码的数量，从而以牺牲GOP内编码并行性为代价的优点，对不同的GOP进行编码的平行化，反之亦然，从而在编码之间设置适当的平衡 延迟和吞吐量。

公开(公告)号：US20120106806A1

公开(公告)日：2012-05-03

申请号：US12916895

申请日：2010-11-01

申请人： Florin O. Folta ,  Yaming He ,  King Wei Hor ,  Minesh G. Shilotri ,  Stacey Spears ,  Chuang Gu

发明人： Florin O. Folta ,  Yaming He ,  King Wei Hor ,  Minesh G. Shilotri ,  Stacey Spears ,  Chuang Gu

IPC分类号： G06K9/00

CPC分类号： G06K9/00295 ,  G06K2009/00328

摘要： The subject disclosure relates to face recognition in video. Face detection data in frames of input data are used to generate face galleries, which are labeled and used in recognizing faces throughout the video. Metadata that associates the video frame and the face are generated and maintained for subsequent identification. Faces other than those found by face detection may be found by face tracking, in which facial landmarks found by the face detection are used to track a face over previous and/or subsequent video frames. Once generated, the maintained metadata may be accessed to efficiently determine the identity of a person corresponding to a viewer-selected face.

摘要翻译： 本公开涉及视频中的面部识别。 输入数据帧中的脸部检测数据用于生成面部画廊，这些画廊被标记并用于识别整个视频中的脸部。 生成并维护与视频帧和脸部相关联的元数据，以便后续识别。 面部检测以外的脸部可以通过脸部跟踪来发现，其中通过面部检测发现的面部地标用于跟踪先前和/或后续视频帧的面部。 一旦生成，可以访问维护的元数据以有效地确定与观众选择的面对应的人的身份。