公开(公告)号：US20130329781A1

公开(公告)日：2013-12-12

申请号：US13631605

申请日：2012-09-28

Applicant: APPLE INC.

Inventor： Yeping Su ,  Hsi-Jung Wu ,  Hao Pan ,  Ke Zhang

IPC: H04N7/26

CPC classification number: H04N19/10 ,  H04N21/23424 ,  H04N21/23439 ,  H04N21/242 ,  H04N21/8456

Abstract: A vide coding server may code a common video sequence into a plurality of coded data streams, each coded data stream representing the video sequence coded using coding parameters tailored for a respective transmission bit rate. The coding may cause a set of transmission units from among the coded data streams to include coded video data from a common point of the video sequence, and a first coded frame of each transmission unit of the set to be a synchronization frame. A manifest file may be built representing an index of transmission units of the respective coded data streams. The coded data streams and manifest file may be stored by the server for delivery to a client device. During download and decode, the chunks may be decoded efficiently even when switching among streams because the first frame in each chunk is a synchronization frame.

Abstract translation: 视频编码服务器可以将公共视频序列编码为多个编码数据流，每个编码数据流表示使用针对相应传输比特率定制的编码参数进行编码的视频序列。 编码可以使得编码数据流中的一组传输单元包括来自视频序列的公共点的编码视频数据和作为同步帧的组的每个传输单元的第一编码帧。 可以构建表示相应编码数据流的传输单元的索引的清单文件。 编码数据流和清单文件可以由服务器存储以传送到客户端设备。 在下载和解码期间，即使在每个块中的第一帧是同步帧时，即使切换流之间也可以有效地解码该块。

公开(公告)号：US20130235942A1

公开(公告)日：2013-09-12

申请号：US13631428

申请日：2012-09-28

Applicant: APPLE INC.

Inventor： Yeping Su ,  Hao Pan ,  Ke Zhang ,  Douglas Scott Price ,  James Oliver Normile ,  Hsi-Jung Wu

IPC: H04N7/26

CPC classification number: H04N19/577 ,  H04N19/107 ,  H04N19/117 ,  H04N19/124 ,  H04N19/139 ,  H04N19/149 ,  H04N19/15 ,  H04N19/154 ,  H04N19/156 ,  H04N19/172 ,  H04N19/192 ,  H04N19/46 ,  H04N19/58

Abstract: Video coding systems and methods protect against banding artifacts in decoded image content. According to the method, a video coder may identify, from content of pixel blocks of a frame of video data, which pixel blocks are likely to exhibit banding artifacts from the video coding/decoding processes. The video coder may assemble regions of the frame that are likely to exhibit banding artifacts based on the identified pixel blocks' locations with respect to each other. The video coder may apply anti-banding processing to pixel blocks within one or more of the identified regions and, thereafter, may code the processed frame by a compression operation.

Abstract translation: 视频编码系统和方法保护解码图像内容中的带状伪像。 根据该方法，视频编码器可以根据视频数据帧的像素块的内容从视频编码/解码处理中识别哪些像素块可能呈现带状伪影。 视频编码器可以基于所识别的像素块相对于彼此的位置来组合可能呈现带状伪影的帧的区域。 视频编码器可以对所识别的一个或多个区域内的像素块应用反绑带处理，然后可以通过压缩操作来对经处理的帧进行编码。

公开(公告)号：US10062412B2

公开(公告)日：2018-08-28

申请号：US15173465

申请日：2016-06-03

Applicant: Apple Inc.

Inventor： Shujie Liu ,  Yunfei Zheng ,  Xiaosong Zhou ,  Hsi-Jung Wu ,  Ke Zhang ,  Albert E. Keinath ,  Chris Y. Chung

IPC: G11B27/031 ,  G06K9/00

CPC classification number: G11B27/031 ,  G06K9/00718 ,  G06K9/00751 ,  G06K9/00765 ,  G11B27/28

Abstract: Methods for organizing media data by automatically segmenting media data into hierarchical layers of scenes are described. The media data may include metadata and content having still image, video or audio data. The metadata may be content-based (e.g., differences between neighboring frames, exposure data, key frame identification data, motion data, or face detection data) or non-content-based (e.g., exposure, focus, location, time) and used to prioritize and/or classify portions of video. The metadata may be generated at the time of image capture or during post-processing. Prioritization information, such as a score for various portions of the image data may be based on the metadata and/or image data. Classification information such as the type or quality of a scene may be determined based on the metadata and/or image data. The classification and prioritization information may be metadata and may be used to organize the media data.

公开(公告)号：US20160092561A1

公开(公告)日：2016-03-31

申请号：US14559705

申请日：2014-12-03

Applicant: Apple Inc.

Inventor： Shujie Liu ,  Ke Zhang ,  Xiaosong Zhou ,  Hsi-Jung Wu ,  Chris Y. Chung ,  James O. Normile ,  Douglas S. Price ,  Albert E. Keinath

IPC: G06F17/30 ,  G06K9/00 ,  G11B27/031 ,  G11B27/34 ,  G11B27/30

CPC classification number: G06F16/739 ,  G06F16/745 ,  G06F16/783 ,  G06F16/7837 ,  G06F16/7867 ,  G06K9/00718 ,  G06K9/00751 ,  G11B27/031 ,  G11B27/3081 ,  G11B27/34

Abstract: Systems and processes for improved video editing, summarization and navigation based on generation and analysis of metadata are described. The metadata may be content-based (e.g., differences between neighboring frames, exposure data, key frame identification data, motion data, or face detection data) or non-content-based (e.g., exposure, focus, location, time) and used to prioritize and/or classify portions of video. The metadata may be generated at the time of image capture or during post-processing. Prioritization information, such as a score for various portions of the image data may be based on the metadata and/or image data. Classification information such as the type or quality of a scene may be determined based on the metadata and/or image data. The classification and prioritization information may be metadata and may be used to automatically remove undesirable portions of the video, generate suggestions during editing or automatically generate summary video.

Abstract translation: 描述了基于元数据生成和分析改进视频编辑，汇总和导航的系统和过程。 元数据可以是基于内容的（例如，相邻帧之间的差异，曝光数据，关键帧识别数据，运动数据或面部检测数据）或非基于内容的（例如，曝光，焦点，位置，时间）并且被使用 对视频的部分进行优先排序和/或分类。 元数据可以在图像捕获时或在后处理期间生成。 诸如图像数据的各个部分的得分的优先级信息可以基于元数据和/或图像数据。 可以基于元数据和/或图像数据来确定诸如场景的类型或质量的分类信息。 分类和优先化信息可以是元数据，并且可以用于自动去除视频的不期望的部分，在编辑期间生成建议或自动生成汇总视频。

公开(公告)号：US20150350714A1

公开(公告)日：2015-12-03

申请号：US14290227

申请日：2014-05-29

Applicant: Apple Inc.

Inventor： James O. Normile ,  Hsi-Jung Wu ,  Xiaosong Zhou ,  Chris Y. Chung ,  Ke Zhang ,  Yeping Su

IPC: H04N21/433 ,  H04N21/258 ,  H04N21/437 ,  H04N21/81

CPC classification number: H04N21/433 ,  H04L65/4084 ,  H04L67/1078 ,  H04L67/108 ,  H04N21/231 ,  H04N21/25891 ,  H04N21/26258 ,  H04N21/432 ,  H04N21/437 ,  H04N21/6587 ,  H04N21/812 ,  H04N21/8456 ,  H04N21/85406

Abstract: A method and system for caching and streaming media content, including predictively delivering and/or acquiring content is provided. In the system, client devices may be communicatively coupled in a network, and may access and share cached content. Video segments making up a media stream may be selectively delivered to the clients such that a complete media stream may be formed from the different segments delivered to the different clients. Video segments may be pushed by the server to the client or requested by the client according to a prioritization scheme, including downloading: partial items on a client's subscription log, lower quality version(s) of content before higher quality version(s), higher bitrate segments before lower bitrate segments, summaries of full-length content, advertisements and splash screens common to multiple video clips.

Abstract translation: 提供了一种用于缓存和流式传输媒体内容的方法和系统，包括预测地传递和/或获取内容。 在系统中，客户机设备可以通信地耦合在网络中，并且可以访问和共享缓存的内容。 构成媒体流的视频片段可以被选择性地传递到客户端，使得可以从递送到不同客户端的不同片段形成完整的媒体流。 视频片段可以由服务器推送到客户端或由客户端根据优先化方案请求，包括下载：客户端订阅日志上的部分项目，较高质量版本之前的较低质量版本的内容，更高质量版本 低比特率段之间的比特率段，多个视频剪辑共有的全长内容，广告和闪屏的总结。

公开(公告)号：US11605224B2

公开(公告)日：2023-03-14

申请号：US16882959

申请日：2020-05-26

Applicant: Apple Inc.

Inventor： Bartlomiej Rymkowski ,  Robert Bailey ,  Ethan Tira-Thompson ,  Shuang Gao ,  Ben Englert ,  Emilie Kim ,  Shujie Liu ,  Ke Zhang ,  Vinay Sharma ,  Xiaosong Zhou

IPC: G06V20/40 ,  G06T7/73 ,  G06T7/246 ,  G06V20/64

Abstract: Techniques disclosed for managing video captured by an imaging device. Methods disclosed capture a video in response to a capture command received at the imaging device. Following a video capture, techniques for classifying the captured video based on feature(s) extracted therefrom, for marking the captured video based on the classification, and for generating a media item from the captured video according to the marking are disclosed. Accordingly, the captured video may be classified as representing a static event, and, as a result, a media item of a still image may be generated. Otherwise, the captured video may be classified as representing a dynamic event, and, as a result, a media item of a video may be generated.

公开(公告)号：US10536731B2

公开(公告)日：2020-01-14

申请号：US14710520

申请日：2015-05-12

Applicant: Apple Inc.

Inventor： Yeping Su ,  Jiefu Zhai ,  Ke Zhang ,  Xiaosong Zhou ,  Hsi-Jung Wu ,  Chris Y. Chung

IPC: H04N19/50 ,  H04N21/2343 ,  H04N21/234 ,  H04N21/2385 ,  H04N21/438 ,  H04N21/44 ,  H04N21/4402 ,  H04N19/186 ,  H04N19/184

Abstract: Systems and methods are provided for processing high quality video data, such as data having a higher than standard bit depth, a high dynamic range, or a wide or custom color gamut, to be compatible with conventional encoders and decoders without significant loss of quality. High quality data is encoded into a plurality of layers with a base layer having the standard quality data and one or more higher quality layers. Decoding systems and methods may map the base layer to the dynamic range or color gamut of the enhancement layer, combine the layers, and map the combined layers to a dynamic range or color gamut appropriate for the target display. Each of the standard quality and the high quality data may be encoded as a plurality of tiers of increasing quality and reference lower level tiers as sources of prediction during predictive coding.

公开(公告)号：US10452713B2

公开(公告)日：2019-10-22

申请号：US14559705

申请日：2014-12-03

Applicant: Apple Inc.

Inventor： Shujie Liu ,  Ke Zhang ,  Xiaosong Zhou ,  Hsi-Jung Wu ,  Chris Y. Chung ,  James O. Normile ,  Douglas S. Price ,  Albert E. Keinath

IPC: G06F16/738 ,  G06F16/78 ,  G06F16/74 ,  G11B27/34 ,  G06K9/00 ,  G11B27/031 ,  G11B27/30 ,  G06F16/783

Abstract: Systems and processes for improved video editing, summarization and navigation based on generation and analysis of metadata are described. The metadata may be content-based (e.g., differences between neighboring frames, exposure data, key frame identification data, motion data, or face detection data) or non-content-based (e.g., exposure, focus, location, time) and used to prioritize and/or classify portions of video. The metadata may be generated at the time of image capture or during post-processing. Prioritization information, such as a score for various portions of the image data may be based on the metadata and/or image data. Classification information such as the type or quality of a scene may be determined based on the metadata and/or image data. The classification and prioritization information may be metadata and may be used to automatically remove undesirable portions of the video, generate suggestions during editing or automatically generate summary video.

公开(公告)号：US10282633B2

公开(公告)日：2019-05-07

申请号：US15298777

申请日：2016-10-20

Applicant: Apple Inc.

Inventor： Shujie Liu ,  Jiefu Zhai ,  Chris Y. Chung ,  Hsi-Jung Wu ,  Yunfei Zheng ,  Albert E. Keinath ,  Xiaosong Zhou ,  Ke Zhang

IPC: G06K9/00 ,  G06K9/46 ,  G06T5/00 ,  G06F16/583 ,  G06K9/03 ,  G06K9/62 ,  G11B27/00

Abstract: A method for processing media assets includes, given a first media asset, deriving characteristics from the first media asset, searching for other media assets having characteristics that correlate to the characteristics of the first media asset, when a match is found, deriving content corrections for the first media asset or a matching media asset from the other of the first media asset or the matching media asset, and correcting content of the first media asset or the matching media asset based on the content corrections.

公开(公告)号：US09888240B2

公开(公告)日：2018-02-06

申请号：US14056043

申请日：2013-10-17

Applicant: Apple Inc.

Inventor： Yeping Su ,  Chris Y. Chung ,  Hao Pan ,  Hsi-Jung Wu ,  Ke Zhang

IPC: H04N19/117 ,  H04N19/136

CPC classification number: H04N19/117 ,  H04N19/136

Abstract: Video coding systems and methods are provided that protect against various artifacts (e.g., banding artifacts) in decoded frame content. The embodiments to protect against introducing artifacts include pre-processing the input video frame, controlling the encoding parameters and/or post-processing the decoded video frame. A method for encoding a frame may include calculating a dark-scene score for the frame based on measured statistics of the frame. The dark-scene score may be compared to a threshold to determine if the banding artifacts may be present in the frame. Based on the comparison, filtering parameters for the frame may be altered to reduce the amount of noise filtered from the frame. The frame may be filtered based on the altered filtering parameters and encoded.