公开(公告)号：US10452713B2

公开(公告)日：2019-10-22

申请号：US14559705

申请日：2014-12-03

Applicant: Apple Inc.

Inventor： Shujie Liu ,  Ke Zhang ,  Xiaosong Zhou ,  Hsi-Jung Wu ,  Chris Y. Chung ,  James O. Normile ,  Douglas S. Price ,  Albert E. Keinath

IPC: G06F16/738 ,  G06F16/78 ,  G06F16/74 ,  G11B27/34 ,  G06K9/00 ,  G11B27/031 ,  G11B27/30 ,  G06F16/783

Abstract: Systems and processes for improved video editing, summarization and navigation based on generation and analysis of metadata are described. The metadata may be content-based (e.g., differences between neighboring frames, exposure data, key frame identification data, motion data, or face detection data) or non-content-based (e.g., exposure, focus, location, time) and used to prioritize and/or classify portions of video. The metadata may be generated at the time of image capture or during post-processing. Prioritization information, such as a score for various portions of the image data may be based on the metadata and/or image data. Classification information such as the type or quality of a scene may be determined based on the metadata and/or image data. The classification and prioritization information may be metadata and may be used to automatically remove undesirable portions of the video, generate suggestions during editing or automatically generate summary video.

公开(公告)号：US10298854B2

公开(公告)日：2019-05-21

申请号：US14726331

申请日：2015-05-29

Applicant: Apple Inc.

Inventor： Jiefu Zhai ,  Xiaosong Zhou ,  Chris Y. Chung ,  Hsi-Jung Wu

IPC: H04N5/235 ,  H04N5/232 ,  H04N19/176 ,  H04N19/115 ,  H04N19/154 ,  H04N19/117 ,  H04N19/14 ,  H04N19/156

Abstract: Systems and methods are provided for capturing high quality video data, including data having a high dynamic range, for use with conventional encoders and decoders. High dynamic range data is captured using multiple groups of pixels where each group is captured using different exposure times to create groups of pixels. The pixels that are captured at different exposure times may be determined adaptively based on the content of the image, the parameters of the encoding system, or on the available resources within the encoding system. The transition from single exposure to using two different exposure times may be implemented gradually.

公开(公告)号：US10282633B2

公开(公告)日：2019-05-07

申请号：US15298777

申请日：2016-10-20

Applicant: Apple Inc.

Inventor： Shujie Liu ,  Jiefu Zhai ,  Chris Y. Chung ,  Hsi-Jung Wu ,  Yunfei Zheng ,  Albert E. Keinath ,  Xiaosong Zhou ,  Ke Zhang

IPC: G06K9/00 ,  G06K9/46 ,  G06T5/00 ,  G06F16/583 ,  G06K9/03 ,  G06K9/62 ,  G11B27/00

Abstract: A method for processing media assets includes, given a first media asset, deriving characteristics from the first media asset, searching for other media assets having characteristics that correlate to the characteristics of the first media asset, when a match is found, deriving content corrections for the first media asset or a matching media asset from the other of the first media asset or the matching media asset, and correcting content of the first media asset or the matching media asset based on the content corrections.

公开(公告)号：US20190075342A1

公开(公告)日：2019-03-07

申请号：US16180115

申请日：2018-11-05

Applicant: Apple Inc.

Inventor： Yeping Su ,  Chris Y. Chung ,  Xiaosong Zhou ,  James Oliver Normile ,  Hsi-Jung Wu ,  Thomas Jansen ,  Hyeonkuk Jeong ,  Joe S. Abuan ,  Douglas Scott Price

IPC: H04N21/2343 ,  H04N21/44 ,  H04N21/438 ,  H04N21/2381

Abstract: A video streaming method for transitioning between multiple sequences of coded video data may include receiving and decoding transmission units from a first sequence of coded video data. In response to a request to transition to a second sequence of coded video data, the method may determine whether a time to transition to the second sequence of coded video data can be reduced by transitioning to the second sequence of coded video data via an intermediate sequence of coded video data. If the time can be reduced, the method may include receiving at least one transmission unit from an intermediate sequence of coded video data that corresponds to the request to transition, decoding the transmission unit from the intermediate sequence, and transitioning from the first sequence to the second sequence via the decoded transmission unit from the intermediate sequence.

公开(公告)号：US10178394B2

公开(公告)日：2019-01-08

申请号：US15179728

申请日：2016-06-10

Applicant: Apple Inc.

Inventor： Jingteng Xue ,  Yeping Su ,  Chris Chung ,  Xiaosong Zhou ,  Hsi-Jung Wu

IPC: H04N19/167 ,  H04N19/70 ,  H04N19/40 ,  H04N19/44

Abstract: Video coding techniques are disclosed for resource-limited destination display devices. Input video data may be coded by converting a first representation of the input video to a resolution of a destination display and base layer coding the converted representation. Additionally, a region of interest may be predicted from within the input video. The predicted ROI may be converted to a resolution of the destination display, and the converted ROI may be enhancement layer coded. The base layer coded data and the enhancement layer data may be transmitted to the destination display where the coded base layer data is decoded and displayed until a zoom event occurs. When a zoom event occurs, both the coded base layer data and the coded enhancement layer data may be decoded and displayed. Thus, the switchover from a first field of view to an ROI view may be performed quickly.

公开(公告)号：US10051281B2

公开(公告)日：2018-08-14

申请号：US14284701

申请日：2014-05-22

Applicant: Apple Inc.

Inventor： Xiaosong Zhou ,  Hsi-Jung Wu ,  Chris Y. Chung

IPC: H04N7/12 ,  H04N11/02 ,  H04N11/04 ,  H04N19/50 ,  H04N19/105 ,  H04N19/172 ,  H04N19/142 ,  H04N19/87 ,  H04N19/59

Abstract: A video coder, responsive to detection of a zooming transition in source video, estimates a scale factor and a zooming rectangle for a reference frame, scales content of the reference frame within the zooming rectangle according to the scaling factor, codes content of a new frame of the source video predictively using the scaled reference frame as a basis of prediction, and transmits coded video data obtained from the predictive coding to a decoder along with an indication of the scaling factor and zooming rectangle.

公开(公告)号：US10038919B2

公开(公告)日：2018-07-31

申请号：US14290873

申请日：2014-05-29

Applicant: Apple Inc.

Inventor： Jiefu Zhai ,  Dazhong Zhang ,  Xiaosong Zhou ,  Chris Y. Chung ,  Hsi-Jung Wu ,  Peikang Song ,  David R. Conrad ,  Jae Hoon Kim ,  Yunfei Zheng

IPC: H04N7/12 ,  H04N19/82 ,  H04N19/186

CPC classification number: H04N19/82 ,  H04N19/186

Abstract: Chroma deblock filtering of reconstructed video samples may be performed to remove blockiness artifacts and reduce color artifacts without over-smoothing. In a first method, chroma deblocking may be performed for boundary samples of a smallest transform size, regardless of partitions and coding modes. In a second method, chroma deblocking may be performed when a boundary strength is greater than 0. In a third method, chroma deblocking may be performed regardless of boundary strengths. In a fourth method, the type of chroma deblocking to be performed may be signaled in a slice header by a flag. Furthermore, luma deblock filtering techniques may be applied to chroma deblock filtering.

公开(公告)号：US20180184121A1

公开(公告)日：2018-06-28

申请号：US15390202

申请日：2016-12-23

Applicant: Apple Inc.

Inventor： Jae Hoon Kim ,  Xiaosong Zhou ,  Dazhong Zhang ,  Hang Yuan ,  Jiefu Zhai ,  Chris Y. Chung ,  Hsi-Jung Wu

IPC: H04N19/597 ,  H04N19/176 ,  H04N19/105

CPC classification number: H04N19/597 ,  H04N19/105 ,  H04N19/176 ,  H04N19/547

Abstract: Techniques are disclosed for coding video data predictively based on predictions made from spherical-domain projections of input pictures to be coded and reference pictures that are prediction candidates. Spherical projection of an input picture and the candidate reference pictures may be generated. Thereafter, a search may be conducted for a match between the spherical-domain representation of a pixel block to be coded and a spherical-domain representation of the reference picture. On a match, an offset may be determined between the spherical-domain representation of the pixel block to a matching portion of the of the reference picture in the spherical-domain representation. The spherical-domain offset may be transformed to a motion vector in a source-domain representation of the input picture, and the pixel block may be coded predictively with reference to a source-domain representation of the matching portion of the reference picture.

公开(公告)号：US20180109824A1

公开(公告)日：2018-04-19

申请号：US15845287

申请日：2017-12-18

Applicant: Apple Inc.

Inventor： Yeping Su ,  Chris Y. Chung ,  Xiaosong Zhou ,  James Oliver Normile ,  Hsi-Jung Wu ,  Thomas Jansen ,  Hyeonkuk Jeong ,  Joe S. Abuan ,  Douglas Scott Price

IPC: H04N21/2343 ,  H04N21/44 ,  H04N21/438 ,  H04N21/2381

CPC classification number: H04N21/234372 ,  H04N21/23439 ,  H04N21/2381 ,  H04N21/4384 ,  H04N21/44004

Abstract: A video streaming method for transitioning between multiple sequences of coded video data may include receiving and decoding transmission units from a first sequence of coded video data. In response to a request to transition to a second sequence of coded video data, the method may determine whether a time to transition to the second sequence of coded video data can be reduced by transitioning to the second sequence of coded video data via an intermediate sequence of coded video data. If the time can be reduced, the method may include receiving at least one transmission unit from an intermediate sequence of coded video data that corresponds to the request to transition, decoding the transmission unit from the intermediate sequence, and transitioning from the first sequence to the second sequence via the decoded transmission unit from the intermediate sequence.

公开(公告)号：US09876964B2

公开(公告)日：2018-01-23

申请号：US14290351

申请日：2014-05-29

Applicant: Apple Inc.

Inventor： Xiaosong Zhou ,  Hsi-Jung Wu ,  Chris Y. Chung ,  James O. Normile ,  Dazhong Zhang

IPC: H04N7/12 ,  H04N5/262 ,  H04N19/167 ,  H04N19/132 ,  H04N19/115 ,  H04N19/17 ,  H04N19/124 ,  H04N19/136

CPC classification number: H04N5/262 ,  H04N19/115 ,  H04N19/124 ,  H04N19/132 ,  H04N19/136 ,  H04N19/167 ,  H04N19/17

Abstract: Techniques for coding video data estimate depths of different elements within video content and identify regions within the video content based on the estimated depths. One of the regions may be assigned as an area of interest. Thereafter, video content of a region that is not an area of interest may be masked out and the resultant video content obtained from the masking may be coded. The coded video content may be transmitted to a channel. These techniques permit a coding terminal to mask out captured video content prior to coding in order to support coding policies that account for privacy interests or video composition features during a video coding session.