公开(公告)号：US20220329756A1

公开(公告)日：2022-10-13

申请号：US17846896

申请日：2022-06-22

Applicant: Apple Inc.

Inventor： Jae Hoon Kim ,  Chris Y. Chung ,  Dazhong Zhang ,  Hang Yuan ,  Hsi-Jung Wu ,  Xiaosong Zhou ,  Jiefu Zhai

IPC: H04N7/14 ,  H04N7/15 ,  G06F3/0488

Abstract: Embodiments of the present disclosure provide systems and methods for perspective shifting in a video conferencing session. In one exemplary method, a video stream may be generated. A foreground element may be identified in a frame of the video stream and distinguished from a background element of the frame. Data may be received representing a viewing condition at a terminal that will display the generated video stream. The frame of the video stream may be modified based on the received data to shift of the foreground element relative to the background element. The modified video stream may be displayed at the displaying terminal.

公开(公告)号：US10992919B2

公开(公告)日：2021-04-27

申请号：US16725245

申请日：2019-12-23

Applicant: Apple Inc.

Inventor： Jae Hoon Kim ,  Ming Chen ,  Xiaosong Zhou ,  Hsi-Jung Wu ,  Dazhong Zhang ,  Hang Yuan ,  Jiefu Zhai ,  Chris Y. Chung

IPC: H04N13/161 ,  H04N19/597 ,  H04N19/70 ,  H04N5/232 ,  H04N13/243 ,  H04N13/139

Abstract: Frame packing techniques are disclosed for multi-directional images and video. According to an embodiment, a multi-directional source image is reformatted into a format in which image data from opposing fields of view are represented in respective regions of the packed image as flat image content. Image data from a multi-directional field of view of the source image between the opposing fields of view are represented in another region of the packed image as equirectangular image content. It is expected that use of the formatted frame will lead to coding efficiencies when the formatted image is processed by predictive video coding techniques and the like.

公开(公告)号：US10754242B2

公开(公告)日：2020-08-25

申请号：US15638848

申请日：2017-06-30

Applicant: Apple Inc.

Inventor： Jae Hoon Kim ,  Ming Chen ,  Xiaosong Zhou ,  Hsi-Jung Wu ,  Dazhong Zhang ,  Hang Yuan ,  Jiefu Zhai ,  Chris Y. Chung

IPC: G03B37/04 ,  G06T3/40 ,  H04N5/232 ,  H04N19/172 ,  H04N19/159 ,  G06T3/00 ,  H04N19/597 ,  H04N19/105 ,  H04N13/161

Abstract: Techniques are described for implementing format configurations for multi-directional video and for switching between them. Source images may be assigned to formats that may change during a coding session. When a change occurs between formats, video coders and decoder may transform decoded reference frames from the first format to the second format. Thereafter, new frames in the second configuration may be coded or decoded predictively using transformed reference frame(s) as source(s) of prediction. In this manner, video coders and decoders may use intra-coding techniques and achieve high efficiency in coding.

公开(公告)号：US10536731B2

公开(公告)日：2020-01-14

申请号：US14710520

申请日：2015-05-12

Applicant: Apple Inc.

Inventor： Yeping Su ,  Jiefu Zhai ,  Ke Zhang ,  Xiaosong Zhou ,  Hsi-Jung Wu ,  Chris Y. Chung

IPC: H04N19/50 ,  H04N21/2343 ,  H04N21/234 ,  H04N21/2385 ,  H04N21/438 ,  H04N21/44 ,  H04N21/4402 ,  H04N19/186 ,  H04N19/184

Abstract: Systems and methods are provided for processing high quality video data, such as data having a higher than standard bit depth, a high dynamic range, or a wide or custom color gamut, to be compatible with conventional encoders and decoders without significant loss of quality. High quality data is encoded into a plurality of layers with a base layer having the standard quality data and one or more higher quality layers. Decoding systems and methods may map the base layer to the dynamic range or color gamut of the enhancement layer, combine the layers, and map the combined layers to a dynamic range or color gamut appropriate for the target display. Each of the standard quality and the high quality data may be encoded as a plurality of tiers of increasing quality and reference lower level tiers as sources of prediction during predictive coding.

公开(公告)号：US10452713B2

公开(公告)日：2019-10-22

申请号：US14559705

申请日：2014-12-03

Applicant: Apple Inc.

Inventor： Shujie Liu ,  Ke Zhang ,  Xiaosong Zhou ,  Hsi-Jung Wu ,  Chris Y. Chung ,  James O. Normile ,  Douglas S. Price ,  Albert E. Keinath

IPC: G06F16/738 ,  G06F16/78 ,  G06F16/74 ,  G11B27/34 ,  G06K9/00 ,  G11B27/031 ,  G11B27/30 ,  G06F16/783

Abstract: Systems and processes for improved video editing, summarization and navigation based on generation and analysis of metadata are described. The metadata may be content-based (e.g., differences between neighboring frames, exposure data, key frame identification data, motion data, or face detection data) or non-content-based (e.g., exposure, focus, location, time) and used to prioritize and/or classify portions of video. The metadata may be generated at the time of image capture or during post-processing. Prioritization information, such as a score for various portions of the image data may be based on the metadata and/or image data. Classification information such as the type or quality of a scene may be determined based on the metadata and/or image data. The classification and prioritization information may be metadata and may be used to automatically remove undesirable portions of the video, generate suggestions during editing or automatically generate summary video.

公开(公告)号：US10298854B2

公开(公告)日：2019-05-21

申请号：US14726331

申请日：2015-05-29

Applicant: Apple Inc.

Inventor： Jiefu Zhai ,  Xiaosong Zhou ,  Chris Y. Chung ,  Hsi-Jung Wu

IPC: H04N5/235 ,  H04N5/232 ,  H04N19/176 ,  H04N19/115 ,  H04N19/154 ,  H04N19/117 ,  H04N19/14 ,  H04N19/156

Abstract: Systems and methods are provided for capturing high quality video data, including data having a high dynamic range, for use with conventional encoders and decoders. High dynamic range data is captured using multiple groups of pixels where each group is captured using different exposure times to create groups of pixels. The pixels that are captured at different exposure times may be determined adaptively based on the content of the image, the parameters of the encoding system, or on the available resources within the encoding system. The transition from single exposure to using two different exposure times may be implemented gradually.

公开(公告)号：US10282633B2

公开(公告)日：2019-05-07

申请号：US15298777

申请日：2016-10-20

Applicant: Apple Inc.

Inventor： Shujie Liu ,  Jiefu Zhai ,  Chris Y. Chung ,  Hsi-Jung Wu ,  Yunfei Zheng ,  Albert E. Keinath ,  Xiaosong Zhou ,  Ke Zhang

IPC: G06K9/00 ,  G06K9/46 ,  G06T5/00 ,  G06F16/583 ,  G06K9/03 ,  G06K9/62 ,  G11B27/00

Abstract: A method for processing media assets includes, given a first media asset, deriving characteristics from the first media asset, searching for other media assets having characteristics that correlate to the characteristics of the first media asset, when a match is found, deriving content corrections for the first media asset or a matching media asset from the other of the first media asset or the matching media asset, and correcting content of the first media asset or the matching media asset based on the content corrections.

公开(公告)号：US20190075342A1

公开(公告)日：2019-03-07

申请号：US16180115

申请日：2018-11-05

Applicant: Apple Inc.

Inventor： Yeping Su ,  Chris Y. Chung ,  Xiaosong Zhou ,  James Oliver Normile ,  Hsi-Jung Wu ,  Thomas Jansen ,  Hyeonkuk Jeong ,  Joe S. Abuan ,  Douglas Scott Price

IPC: H04N21/2343 ,  H04N21/44 ,  H04N21/438 ,  H04N21/2381

Abstract: A video streaming method for transitioning between multiple sequences of coded video data may include receiving and decoding transmission units from a first sequence of coded video data. In response to a request to transition to a second sequence of coded video data, the method may determine whether a time to transition to the second sequence of coded video data can be reduced by transitioning to the second sequence of coded video data via an intermediate sequence of coded video data. If the time can be reduced, the method may include receiving at least one transmission unit from an intermediate sequence of coded video data that corresponds to the request to transition, decoding the transmission unit from the intermediate sequence, and transitioning from the first sequence to the second sequence via the decoded transmission unit from the intermediate sequence.

公开(公告)号：US10051281B2

公开(公告)日：2018-08-14

申请号：US14284701

申请日：2014-05-22

Applicant: Apple Inc.

Inventor： Xiaosong Zhou ,  Hsi-Jung Wu ,  Chris Y. Chung

IPC: H04N7/12 ,  H04N11/02 ,  H04N11/04 ,  H04N19/50 ,  H04N19/105 ,  H04N19/172 ,  H04N19/142 ,  H04N19/87 ,  H04N19/59

Abstract: A video coder, responsive to detection of a zooming transition in source video, estimates a scale factor and a zooming rectangle for a reference frame, scales content of the reference frame within the zooming rectangle according to the scaling factor, codes content of a new frame of the source video predictively using the scaled reference frame as a basis of prediction, and transmits coded video data obtained from the predictive coding to a decoder along with an indication of the scaling factor and zooming rectangle.

公开(公告)号：US10038919B2

公开(公告)日：2018-07-31

申请号：US14290873

申请日：2014-05-29

Applicant: Apple Inc.

Inventor： Jiefu Zhai ,  Dazhong Zhang ,  Xiaosong Zhou ,  Chris Y. Chung ,  Hsi-Jung Wu ,  Peikang Song ,  David R. Conrad ,  Jae Hoon Kim ,  Yunfei Zheng

IPC: H04N7/12 ,  H04N19/82 ,  H04N19/186

CPC classification number: H04N19/82 ,  H04N19/186

Abstract: Chroma deblock filtering of reconstructed video samples may be performed to remove blockiness artifacts and reduce color artifacts without over-smoothing. In a first method, chroma deblocking may be performed for boundary samples of a smallest transform size, regardless of partitions and coding modes. In a second method, chroma deblocking may be performed when a boundary strength is greater than 0. In a third method, chroma deblocking may be performed regardless of boundary strengths. In a fourth method, the type of chroma deblocking to be performed may be signaled in a slice header by a flag. Furthermore, luma deblock filtering techniques may be applied to chroma deblock filtering.