公开(公告)号：US20200304837A1

公开(公告)日：2020-09-24

申请号：US16895815

申请日：2020-06-08

Applicant: Apple Inc.

Inventor： Yunfei Zheng ,  Dazhong Zhang ,  Xiaosong Zhou ,  Chris Y. Chung ,  Hsi-Jung Wu

IPC: H04N19/70

Abstract: An encoding system may include a video source that captures video image, a video coder, and a controller to manage operation of the system. The video coder may encode the video image into encoded video data using a plurality of subgroup parameters corresponding to a plurality of subgroups of pixels within a group. The controller may set the subgroup parameters for at least one of the subgroups of pixels in the video coder, based upon at least one parameters corresponding to the group. A decoding system may decode the video data based upon the motion prediction parameters.

公开(公告)号：US10749923B2

公开(公告)日：2020-08-18

申请号：US15169641

申请日：2016-05-31

Applicant: Apple Inc.

Inventor： Chris Y. Chung ,  Hsi-Jung Wu ,  Xiaosong Zhou ,  Jae Hoon Kim ,  Jingteng Xue

IPC: G06F15/16 ,  H04L29/06 ,  H04W88/02 ,  H04N21/2668 ,  G11B27/034 ,  H04N21/2343 ,  H04N21/258

Abstract: Methods and apparatus for contextual video content adaptation are disclosed. Video content is adapted based on any number of criteria such as a target device type, viewing conditions, network conditions or various use cases, for example. A target adaptation of content may be defined for a specified video source. For example, based on receiving a request from a portable device for a live sports feed, a shortened and reduced resolution version of the live sport feed video may be defined for the portable device. The source content may be accessed and adapted (e.g., adapted temporally, spatially, etc.) and an adapted version of content generated. For example, the source content may be cropped to a particular spatial region of interest and/or reduced in length to a particular scene. The generated adaptation may be transmitted to a device in response to the request, or stored to a storage device.

公开(公告)号：US10652578B2

公开(公告)日：2020-05-12

申请号：US15888559

申请日：2018-02-05

Applicant: Apple Inc.

Inventor： Jae Hoon Kim ,  Dazhong Zhang ,  Hang Yuan ,  Jiefu Zhai ,  Ming Chen ,  Xiaosong Zhou ,  Chris Y. Chung ,  Hsi-Jung Wu

IPC: H04N19/597 ,  H04N19/70 ,  H04N19/105 ,  H04N19/139 ,  H04N19/162 ,  H04N19/167 ,  H04N19/176 ,  H04N19/52

Abstract: Image processing techniques may accelerate coding of viewport data contained within multi-view image data. According to such techniques, an encoder may shifting content of a multi-directional image data according to the viewport location data provided by a decoder. The encoder may code the shifted multi-directional image data by predictive coding, and transmit to the decoder, the coded multi-directional image data and data identifying an amount of the shift. Doing so may move the viewport location to positions in the image data that are coded earlier than the positions that the viewport location naturally occupies and, thereby, may accelerate coding. On decode, a decoder may compare its present viewport location with viewport location data provided by the encoder with coded video data. The decoder may decode the coded video data and extract a portion of the decoded video data corresponding to a present viewport location for display.

公开(公告)号：US10575008B2

公开(公告)日：2020-02-25

申请号：US15169072

申请日：2016-05-31

Applicant: Apple Inc.

Inventor： Dazhong Zhang ,  Hsi-Jung Wu ,  Peikang Song ,  Yunfei Zheng ,  Chris Y. Chung ,  Jae Hoon Kim ,  Xiaosong Zhou

IPC: H04N19/184 ,  H04N19/44 ,  H04N19/37 ,  H04N19/40 ,  H04N19/85

Abstract: A method of managing resources on a terminal includes determining a number of downloaded video streams active at the terminal, prioritizing the active video streams, assigning a decoding quality level to each active video stream based on a priority assignment for each active video stream, and apportioning reception bandwidth to each active video stream based on an assigned quality level of each active video stream.

公开(公告)号：US10523913B2

公开(公告)日：2019-12-31

申请号：US15638709

申请日：2017-06-30

Applicant: Apple Inc.

Inventor： Jae Hoon Kim ,  Ming Chen ,  Xiaosong Zhou ,  Hsi-Jung Wu ,  Dazhong Zhang ,  Hang Yuan ,  Jiefu Zhai ,  Chris Y. Chung

IPC: H04N13/161 ,  H04N19/597 ,  H04N19/70 ,  H04N5/232 ,  H04N13/243 ,  H04N13/139

Abstract: Frame packing techniques are disclosed for multi-directional images and video. According to an embodiment, a multi-directional source image is reformatted into a format in which image data from opposing fields of view are represented in respective regions of the packed image as flat image content. Image data from a multi-directional field of view of the source image between the opposing fields of view are represented in another region of the packed image as equirectangular image content. It is expected that use of the formatted frame will lead to coding efficiencies when the formatted image is processed by predictive video coding techniques and the like.

公开(公告)号：US20190104315A1

公开(公告)日：2019-04-04

申请号：US15724798

申请日：2017-10-04

Applicant: Apple Inc.

Inventor： Mei Guo ,  Jun Xin ,  Yeping Su ,  Chris Y. Chung ,  Xiaosong Zhou ,  Hsi-Jung Wu

IPC: H04N19/142 ,  H04N19/172 ,  H04N19/66 ,  H04N19/14 ,  H04N19/44 ,  H04N19/115

Abstract: The present disclosure describes techniques for coding video data in a manner that provides consistency to portions of the video that have similar content. According to such techniques, a video sequence may be parsed into partitions and content of the partitions may be analyzed. Partitions may be grouped together based on detected similarities in content. Coding parameters may be selected for each partition based on the partition's membership in the groups. Thus, when the video sequence is coded, coding parameters for frames of two commonly-grouped partitions may be similar, which causes coded video data to have similar presentation.

公开(公告)号：US20190058846A1

公开(公告)日：2019-02-21

申请号：US16112540

申请日：2018-08-24

Applicant: Apple Inc.

Inventor： Xiasong Zhou ,  Hsi-Jung Wu ,  Chris Y. Chung ,  James Normile ,  Joe S. Abuan ,  Hyeonkuk Jeong ,  Yan Yang ,  Gobind Johar ,  Thomas Christopher Jansen

IPC: H04N7/14 ,  H04L12/58 ,  H04N7/15 ,  H04L29/06

Abstract: Computing devices may implement instant video communication connections for video communications. Connection information for mobile computing devices may be maintained. A request to initiate an instant video communication may be received, and if authorized, the connection information for the particular recipient mobile computing device may be accessed. Video communication data may then be sent to the recipient mobile computing device according to the connection information so that the video communication data may be displayed at the recipient device as it is received. New connection information for different mobile computing devices may be added, or updates to existing connection information may also be performed. Connection information for some mobile computing devices may be removed.

公开(公告)号：US10212456B2

公开(公告)日：2019-02-19

申请号：US15612806

申请日：2017-06-02

Applicant: Apple Inc.

Inventor： Mei Guo ,  Feng Yi ,  Jun Xin ,  Chris Y. Chung ,  Yeping Su ,  Xiaosong Zhou ,  Jun Xu ,  Hsi-Jung Wu ,  Jingteng Xue

IPC: H04N19/86 ,  H04N19/117 ,  H04N19/159

Abstract: Methods of in-loop deblocking filter for high dynamic range (HDR) video compression are disclosed. HDR processing and standard dynamic range (SDR) processing adopt different electro-optical transfer function (EOTF) to convert digital code words to linear luminance. For compressing HDR video, EOTF is proposed to be involved in the selection of two deblocking parameters, β and tC, which control the strength of deblocking filter. In local activity checking for filter decisions, the calculated local signal characteristics and the thresholds are adjusted according to EOTF. After deblocking filter, the clipping range is modified based on EOTF. The chroma deblocking filter is also extended to inter-inter block boundary.

公开(公告)号：US20190007669A1

公开(公告)日：2019-01-03

申请号：US15638709

申请日：2017-06-30

Applicant: Apple Inc.

Inventor： Jae Hoon Kim ,  Ming Chen ,  Xiaosong Zhou ,  Hsi-Jung Wu ,  Dazhong Zhang ,  Hang Yuan ,  Jiefu Zhai ,  Chris Y. Chung

IPC: H04N13/00 ,  H04N19/597 ,  H04N13/02 ,  H04N19/70 ,  H04N5/232

CPC classification number: H04N13/161 ,  H04N5/23238 ,  H04N13/139 ,  H04N13/243 ,  H04N19/597 ,  H04N19/70

Abstract: Frame packing techniques are disclosed for multi-directional images and video. According to an embodiment, a multi-directional source image is reformatted into a format in which image data from opposing fields of view are represented in respective regions of the packed image as flat image content. Image data from a multi-directional field of view of the source image between the opposing fields of view are represented in another region of the packed image as equirectangular image content. It is expected that use of the formatted frame will lead to coding efficiencies when the formatted image is processed by predictive video coding techniques and the like.

公开(公告)号：US20180352225A1

公开(公告)日：2018-12-06

申请号：US15612880

申请日：2017-06-02

Applicant: Apple Inc.

Inventor： Mei Guo ,  Jun Xin ,  Yeping Su ,  Chris Y. Chung ,  Xiaosong Zhou ,  Hsi-Jung Wu

IPC: H04N19/117 ,  H04N19/136 ,  H04N19/186 ,  H04N19/46 ,  H04N19/157 ,  H04N19/80

CPC classification number: H04N19/117 ,  H04N19/136 ,  H04N19/157 ,  H04N19/186 ,  H04N19/46 ,  H04N19/80

Abstract: Methods of sample adaptive offset (SAO) for high dynamic range (HDR) video compression are disclosed. For band offset (BO), the sample range of each component is unequally divided into a number of bands based on the distribution of samples, the electro-optical transfer function (EOTF) of HDR source and one perceptually uniform EOTF. Each component may have a different number of bands, different number of signaled bands, and different range value for signaled offsets in BO mode. For edge offset (EO), Cb and Cr may use separate syntax elements. In the sample classification for EO, the difference between the current sample and its neighbor is compared with a threshold to determine whether it is a local valley, a local peak, or corners. A distortion measure for HDR source images are also disclosed.