公开(公告)号：US10735773B2

公开(公告)日：2020-08-04

申请号：US14730975

申请日：2015-06-04

Applicant: Apple Inc.

Inventor： Peikang Song ,  Jae Hoon Kim ,  Xiaosong Zhou ,  Chris Y. Chung ,  Hsi-Jung Wu ,  Dazhong Zhang

IPC: H04N19/85 ,  H04N19/117 ,  H04N19/137 ,  H04N19/132 ,  H04N19/172

Abstract: Techniques for coding video data are described that maintain high precision coding for low motion video content. Such techniques include determining whether a source video sequence to be coded has low motion content. When the source video sequence contains low motion content, the video sequence may be coded as a plurality of coded frames using a chain of temporal prediction references among the coded frames. Thus, a single frame in the source video sequence is coded as a plurality of frames. Because the coded frames each represent identical content, the quality of coding should improve across the plurality of frames. Optionally, the disclosed techniques may increase the resolution at which video is coded to improve precision and coding quality.

公开(公告)号：US10652567B2

公开(公告)日：2020-05-12

申请号：US15938158

申请日：2018-03-28

Applicant: Apple Inc.

Inventor： Xing Wen ,  Dazhong Zhang ,  Peikang Song ,  Xiaosong Zhou ,  Sudeng Hu ,  Hsi-Jung Wu ,  Jae Hoon Kim

IPC: H04N19/51 ,  H04N19/44 ,  H04N19/65 ,  H04N19/176 ,  H04N19/91

Abstract: Techniques are disclosed for coding and decoding video data using object recognition and object modeling as a basis of coding and error recovery. A video decoder may decode coded video data received from a channel. The video decoder may perform object recognition on decoded video data obtained therefrom, and, when an object is recognized in the decoded video data, the video decoder may generate a model representing the recognized object. It may store data representing the model locally. The video decoder may communicate the model data to an encoder, which may form a basis of error mitigation and recovery. The video decoder also may monitor deviation patterns in the object model and associated patterns in audio content; if/when video decoding is suspended due to operational errors, the video decoder may generate simulated video data by analyzing audio data received during the suspension period and developing video data from the data model and deviation(s) associated with patterns detected from the audio data.

公开(公告)号：US20200059628A1

公开(公告)日：2020-02-20

申请号：US16666073

申请日：2019-10-28

Applicant: Apple Inc.

Inventor： Elizabeth C. Cranfill ,  Stephen O. Lemay ,  Joe S. Abuan ,  Hsi-Jung Wu ,  Xiaosong Zhou ,  Roberto Garcia, JR.

IPC: H04N7/14 ,  G06F3/0481 ,  H04N5/272 ,  H04N5/262 ,  G06F3/0484 ,  H04N7/15 ,  G06F3/0488 ,  H04M1/725 ,  H04N5/225 ,  G09G5/14 ,  G06F3/0486 ,  G06F3/0482 ,  G06F9/451

Abstract: Some embodiments provide a method for initiating a video conference using a first mobile device. The method presents, during an audio call through a wireless communication network with a second device, a selectable user-interface (UI) item on the first mobile device for switching from the audio call to the video conference. The method receives a selection of the selectable UI item. The method initiates the video conference without terminating the audio call. The method terminates the audio call before allowing the first and second devices to present audio and video data exchanged through the video conference.

公开(公告)号：US20190279681A1

公开(公告)日：2019-09-12

申请号：US15917441

申请日：2018-03-09

Applicant: Apple Inc.

Inventor： Hang Yuan ,  Jiefu Zhai ,  Ming Chen ,  Jae Hoon Kim ,  Dazhong Zhang ,  Xiaosong Zhou ,  Chris Y. Chung ,  Hsi-Jung Wu

IPC: G11B27/031 ,  G06T5/00 ,  G06T7/73 ,  G06T19/20 ,  G06K9/00

Abstract: Techniques are presented for modifying images of an object in video, for example to correct for lens distortion, or to beautify a face. These techniques include extracting and validating features of an object from a source video frame, tracking those features over time, estimating a pose of the object, modifying a 3D model of the object based on the features, and rendering a modified video frame based on the modified 3D model and modified intrinsic and extrinsic matrices. These techniques may be applied in real-time to an object in a sequence of video frames.

公开(公告)号：US20190246141A1

公开(公告)日：2019-08-08

申请号：US15888559

申请日：2018-02-05

Applicant: Apple Inc.

Inventor： Jae Hoon Kim ,  Dazhong Zhang ,  Hang Yuan ,  Jiefu Zhai ,  Ming Chen ,  Xiaosong Zhou ,  Chris Y. Chung ,  Hsi-Jung Wu

IPC: H04N19/597 ,  H04N19/139 ,  H04N19/176 ,  H04N19/105 ,  H04N19/52 ,  H04N19/167 ,  H04N19/162

CPC classification number: H04N19/597 ,  H04N19/105 ,  H04N19/139 ,  H04N19/162 ,  H04N19/167 ,  H04N19/176 ,  H04N19/52

Abstract: Image processing techniques may accelerate coding of viewport data contained within multi-view image data. According to such techniques, an encoder may shifting content of a multi-directional image data according to the viewport location data provided by a decoder. The encoder may code the shifted multi-directional image data by predictive coding, and transmit to the decoder, the coded multi-directional image data and data identifying an amount of the shift. Doing so may move the viewport location to positions in the image data that are coded earlier than the positions that the viewport location naturally occupies and, thereby, may accelerate coding. On decode, a decoder may compare its present viewport location with viewport location data provided by the encoder with coded video data. The decoder may decode the coded video data and extract a portion of the decoded video data corresponding to a present viewport location for display.

公开(公告)号：US10200687B2

公开(公告)日：2019-02-05

申请号：US15612880

申请日：2017-06-02

Applicant: Apple Inc.

Inventor： Mei Guo ,  Jun Xin ,  Yeping Su ,  Chris Y. Chung ,  Xiaosong Zhou ,  Hsi-Jung Wu

IPC: H04N19/117 ,  H04N19/136 ,  H04N19/186 ,  H04N19/46 ,  H04N19/157 ,  H04N19/80

Abstract: Methods of sample adaptive offset (SAO) for high dynamic range (HDR) video compression are disclosed. For band offset (BO), the sample range of each component is unequally divided into a number of bands based on the distribution of samples, the electro-optical transfer function (EOTF) of HDR source and one perceptually uniform EOTF. Each component may have a different number of bands, different number of signaled bands, and different range value for signaled offsets in BO mode. For edge offset (EO), Cb and Cr may use separate syntax elements. In the sample classification for EO, the difference between the current sample and its neighbor is compared with a threshold to determine whether it is a local valley, a local peak, or corners. A distortion measure for HDR source images are also disclosed.

公开(公告)号：US20190014332A1

公开(公告)日：2019-01-10

申请号：US15644270

申请日：2017-07-07

Applicant: Apple Inc.

Inventor： Peikang Song ,  Xing Wen ,  Sudeng Hu ,  Hang Yuan ,  Jae Hoon Kim ,  Dazhong Zhang ,  Xiaosong Zhou ,  Hsi-Jung Wu

IPC: H04N19/23 ,  H04N19/124 ,  H04N19/70 ,  H04N19/85 ,  H04N19/174 ,  H04N19/80 ,  H04N19/147

Abstract: Techniques for encoding and decoding video images based on image content types are described. Techniques include determining a plurality of image content types from metadata or an image content type recognition algorithm, where each image content type corresponding to a portion of a source video, such as a spatial or temporal portion. Encoding parameters, such as quantization parameter, may be selected for portions of source by a constrained search for encoding parameters, where the constraints are based on image content type.

公开(公告)号：US20180324326A1

公开(公告)日：2018-11-08

申请号：US16034272

申请日：2018-07-12

Applicant: Apple Inc.

Inventor： Alexandros Michael Tourapis ,  Yeping Su ,  David William Singer ,  Hsi-Jung Wu

IPC: H04N1/60 ,  H04N19/85 ,  H04N19/186 ,  H04N9/67 ,  H04N19/46

CPC classification number: H04N1/6005 ,  H04N1/6058 ,  H04N9/67 ,  H04N19/186 ,  H04N19/46 ,  H04N19/85

Abstract: Image and video processing techniques are disclosed for processing components of a color space individually by determining limits for each component based on the relationship between each component in a color space. These limits may then be used to clip each component such that the component values are within the determined range for that component. In this manner, more efficient processing of images and/or video may be achieved.

公开(公告)号：US10070143B2

公开(公告)日：2018-09-04

申请号：US15168872

申请日：2016-05-31

Applicant: Apple Inc.

Inventor： Dazhong Zhang ,  Jae Hoon Kim ,  Peikang Song ,  Xiaosong Zhou ,  Chris Chung ,  Hsi-Jung Wu

IPC: H04N19/46 ,  H04N19/68 ,  H04L5/00 ,  H04L29/06 ,  H04L12/741

CPC classification number: H04N19/46 ,  H04L5/0055 ,  H04L45/745 ,  H04L65/602 ,  H04L65/607 ,  H04L65/608 ,  H04L65/80 ,  H04N19/68

Abstract: Coding and decoding techniques are disclosed in which a plurality of coding parameter sets is transmitted between an encoder and a decoder, each of which is distinguishable from the others by a respective identifier. When a new frame of video is to be coded, an encoder may identify a coding parameter set to be applied during coding, it may code the new frame according to the identified coding parameter set, and it may transmit the coded frame to the decoder along with an identifier of the coding parameter set used during the coding. A plurality of coding parameter sets is persistent at an encoder and the decoder simultaneously.

公开(公告)号：US10063810B2

公开(公告)日：2018-08-28

申请号：US15368371

申请日：2016-12-02

Applicant: Apple Inc.

Inventor： Xiaosong Zhou ,  Hsi-Jung Wu ,  Chris Y. Chung ,  James O. Normile ,  Joe S. Abuan ,  Hyeonkuk Jeong ,  Yan Yang ,  Gobind Johar ,  Thomas Jansen

IPC: H04N7/15 ,  H04N7/14 ,  H04L29/06 ,  H04L12/58

CPC classification number: H04N7/147 ,  H04L51/04 ,  H04L51/10 ,  H04L65/1069 ,  H04N7/15

Abstract: Computing devices may implement instant video communication connections for video communications. Connection information for mobile computing devices may be maintained. A request to initiate an instant video communication may be received, and if authorized, the connection information for the particular recipient mobile computing device may be accessed. Video communication data may then be sent to the recipient mobile computing device according to the connection information so that the video communication data may be displayed at the recipient device as it is received. New connection information for different mobile computing devices may be added, or updates to existing connection information may also be performed. Connection information for some mobile computing devices may be removed.