公开(公告)号：US10911992B2

公开(公告)日：2021-02-02

申请号：US16145055

申请日：2018-09-27

Applicant: Apple Inc.

Inventor： Joe S. Abuan ,  Ian J. Baird ,  Xiaosong Zhou ,  Christopher M. Garrido ,  Dazhong Zhang ,  Keith W. Rauenbuehler ,  Yan Yang ,  Patrick Miauton ,  Eric L. Chien ,  Berkat S. Tung ,  Karthick Santhanam

IPC: H04W72/12 ,  H04W36/00 ,  H04L29/08 ,  H04W4/08 ,  H04L29/06 ,  H04W12/04 ,  H04W12/06 ,  G06F9/48 ,  H04W36/02 ,  H04L12/18 ,  H04L9/08 ,  H04B17/318 ,  H04B17/336

Abstract: A device implementing the subject technology may include at least one processor configured to receive a plurality of buffer reports from a plurality of other devices, each of the plurality of buffer reports indicating a current target buffer level for a respective one of the plurality of other devices. The at least one processor may be further configured to determine a group target buffer level based at least in part on the current target buffer levels of the plurality of other devices and a current target buffer level of the at least one buffer. The at least one processor may be further configured to transmit the group target buffer level to the plurality of other devices. The at least one processor may be further configured to manage an occupancy of the at least one buffer based at least in part on the group target buffer level.

公开(公告)号：US10715833B2

公开(公告)日：2020-07-14

申请号：US14289082

申请日：2014-05-28

Applicant: Apple Inc.

Inventor： Yunfei Zheng ,  Dazhong Zhang ,  Xiaosong Zhou ,  Chris Y. Chung ,  Hsi-Jung Wu

IPC: H04N19/70

Abstract: An encoding system may include a video source that captures video image, a video coder, and a controller to manage operation of the system. The video coder may encode the video image into encoded video data using a plurality of subgroup parameters corresponding to a plurality of subgroups of pixels within a group. The controller may set the subgroup parameters for at least one of the subgroups of pixels in the video coder, based upon at least one parameters corresponding to the group. A decoding system may decode the video data based upon the motion prediction parameters.

公开(公告)号：US20200213571A1

公开(公告)日：2020-07-02

申请号：US16725245

申请日：2019-12-23

Applicant: Apple Inc.

Inventor： Jae Hoon Kim ,  Ming Chen ,  Xiaosong Zhou ,  Hsi-Jung Wu ,  Dazhong Zhang ,  Hang Yuan ,  Jiefu Zhai ,  Chris Y. Chung

IPC: H04N13/161 ,  H04N13/243 ,  H04N5/232 ,  H04N19/70 ,  H04N19/597

Abstract: Frame packing techniques are disclosed for multi-directional images and video. According to an embodiment, a multi-directional source image is reformatted into a format in which image data from opposing fields of view are represented in respective regions of the packed image as flat image content. Image data from a multi-directional field of view of the source image between the opposing fields of view are represented in another region of the packed image as equirectangular image content. It is expected that use of the formatted frame will lead to coding efficiencies when the formatted image is processed by predictive video coding techniques and the like.

公开(公告)号：US10432946B2

公开(公告)日：2019-10-01

申请号：US14964965

申请日：2015-12-10

Applicant: Apple Inc.

Inventor： Yeping Su ,  Chris Y. Chung ,  Hsi-Jung Wu ,  Xiaosong Zhou ,  Jiefu Zhai

IPC: H04N7/12 ,  H04N19/154 ,  H04N19/115 ,  H04N19/137 ,  H04N19/187 ,  H04N19/177 ,  H04N7/01 ,  H04N19/117 ,  H04N19/31 ,  H04N19/587 ,  H04N19/46 ,  H04N19/85

Abstract: Judder artifacts are remedied in video coding system by employing frame rate conversion at an encoder. A source video sequence may be coded as base layer coded video at a first frame rate. An encoder may identify a portion of the coded video sequence that likely will exhibit judder effects when decoded. For those portions that likely will exhibit judder effects, video data representing the portion of the source video may be coded at a higher frame rate than a frame rate of the coded base layer data as enhancement layer data. Moreover, an encoder may generate metadata representing “FRC hints”—techniques that a decoder should employ when performing decoder-side frame rate conversion. An encoding terminal may transmit the base layer coded video and either the enhancement layer coded video or the FRC hints to a decoder. Thus, encoder infrastructure may mitigate against judder artifacts that may arise during decoding.

公开(公告)号：US20190005709A1

公开(公告)日：2019-01-03

申请号：US15638587

申请日：2017-06-30

Applicant: Apple Inc.

Inventor： Jae Hoon Kim ,  Dazhong Zhang ,  Hang Yuan ,  Hsi-Jung Wu ,  Jiefu Zhai ,  Ming Chen ,  Xiaosong Zhou

IPC: G06T15/20 ,  H04N13/02 ,  H04N5/232 ,  H04N19/117

Abstract: Techniques are disclosed for correcting artifacts in multi-view images that include a plurality of planar views. Image content the planar views may be projected from the planar representation to a spherical projection. Thereafter, a portion of the image content may be projected from the spherical projection to a planar representation. The image content of the planar representation may be used for display. Extensions are disclosed that correct artifacts that may arise during deblocking filtering of the multi-view images.

公开(公告)号：US20190004414A1

公开(公告)日：2019-01-03

申请号：US15638848

申请日：2017-06-30

Applicant: Apple Inc.

Inventor： Jae Hoon Kim ,  Ming Chen ,  Xiaosong Zhou ,  Hsi-Jung Wu ,  Dazhong Zhang ,  Hang Yuan ,  Jiefu Zhai ,  Chris Y. Chung

IPC: G03B37/04 ,  G06T3/40 ,  H04N5/232 ,  H04N13/02 ,  H04N19/172 ,  H04N19/159

Abstract: Techniques are described for implementing format configurations for multi-directional video and for switching between them. Source images may be assigned to formats that may change during a coding session. When a change occurs between formats, video coders and decoder may transform decoded reference frames from the first format to the second format. Thereafter, new frames in the second configuration may be coded or decoded predictively using transformed reference frame(s) as source(s) of prediction. In this manner, video coders and decoders may use intra-coding techniques and achieve high efficiency in coding.

公开(公告)号：US20180262714A1

公开(公告)日：2018-09-13

申请号：US15455890

申请日：2017-03-10

Applicant: Apple Inc.

Inventor： Jae Hoon Kim ,  Chris Y. Chung ,  Dazhong Zhang ,  Hang Yuan ,  Hsi-Jung Wu ,  Xiaosong Zhou ,  Jiefu Zhai

IPC: H04N7/14 ,  H04N7/15 ,  G06T7/194 ,  G06F3/0488

CPC classification number: H04N7/147 ,  G06F3/0488 ,  H04N7/15 ,  H04N13/239 ,  H04N2007/145 ,  H04N2013/0092

Abstract: Embodiments of the present disclosure provide systems and methods for perspective shifting in a video conferencing session. In one exemplary method, a video stream may be generated. A foreground element may be identified in a frame of the video stream and distinguished from a background element of the frame. Data may be received representing a viewing condition at a terminal that will display the generated video stream. The frame of the video stream may be modified based on the received data to shift of the foreground element relative to the background element. The modified video stream may be displayed at the displaying terminal.

公开(公告)号：US20180234700A1

公开(公告)日：2018-08-16

申请号：US15433505

申请日：2017-02-15

Applicant: Apple Inc.

Inventor： Jae Hoon Kim ,  Chris Y. Chung ,  Dazhong Zhang ,  Hang Yuan ,  Hsi-Jung Wu ,  Jiefu Zhai ,  Xiaosong Zhou

IPC: H04N19/597 ,  H04N19/61 ,  H04N19/105 ,  H04N19/513 ,  H04N19/159 ,  H04N19/124 ,  H04N19/13

Abstract: Multi-directional image data often contains distortions of image content that cause problems when processed by video coders that are designed to process traditional, “flat” image content. Embodiments of the present disclosure provide techniques for coding multi-directional image data using such coders. For each pixel block in a frame to be coded, an encoder may transform reference picture data within a search window about a location of the input pixel block based on displacement respectively between the location of the input pixel block and portions of the reference picture within the search window. The encoder may perform a prediction search among the transformed reference picture data to identify a match between the input pixel block and a portion of the transformed reference picture and, when a match is identified, the encoder may code the input pixel block differentially with respect to the matching portion of the transformed reference picture. The transform may counter-act distortions imposed on image content of the reference picture data by the multi-directional format, which aligns the content with image content of the input picture. The techniques apply both for intra-coding and inter-coding.

公开(公告)号：US10021411B2

公开(公告)日：2018-07-10

申请号：US14704707

申请日：2015-05-05

Applicant: Apple Inc.

Inventor： Yeping Su ,  Chris Y. Chung ,  Hsi-Jung Wu ,  Jiefu Zhai ,  Ke Zhang ,  Xiaosong Zhou

IPC: H04N7/12 ,  H04N19/503 ,  H04N19/124 ,  H04N19/172 ,  H04N19/147 ,  H04N19/30

CPC classification number: H04N19/503 ,  H04N19/124 ,  H04N19/147 ,  H04N19/172 ,  H04N19/30

Abstract: A scalable coding system codes video as a base layer representation and an enhancement layer representation. A base layer coder may code an LDR representation of a source video. A predictor may predict an HDR representation of the source video from the coded base layer data. A comparator may generate prediction residuals which represent a difference between an HDR representation of the source video and the predicted HDR representation of the source video. A quantizer may quantize the residuals down to an LDR representation. An enhancement layer coder may code the LDR residuals. In other scalable coding systems, the enhancement layer coder may code LDR-converted HDR video directly.

公开(公告)号：US20180160072A1

公开(公告)日：2018-06-07

申请号：US15725868

申请日：2017-10-05

Applicant: Apple Inc.

Inventor： Elizabeth C. Cranfill ,  Stephen O. Lemay ,  Joe S. Abuan ,  Hsi-Jung WO ,  Xiaosong Zhou ,  Roberto Garcia

IPC: H04N7/14 ,  H04N7/15 ,  H04N5/272 ,  G06F3/0484 ,  H04N5/225 ,  G09G5/14 ,  H04N5/262

Abstract: Some embodiments provide a method for initiating a video conference using a first mobile device. The method presents, during an audio call through a wireless communication network with a second device, a selectable user-interface (UI) item on the first mobile device for switching from the audio call to the video conference. The method receives a selection of the selectable UI item. The method initiates the video conference without terminating the audio call. The method terminates the audio call before allowing the first and second devices to present audio and video data exchanged through the video conference.