公开(公告)号：US20190004414A1

公开(公告)日：2019-01-03

申请号：US15638848

申请日：2017-06-30

Applicant: Apple Inc.

Inventor： Jae Hoon Kim ,  Ming Chen ,  Xiaosong Zhou ,  Hsi-Jung Wu ,  Dazhong Zhang ,  Hang Yuan ,  Jiefu Zhai ,  Chris Y. Chung

IPC: G03B37/04 ,  G06T3/40 ,  H04N5/232 ,  H04N13/02 ,  H04N19/172 ,  H04N19/159

Abstract: Techniques are described for implementing format configurations for multi-directional video and for switching between them. Source images may be assigned to formats that may change during a coding session. When a change occurs between formats, video coders and decoder may transform decoded reference frames from the first format to the second format. Thereafter, new frames in the second configuration may be coded or decoded predictively using transformed reference frame(s) as source(s) of prediction. In this manner, video coders and decoders may use intra-coding techniques and achieve high efficiency in coding.

公开(公告)号：US10136033B2

公开(公告)日：2018-11-20

申请号：US15650750

申请日：2017-07-14

Applicant: Apple Inc.

Inventor： Alexandros Michael Tourapis ,  Yeping Su ,  David William Singer ,  Hsi-Jung Wu

IPC: H04N1/60 ,  H04N9/67 ,  H04N19/186 ,  H04N19/46 ,  H04N19/85

Abstract: Image and video processing techniques are disclosed for processing components of a color space individually by determining limits for each component based on the relationship between each component in a color space. These limits may then be used to clip each component such that the component values are within the determined range for that component. In this manner, more efficient processing of images and/or video may be achieved.

公开(公告)号：US20180262714A1

公开(公告)日：2018-09-13

申请号：US15455890

申请日：2017-03-10

Applicant: Apple Inc.

Inventor： Jae Hoon Kim ,  Chris Y. Chung ,  Dazhong Zhang ,  Hang Yuan ,  Hsi-Jung Wu ,  Xiaosong Zhou ,  Jiefu Zhai

IPC: H04N7/14 ,  H04N7/15 ,  G06T7/194 ,  G06F3/0488

CPC classification number: H04N7/147 ,  G06F3/0488 ,  H04N7/15 ,  H04N13/239 ,  H04N2007/145 ,  H04N2013/0092

Abstract: Embodiments of the present disclosure provide systems and methods for perspective shifting in a video conferencing session. In one exemplary method, a video stream may be generated. A foreground element may be identified in a frame of the video stream and distinguished from a background element of the frame. Data may be received representing a viewing condition at a terminal that will display the generated video stream. The frame of the video stream may be modified based on the received data to shift of the foreground element relative to the background element. The modified video stream may be displayed at the displaying terminal.

公开(公告)号：US20180234700A1

公开(公告)日：2018-08-16

申请号：US15433505

申请日：2017-02-15

Applicant: Apple Inc.

Inventor： Jae Hoon Kim ,  Chris Y. Chung ,  Dazhong Zhang ,  Hang Yuan ,  Hsi-Jung Wu ,  Jiefu Zhai ,  Xiaosong Zhou

IPC: H04N19/597 ,  H04N19/61 ,  H04N19/105 ,  H04N19/513 ,  H04N19/159 ,  H04N19/124 ,  H04N19/13

Abstract: Multi-directional image data often contains distortions of image content that cause problems when processed by video coders that are designed to process traditional, “flat” image content. Embodiments of the present disclosure provide techniques for coding multi-directional image data using such coders. For each pixel block in a frame to be coded, an encoder may transform reference picture data within a search window about a location of the input pixel block based on displacement respectively between the location of the input pixel block and portions of the reference picture within the search window. The encoder may perform a prediction search among the transformed reference picture data to identify a match between the input pixel block and a portion of the transformed reference picture and, when a match is identified, the encoder may code the input pixel block differentially with respect to the matching portion of the transformed reference picture. The transform may counter-act distortions imposed on image content of the reference picture data by the multi-directional format, which aligns the content with image content of the input picture. The techniques apply both for intra-coding and inter-coding.

公开(公告)号：US10021411B2

公开(公告)日：2018-07-10

申请号：US14704707

申请日：2015-05-05

Applicant: Apple Inc.

Inventor： Yeping Su ,  Chris Y. Chung ,  Hsi-Jung Wu ,  Jiefu Zhai ,  Ke Zhang ,  Xiaosong Zhou

IPC: H04N7/12 ,  H04N19/503 ,  H04N19/124 ,  H04N19/172 ,  H04N19/147 ,  H04N19/30

CPC classification number: H04N19/503 ,  H04N19/124 ,  H04N19/147 ,  H04N19/172 ,  H04N19/30

Abstract: A scalable coding system codes video as a base layer representation and an enhancement layer representation. A base layer coder may code an LDR representation of a source video. A predictor may predict an HDR representation of the source video from the coded base layer data. A comparator may generate prediction residuals which represent a difference between an HDR representation of the source video and the predicted HDR representation of the source video. A quantizer may quantize the residuals down to an LDR representation. An enhancement layer coder may code the LDR residuals. In other scalable coding systems, the enhancement layer coder may code LDR-converted HDR video directly.

公开(公告)号：US09992499B2

公开(公告)日：2018-06-05

申请号：US14190880

申请日：2014-02-26

Applicant: Apple Inc.

Inventor： Yeping Su ,  Hao Pan ,  James O. Normile ,  Hsi-Jung Wu

IPC: H04N19/152 ,  H04N19/142 ,  H04N19/87 ,  H04N21/234 ,  H04N21/24 ,  H04N21/44 ,  H04N21/2343 ,  H04N21/845

CPC classification number: H04N19/152 ,  H04N19/142 ,  H04N21/23418 ,  H04N21/23424 ,  H04N21/23439 ,  H04N21/2402 ,  H04N21/44004 ,  H04N21/44008 ,  H04N21/8456

Abstract: Systems and methods are presented for minimizing the suddenness and immediacy of changes to the video quality perceived by users due to bandwidth fluctuations and transitions between different bitrate streams. A method may include identifying an upcoming bitrate change in a bitstream and a nearest scene cut boundary from sync frame scene cut tags included in the bitstream. The method may include calculating whether waiting until the identified nearest scene cut boundary before changing the bitrate will cause the buffer to drop below a threshold. When the buffer is calculated to not drop below the threshold, the method may postpone the upcoming bitrate change until the identified nearest scene cut boundary.

公开(公告)号：US09992450B1

公开(公告)日：2018-06-05

申请号：US15468919

申请日：2017-03-24

Applicant: Apple Inc.

Inventor： Hang Yuan ,  Chris Y. Chung ,  Dazhong Zhang ,  Hsi-Jung Wu ,  Xiaosong Zhou ,  Jae Hoon Kim ,  Jiefu Zhai

IPC: H04N7/14 ,  H04N7/15 ,  H04N5/262 ,  G06K9/00 ,  G06K9/46

CPC classification number: G06K9/4604 ,  G06K9/00711 ,  G06K2009/4666 ,  H04N5/262 ,  H04N7/147

Abstract: Embodiments of the present disclosure provide systems and methods for background concealment in a video conferencing session. In one exemplary method, a video stream may be captured and provided to a first terminal participating in a video chat session. A background element and a foreground element may be determined in the video stream. A border region may additionally be determined in the video stream. The border region may define a boundary between the foreground element and the background element. The background region may be modified based, at least in part, on video content of the border region. The modified video stream may be transmitted to a second terminal participating in the video conferencing session.

公开(公告)号：US20180091812A1

公开(公告)日：2018-03-29

申请号：US15275076

申请日：2016-09-23

Applicant: Apple Inc.

Inventor： Mei Guo ,  Jae Hoon Kim ,  Jun Xin ,  Feng Yi ,  Yeping Su ,  Dazhong Zhang ,  Chris Chung ,  Xiaosong Zhou ,  Hsi-Jung Wu

IPC: H04N19/117 ,  H04N19/86 ,  H04N19/14 ,  H04N19/15 ,  H04N19/61 ,  H04N19/124 ,  H04N19/13 ,  H04N19/159

CPC classification number: H04N19/117 ,  H04N19/124 ,  H04N19/13 ,  H04N19/134 ,  H04N19/136 ,  H04N19/14 ,  H04N19/15 ,  H04N19/159 ,  H04N19/174 ,  H04N19/176 ,  H04N19/182 ,  H04N19/184 ,  H04N19/186 ,  H04N19/61 ,  H04N19/82 ,  H04N19/86

Abstract: Techniques are disclosed for selecting deblocking filter parameters in a video decoding system. According to these techniques, a boundary strength parameter may be determined based, at least in part, on a bit depth of decoded video data. Activity of a pair of decoded pixel blocks may be classified based, at least in part, on the determined boundary strength parameter, and when a level of activity indicates that deblocking filtering is to be applied to the pair of pixel blocks, pixel block content at a boundary between the pair of pixel blocks may be filtered using filtering parameters derived at least in part based on the bit depth of the decoded video data. The filtering parameters may decrease strength with increasing bit depth of the decoded video data, which improves quality of the decoded video data.

公开(公告)号：US20180091811A1

公开(公告)日：2018-03-29

申请号：US15618693

申请日：2017-06-09

Applicant: Apple Inc.

Inventor： Thomas Pun ,  Paul Chang ,  Hsi-Jung Wu

IPC: H04N19/105 ,  H04N19/436 ,  H04N19/44 ,  H04N19/157 ,  H04N19/61 ,  H04N19/102 ,  H04N19/46 ,  H04N19/176 ,  H04N19/52 ,  H04N19/182 ,  H04N19/134

CPC classification number: H04N19/105 ,  H04N19/102 ,  H04N19/134 ,  H04N19/157 ,  H04N19/176 ,  H04N19/182 ,  H04N19/436 ,  H04N19/44 ,  H04N19/46 ,  H04N19/52 ,  H04N19/61

Abstract: A method for decoding a compressed video data sequence containing one or more coded pixel blocks. The compressed video sequence is buffered. Prediction information for each of the coded pixel blocks is reviewed. One or more groups of coded pixel blocks are formed based on the reviewed prediction information such that the coded pixel blocks within a given group have similar prediction dependencies and/or at least do not depend on a reconstructed pixel within a group of received pixel blocks to enable parallel decoding. The formed groups are scheduled for processing and subsequently decoded to produce a decoded video data sequence.

公开(公告)号：US09860485B2

公开(公告)日：2018-01-02

申请号：US14968025

申请日：2015-12-14

Applicant: Apple Inc.

Inventor： Chris Y. Chung ,  Wen Zhao ,  Luciano M. Verger ,  Hyeonkuk Jeong ,  Gang Lu ,  Srinivasan Vasudevan ,  Xiaosong Zhou ,  Hsi-Jung Wu ,  James O. Normile

IPC: H04N7/15 ,  H04W52/02 ,  H04L29/06 ,  H04N5/232 ,  H04N5/372 ,  H04L12/18

CPC classification number: H04N7/15 ,  H04L12/1827 ,  H04L65/1069 ,  H04N5/23241 ,  H04N5/372 ,  H04W52/02 ,  H04W52/0209 ,  H04W52/0216 ,  Y02D70/00 ,  Y02D70/1224 ,  Y02D70/1242 ,  Y02D70/1262 ,  Y02D70/142 ,  Y02D70/144 ,  Y02D70/146 ,  Y02D70/164 ,  Y02D70/168 ,  Y02D70/24

Abstract: In video conferencing over a radio network, the radio equipment is a major power consumer especially in cellular networks such as LTE. In order to reduce the radio power consumption in video conferencing, it is important to introduce an enough radio inactive time. Several types of data buffering and bundling can be employed within a reasonable range of latency that doesn't significantly disrupt the real-time nature of video conferencing. In addition, the data transmission can be synchronized to the data reception in a controlled manner, which can result in an even longer radio inactive time and thus take advantage of radio power saving modes such as LTE C-DRX.