公开(公告)号：US20210185361A1

公开(公告)日：2021-06-17

申请号：US17188473

申请日：2021-03-01

Applicant: Apple Inc.

Inventor： Xiaohua YANG ,  Alexandros TOURAPIS ,  Dazhong ZHANG ,  Hang YUAN ,  Hsi-Jung WU ,  Jae Hoon KIM ,  Jiefu ZHAI ,  Ming CHEN ,  Xiaosong ZHOU

IPC: H04N19/90 ,  H04N19/52 ,  H04N19/597 ,  G06F3/01 ,  H04N21/2343

Abstract: In communication applications, aggregate source image data at a transmitter exceeds the data that is needed to display a rendering of a viewport at a receiver. Improved streaming techniques that include estimating a location of a viewport at a future time. According to such techniques, the viewport may represent a portion of an image from a multi-directional video to be displayed at the future time, and tile(s) of the image may be identified in which the viewport is estimated to be located. In these techniques, the image data of tile(s) in which the viewport is estimated to be located may be requested at a first service tier, and the other tile in which the viewport is not estimated to be located may be requested at a second service tier, lower than the first service tier.

公开(公告)号：US20210099507A1

公开(公告)日：2021-04-01

申请号：US16825381

申请日：2020-03-20

Applicant: Apple Inc.

Inventor： Fanyi DUANMU ,  Alexandros TOURAPIS ,  Jun XIN ,  Hsi-Jung WU ,  Xiaosong ZHOU

IPC: H04L29/06 ,  H04N13/344 ,  H04N13/161 ,  H04N13/194 ,  H04N13/111

Abstract: Techniques for multi-view video streaming are described in the present disclosure, wherein a viewport prediction may be employed at a client-end based on analysis of pre-fetched media item data and ancillary information. A streaming method may first prefetch a portion of content of a multi-view media item. The method may next identify a salient region from the prefetched content and may then download additional content of the media item that corresponds to the identified salient region.

公开(公告)号：US20210084332A1

公开(公告)日：2021-03-18

申请号：US16569725

申请日：2019-09-13

Applicant: Apple Inc.

Inventor： Fanyi DUANMU ,  Eduardo ASBUN ,  Xiaosong ZHOU ,  Jun XIN ,  Hsi-Jung WU ,  John SU ,  Samir GEHANI ,  Christopher FLICK ,  Shalini SAHOO

IPC: H04N19/597 ,  H04N19/176 ,  H04N19/187

Abstract: Techniques are disclosed for coding and delivering multi-view video in which the video is represented as a manifest file identifying a plurality of segments of the video available for download. The multi-view video may be partitioned spatially into a plurality of tiles that, in aggregate, encompass the entire spatial area of the video. The tiles are coded as segments contains coded video representing content contained within its respective tile. Tiles may be given different sizes based on saliency of the content within their respective regions. In this manner, tiles with high levels of interest may have relatively large spatial areas, which can lead to efficient coding in the presence of content motion.

公开(公告)号：US20210076054A1

公开(公告)日：2021-03-11

申请号：US16561478

申请日：2019-09-05

Applicant: Apple Inc.

Inventor： Mei GUO ,  Jun XIN ,  Yeping SU ,  Hsi-Jung WU ,  Alexandros TOURAPIS

IPC: H04N19/44 ,  H04N19/159 ,  H04N19/46 ,  H04N19/172 ,  H04N19/177

Abstract: Techniques for video exchange are disclosed in which a video source sends redundant copies of video coded at a given presentation time. A decoder may determine, from metadata stored with a first decoded frame, whether other decoded frames have been designated as correlated to the first decoded frame. If so, the decoder may fetch other decoding frames using time indicator values of other decoded frames in metadata stored with the first decoded frame. When other decoded frame(s) are found, the decoder may blend content of the first coded frame and the other decoded frame(s). The decoder may render the blended frame. When one such coded frame is an intra-coded frame, the proposed technique may alleviate beating artifacts by blending recovered data of the intra-coded frame with recovered data of another frame, which may be inter-coded.

公开(公告)号：US20190246114A1

公开(公告)日：2019-08-08

申请号：US16257904

申请日：2019-01-25

Applicant: Apple Inc.

Inventor： Alexandros Michael TOURAPIS ,  Yeping SU ,  David SINGER ,  Hsi-Jung WU

IPC: H04N19/159 ,  H04N19/513 ,  H04N19/70 ,  H04N19/176

CPC classification number: H04N19/159 ,  H04N19/109 ,  H04N19/147 ,  H04N19/176 ,  H04N19/513 ,  H04N19/567 ,  H04N19/70

Abstract: The present disclosure describes techniques for coding and decoding video in which a plurality of coding hypotheses are developed for an input pixel block of frame content. Each coding hypothesis may include generation of prediction data for the input pixel block according to a respective prediction search. The input pixel block may be coded with reference to a prediction block formed from prediction data derived according to plurality of hypotheses. Data of the coded pixel block may be transmitted to a decoder along with data identifying a number of the hypotheses used during the coding to a channel. At a decoder, an inverse process may be performed, which may include generation of a counterpart prediction block from prediction data derived according to the hypothesis identified with the coded pixel block data, then decoding of the coded pixel block according to the prediction data.

公开(公告)号：US20190068992A1

公开(公告)日：2019-02-28

申请号：US16173105

申请日：2018-10-29

Applicant: Apple Inc.

Inventor： Alexandros TOURAPIS ,  David W. SINGER ,  Haitao GUO ,  Hsi-Jung WU ,  Sorin C. CISMAS ,  Xiaohua YANG ,  Yeping SU ,  Dazhong ZHANG

IPC: H04N19/593 ,  H04N19/174 ,  H04N19/156 ,  H04N19/176 ,  H04N19/182 ,  H04N19/117

Abstract: Methods are described for encoding and decoding blocks of image data using intra block copying (IBC). A source block for intra block copying is selected from a source region of a current image that is closer to the current block than a threshold, wherein the source region does not include a portion of the current image that is further from the current block than the threshold.

公开(公告)号：US20140241415A1

公开(公告)日：2014-08-28

申请号：US14190880

申请日：2014-02-26

Applicant: Apple Inc.

Inventor： Yeping SU ,  Hao PAN ,  James O. NORMILE ,  Hsi-Jung WU

IPC: H04N19/152 ,  H04N19/142

CPC classification number: H04N19/152 ,  H04N19/142 ,  H04N21/23418 ,  H04N21/23424 ,  H04N21/23439 ,  H04N21/2402 ,  H04N21/44004 ,  H04N21/44008 ,  H04N21/8456

Abstract: Systems and methods are presented for minimizing the suddenness and immediacy of changes to the video quality perceived by users due to bandwidth fluctuations and transitions between different bitrate streams. A method may include identifying an upcoming bitrate change in a bitstream and a nearest scene cut boundary from sync frame scene cut tags included in the bitstream. The method may include calculating whether waiting until the identified nearest scene cut boundary before changing the bitrate will cause the buffer to drop below a threshold. When the buffer is calculated to not drop below the threshold, the method may postpone the upcoming bitrate change until the identified nearest scene cut boundary.

Abstract translation: 提出了系统和方法，用于最小化由于带宽波动和不同比特率流之间的转换而使用户感知到的视频质量的突变和即时性。 一种方法可以包括从比特流中包括的同步帧场景切换标签中识别比特流中的即将到来的比特率变化和最近的场景剪切边界。 该方法可以包括计算是否在更改比特率之前等待直到所识别的最近的场景切割边界将导致缓冲器降低到阈值以下。 当缓冲区被计算为不低于阈值时，该方法可以推迟即将到来的比特率改变直到所识别的最近的场景切割边界。

公开(公告)号：US20140029846A1

公开(公告)日：2014-01-30

申请号：US13664359

申请日：2012-10-30

Applicant: APPLE INC.

Inventor： Yeping SU ,  Jiefu ZHAI ,  James Oliver NORMILE ,  Hsi-Jung WU ,  Hao PAN

IPC: G09G5/02

CPC classification number: G09G3/2048 ,  G09G3/2066 ,  G09G2340/06 ,  G09G2350/00

Abstract: YCbCr image data may be dithered and converted into RGB data shown on a 8-bit or other bit display. Dither methods and image processors are provided which generate the banding artifact free image data during this process. Some methods and image processors may applying a stronger dither having a same mean with a larger variance to the image data before it is converted to RGB data. Others methods and image processors may calculate a quantization or encoding error and diffuse the calculated error among one or more neighboring pixel blocks.

Abstract translation: YCbCr图像数据可以抖动并转换成8位或其他位显示器上显示的RGB数据。 提供抖动方法和图像处理器，其在该处理期间产生无带纹带图像数据。 一些方法和图像处理器可以在将图像数据转换成RGB数据之前，对图像数据应用具有相同平均值的较强抖动。 其他方法和图像处理器可以计算量化或编码误差并且在一个或多个相邻像素块之间扩展所计算的误差。