公开(公告)号：US20230269400A1

公开(公告)日：2023-08-24

申请号：US18181261

申请日：2023-03-09

Applicant: Apple Inc.

Inventor： Xiaohua YANG ,  Alexandros TOURAPIS ,  Dazhong ZHANG ,  Hang YUAN ,  Hsi-Jung WU ,  Jae Hoon KIM ,  Jiefu ZHAI ,  Ming CHEN ,  Xiaosong ZHOU

IPC: H04N19/90 ,  H04N19/52 ,  H04N19/597 ,  G06F3/01 ,  H04N21/2343

CPC classification number: H04N19/90 ,  H04N19/52 ,  H04N19/597 ,  G06F3/013 ,  H04N21/234345

Abstract: In communication applications, aggregate source image data at a transmitter exceeds the data that is needed to display a rendering of a viewport at a receiver. Improved streaming techniques that include estimating a location of a viewport at a future time. According to such techniques, the viewport may represent a portion of an image from a multi-directional video to be displayed at the future time, and tile(s) of the image may be identified in which the viewport is estimated to be located. In these techniques, the image data of tile(s) in which the viewport is estimated to be located may be requested at a first service tier, and the other tile in which the viewport is not estimated to be located may be requested at a second service tier, lower than the first service tier.

公开(公告)号：US20200304807A1

公开(公告)日：2020-09-24

申请号：US16879007

申请日：2020-05-20

Applicant: Apple Inc.

Inventor： Alexandros Michael TOURAPIS ,  Yeping SU ,  David SINGER ,  Hsi-Jung WU

IPC: H04N19/159 ,  H04N19/567 ,  H04N19/147 ,  H04N19/109 ,  H04N19/176 ,  H04N19/513 ,  H04N19/70

Abstract: The present disclosure describes techniques for coding and decoding video in which a plurality of coding hypotheses are developed for an input pixel block of frame content. Each coding hypothesis may include generation of prediction data for the input pixel block according to a respective prediction search. The input pixel block may be coded with reference to a prediction block formed from prediction data derived according to plurality of hypotheses. Data of the coded pixel block may be transmitted to a decoder along with data identifying a number of the hypotheses used during the coding to a channel. At a decoder, an inverse process may be performed, which may include generation of a counterpart prediction block from prediction data derived according to the hypothesis identified with the coded pixel block data, then decoding of the coded pixel block according to the prediction data.

公开(公告)号：US20160353118A1

公开(公告)日：2016-12-01

申请号：US15169072

申请日：2016-05-31

Applicant: Apple Inc.

Inventor： Dazhong ZHANG ,  Hsi-Jung WU ,  Peikang SONG ,  Yunfei ZHENG ,  Chris Y. CHUNG ,  Jae Hoon KIM ,  Xiaosong ZHOU

IPC: H04N19/184 ,  H04N19/44 ,  H04N19/37 ,  H04N19/40

CPC classification number: H04N19/44 ,  H04N19/85

Abstract: A method of managing resources on a terminal includes determining a number of downloaded video streams active at the terminal, prioritizing the active video streams, assigning a decoding quality level to each active video stream based on a priority assignment for each active video stream, and apportioning reception bandwidth to each active video stream based on an assigned quality level of each active video stream.

Abstract translation: 一种在终端上管理资源的方法包括：确定在终端处活动的下载的视频流的数量，对活动视频流进行优先排序，基于每个活动视频流的优先级分配向每个活动视频流分配解码质量等级，以及分配 基于每个活动视频流的分配质量水平对每个活动视频流的接收带宽。

公开(公告)号：US20240129472A1

公开(公告)日：2024-04-18

申请号：US18468900

申请日：2023-09-18

Applicant: Apple Inc.

Inventor： Yeqing WU ,  Yunfei ZHENG ,  Alican NALCI ,  Yixin DU ,  Hilmi Enes EGILMEZ ,  Guoxin JIN ,  Alexandros TOURAPIS ,  Jun XIN ,  Hsi-Jung WU

IPC: H04N19/13 ,  H04N19/129 ,  H04N19/176

CPC classification number: H04N19/13 ,  H04N19/129 ,  H04N19/176

Abstract: Improved lossless entropy coding techniques for coding of image data include selecting a context for entropy coding based on an ordered scan path of possible context locations. A symbol for a current location within a source image may be entropy coded based on a context of prior encoded symbols of other locations within source images, where the context is selected based on an ordered scan path enumerating a series of potential context locations within one or more source images. To select a context, a predetermined number of prior symbols may be selected by qualifying or disqualifying locations in the scan path, and then the current symbol may be encoded with a context based on prior symbols corresponding to the first qualifying context locations in the order of the scan path.

公开(公告)号：US20230143147A1

公开(公告)日：2023-05-11

申请号：US17979027

申请日：2022-11-02

Applicant: Apple Inc.

Inventor： Yixin DU ,  Alexandros TOURAPIS ,  Yunfei ZHENG ,  Jun XIN ,  Alican NALCI ,  Mei T. GUO ,  Yeqing WU ,  Hsi-Jung WU

IPC: H04N19/82 ,  H04N19/186 ,  H04N19/70

CPC classification number: H04N19/82 ,  H04N19/70 ,  H04N19/186

Abstract: A cross-component based filtering system is disclosed for video coders and decoders. The filtering system may include a filter having an input for a filter offset and an input for samples reconstructed from coded video data representing a native component of source video on which the filter operates. The offset may be generated at least in part from a sample classifier that classifies samples reconstructed from coded video data representing a color component of the source video orthogonal to the native component according to sample intensity.

公开(公告)号：US20230007272A1

公开(公告)日：2023-01-05

申请号：US17894309

申请日：2022-08-24

Applicant: Apple Inc.

Inventor： Alexandros Michael TOURAPIS ,  Yeping SU ,  David SINGER ,  Hsi-Jung WU

IPC: H04N19/159 ,  H04N19/567 ,  H04N19/147 ,  H04N19/109 ,  H04N19/176 ,  H04N19/513 ,  H04N19/70

Abstract: The present disclosure describes techniques for coding and decoding video in which a plurality of coding hypotheses are developed for an input pixel block of frame content. Each coding hypothesis may include generation of prediction data for the input pixel block according to a respective prediction search. The input pixel block may be coded with reference to a prediction block formed from prediction data derived according to plurality of hypotheses. Data of the coded pixel block may be transmitted to a decoder along with data identifying a number of the hypotheses used during the coding to a channel. At a decoder, an inverse process may be performed, which may include generation of a counterpart prediction block from prediction data derived according to the hypothesis identified with the coded pixel block data, then decoding of the coded pixel block according to the prediction data.

公开(公告)号：US20220191473A1

公开(公告)日：2022-06-16

申请号：US17568266

申请日：2022-01-04

Applicant: Apple Inc.

Inventor： Jiefu ZHAI ,  Xingyu ZHANG ,  Xiaosong ZHOU ,  Jun XIN ,  Hsi-Jung WU ,  Yeping SU

IPC: H04N19/105 ,  H04N19/147 ,  H04N19/159 ,  H04N19/176 ,  H04N19/61 ,  G06N3/08

Abstract: Systems and methods disclosed for video compression, utilizing neural networks for predictive video coding. Processes employed combine multiple banks of neural networks with codec system components to carry out the coding and decoding of video data.

公开(公告)号：US20210397826A1

公开(公告)日：2021-12-23

申请号：US17339249

申请日：2021-06-04

Applicant: Apple Inc.

Inventor： Xiaoxia SUN ,  Jiefu ZHAI ,  Ke ZHANG ,  Xiaosong ZHOU ,  Hsi-Jung WU

IPC: G06K9/00 ,  G06K9/46 ,  G06T3/40 ,  G06N3/04

Abstract: Video object and keypoint location detection techniques are presented. The system includes a detection system for generation locations of an object's keypoints along with probabilities associated with the locations, and a stability system for stabilizing keypoint locations of the detected objects. In some aspects, the generated probabilities are two-dimensional array correspond locations within input images, and stability system fits the generated probabilities to a two-dimensional probability distribution function.

公开(公告)号：US20200382806A1

公开(公告)日：2020-12-03

申请号：US16882819

申请日：2020-05-26

Applicant: Apple Inc.

Inventor： Dazhong ZHANG ,  Peikang SONG ,  Beibei WANG ,  Giribalan GOPALAN ,  Albert E. KEINATH ,  Christopher M. GARRIDO ,  David R. CONRAD ,  Hsi-Jung WU ,  Ming JIN ,  Hang YUAN ,  Xiaohua YANG ,  Xiaosong ZHOU ,  Vikrant KASARABADA ,  Davide CONCION ,  Eric L. CHIEN ,  Bess C. CHAN ,  Karthick SANTHANAM ,  Gurtej Singh CHANDOK

IPC: H04N19/507 ,  H04N19/65

Abstract: Techniques are disclosed for coding video data in which frames from a video source are partitioned into a plurality of tiles of common size, and the tiles are coded as a virtual video sequence according to motion-compensated prediction, each tile treated as having respective temporal location of the virtual video sequence. The coding scheme permits relative allocation of coding resources to tiles that are likely to have greater significance in a video coding session, which may lead to certain tiles that have low complexity or low motion content to be skipped during coding of the tiles for select source frames. Moreover, coding of the tiles may be ordered to achieve low coding latencies during a coding session.

公开(公告)号：US20140269932A1

公开(公告)日：2014-09-18

申请号：US13800905

申请日：2013-03-13

Applicant: Apple Inc.

Inventor： Yeping SU ,  Chris Y. CHUNG ,  Xiaosong ZHOU ,  James Oliver NORMILE ,  Hsi-Jung WU ,  Thomas JANSEN ,  Hyeonkuk JEONG ,  Joe S. ABUAN ,  Douglas Scott PRICE

IPC: H04N7/26

CPC classification number: H04N21/234372 ,  H04N21/23439 ,  H04N21/2381 ,  H04N21/4384 ,  H04N21/44004

Abstract: A video streaming method for transitioning between multiple sequences of coded video data may include receiving and decoding transmission units from a first sequence of coded video data. In response to a request to transition to a second sequence of coded video data, the method may determine whether a time to transition to the second sequence of coded video data can be reduced by transitioning to the second sequence of coded video data via an intermediate sequence of coded video data. If the time can be reduced, the method may include receiving at least one transmission unit from an intermediate sequence of coded video data that corresponds to the request to transition, decoding the transmission unit from the intermediate sequence, and transitioning from the first sequence to the second sequence via the decoded transmission unit from the intermediate sequence.

Abstract translation: 用于在多个编码视频数据序列之间转换的视频流方法可以包括从第一编码视频数据序列接收和解码传输单元。 响应于转换到第二编码视频数据序列的请求，该方法可以通过经由中间序列转换到第二编码视频数据序列来确定是否可以减少转换到第二编码视频数据序列的时间 的编码视频数据。 如果可以减少时间，则该方法可以包括从与转换请求对应的编码视频数据的中间序列接收至少一个传输单元，从中间序列解码传输单元，以及从第一序列转换到 通过来自中间序列的解码传输单元的第二序列。