公开(公告)号：US20130329781A1

公开(公告)日：2013-12-12

申请号：US13631605

申请日：2012-09-28

Applicant: APPLE INC.

Inventor： Yeping Su ,  Hsi-Jung Wu ,  Hao Pan ,  Ke Zhang

IPC: H04N7/26

CPC classification number: H04N19/10 ,  H04N21/23424 ,  H04N21/23439 ,  H04N21/242 ,  H04N21/8456

Abstract: A vide coding server may code a common video sequence into a plurality of coded data streams, each coded data stream representing the video sequence coded using coding parameters tailored for a respective transmission bit rate. The coding may cause a set of transmission units from among the coded data streams to include coded video data from a common point of the video sequence, and a first coded frame of each transmission unit of the set to be a synchronization frame. A manifest file may be built representing an index of transmission units of the respective coded data streams. The coded data streams and manifest file may be stored by the server for delivery to a client device. During download and decode, the chunks may be decoded efficiently even when switching among streams because the first frame in each chunk is a synchronization frame.

Abstract translation: 视频编码服务器可以将公共视频序列编码为多个编码数据流，每个编码数据流表示使用针对相应传输比特率定制的编码参数进行编码的视频序列。 编码可以使得编码数据流中的一组传输单元包括来自视频序列的公共点的编码视频数据和作为同步帧的组的每个传输单元的第一编码帧。 可以构建表示相应编码数据流的传输单元的索引的清单文件。 编码数据流和清单文件可以由服务器存储以传送到客户端设备。 在下载和解码期间，即使在每个块中的第一帧是同步帧时，即使切换流之间也可以有效地解码该块。

公开(公告)号：US20130235942A1

公开(公告)日：2013-09-12

申请号：US13631428

申请日：2012-09-28

Applicant: APPLE INC.

Inventor： Yeping Su ,  Hao Pan ,  Ke Zhang ,  Douglas Scott Price ,  James Oliver Normile ,  Hsi-Jung Wu

IPC: H04N7/26

CPC classification number: H04N19/577 ,  H04N19/107 ,  H04N19/117 ,  H04N19/124 ,  H04N19/139 ,  H04N19/149 ,  H04N19/15 ,  H04N19/154 ,  H04N19/156 ,  H04N19/172 ,  H04N19/192 ,  H04N19/46 ,  H04N19/58

Abstract: Video coding systems and methods protect against banding artifacts in decoded image content. According to the method, a video coder may identify, from content of pixel blocks of a frame of video data, which pixel blocks are likely to exhibit banding artifacts from the video coding/decoding processes. The video coder may assemble regions of the frame that are likely to exhibit banding artifacts based on the identified pixel blocks' locations with respect to each other. The video coder may apply anti-banding processing to pixel blocks within one or more of the identified regions and, thereafter, may code the processed frame by a compression operation.

Abstract translation: 视频编码系统和方法保护解码图像内容中的带状伪像。 根据该方法，视频编码器可以根据视频数据帧的像素块的内容从视频编码/解码处理中识别哪些像素块可能呈现带状伪影。 视频编码器可以基于所识别的像素块相对于彼此的位置来组合可能呈现带状伪影的帧的区域。 视频编码器可以对所识别的一个或多个区域内的像素块应用反绑带处理，然后可以通过压缩操作来对经处理的帧进行编码。

公开(公告)号：US20250080726A1

公开(公告)日：2025-03-06

申请号：US18819841

申请日：2024-08-29

Applicant: Apple Inc.

Inventor： Hilmi Enes Egilmez ,  Alexandros Tourapis ,  Alican Nalci ,  Guoxin Jin ,  Hsi-Jung Wu ,  Jun Xin ,  Yeqing Wu ,  Yixin Du ,  Yunfei Zheng

IPC: H04N19/107 ,  H04N19/124 ,  H04N19/13 ,  H04N19/17 ,  H04N19/70

Abstract: Systems and methods are configured for accessing data representing video content, the data comprising a set of one or more symbols each associated with a syntax element; performing a probability estimation, for encoding the data, comprising: for each symbol, obtaining, based on the syntax element for that symbol, an adaptivity rate parameter value, the adaptivity rate parameter value being a function of a number of symbols in the set of one or more symbols; updating the adaptivity rate parameter value as a function of an adjustment parameter value; and generating, based on the updated adaptivity rate parameter value, a probability value; generating a probability estimation; and encoding, based on the CDF of the probability estimation, the data comprising the set of one or more symbols for transmission.

公开(公告)号：US11924391B2

公开(公告)日：2024-03-05

申请号：US18083468

申请日：2022-12-16

Applicant: Apple Inc.

Inventor： Fanyi Duanmu ,  Jun Xin ,  Hsi-Jung Wu ,  Xiaosong Zhou

IPC: H04N13/117 ,  H04N13/178 ,  H04N21/218 ,  H04N21/24

CPC classification number: H04N13/117 ,  H04N13/178 ,  H04N21/21805 ,  H04N21/2401 ,  H04N21/2402

Abstract: A system obtains a data set representing immersive video content for display at a display time, including first data representing the content according to a first level of detail, and second data representing the content according to a second higher level of detail. During one or more first times prior to the display time, the system causes at least a portion of the first data to be stored in a buffer. During one or more second times prior to the display time, the system generates a prediction of a viewport for displaying the content to a user at the display time, identifies a portion of the second data corresponding to the prediction of the viewport, and causes the identified portion of the second data to be stored in the video buffer. At the display time, the system causes the content to be displayed to the user using the video buffer.

公开(公告)号：US11847823B2

公开(公告)日：2023-12-19

申请号：US17339249

申请日：2021-06-04

Applicant: Apple Inc.

Inventor： Xiaoxia Sun ,  Jiefu Zhai ,  Ke Zhang ,  Xiaosong Zhou ,  Hsi-Jung Wu

IPC: G06V10/82 ,  G06T3/40 ,  G06V40/20 ,  G06V20/40 ,  G06N3/045 ,  G06V10/25 ,  G06V20/20 ,  G06V40/10

CPC classification number: G06V10/82 ,  G06N3/045 ,  G06T3/40 ,  G06V10/25 ,  G06V20/20 ,  G06V20/46 ,  G06V40/113 ,  G06V40/28

Abstract: Video object and keypoint location detection techniques are presented. The system includes a detection system for generation locations of an object's keypoints along with probabilities associated with the locations, and a stability system for stabilizing keypoint locations of the detected objects. In some aspects, the generated probabilities are two-dimensional array correspond locations within input images, and stability system fits the generated probabilities to a two-dimensional probability distribution function.

公开(公告)号：US11818502B2

公开(公告)日：2023-11-14

申请号：US17846896

申请日：2022-06-22

Applicant: Apple Inc.

Inventor： Jae Hoon Kim ,  Chris Y. Chung ,  Dazhong Zhang ,  Hang Yuan ,  Hsi-Jung Wu ,  Xiaosong Zhou ,  Jiefu Zhai

IPC: H04N7/14 ,  H04N7/15 ,  G06F3/0488 ,  H04N13/00 ,  H04N13/239

CPC classification number: H04N7/147 ,  G06F3/0488 ,  H04N7/15 ,  H04N13/239 ,  H04N2007/145 ,  H04N2013/0092

Abstract: Embodiments of the present disclosure provide systems and methods for perspective shifting in a video conferencing session. In one exemplary method, a video stream may be generated. A foreground element may be identified in a frame of the video stream and distinguished from a background element of the frame. Data may be received representing a viewing condition at a terminal that will display the generated video stream. The frame of the video stream may be modified based on the received data to shift of the foreground element relative to the background element. The modified video stream may be displayed at the displaying terminal.

公开(公告)号：US11677934B2

公开(公告)日：2023-06-13

申请号：US17485298

申请日：2021-09-24

Applicant: Apple Inc.

Inventor： Sudeng Hu ,  David L. Biderman ,  Christopher M. Garrido ,  Hsi-Jung Wu ,  Xiaosong Zhou ,  Dazhong Zhang ,  Jinbo Qiu ,  Karthick Santhanam ,  Hang Yuan ,  Joshua L. Hare ,  Luciano M. Verger ,  Kevin Arthur Robertson ,  Sasanka Vemuri

IPC: H04N7/12 ,  H04N19/105 ,  H04N19/177 ,  H04N19/172 ,  H04N19/146 ,  H04N19/124

CPC classification number: H04N19/105 ,  H04N19/124 ,  H04N19/146 ,  H04N19/172 ,  H04N19/177

Abstract: In an example method, a system receives a plurality of frames of a video, and generates a data structure representing the video and representing a plurality of temporal layers. Generating the data structure includes: (i) determining a plurality of quality levels for presenting the video, where each of the quality levels corresponds to a different respective sampling period for sampling the frames of the video, (ii) assigning, based on the sampling periods, each of the frames to a respective one of the temporal layers of the data structure, and (iii) indicating, in the data structure, one or more relationships between (a) at least one the frames assigned to at least one of the temporal layers of the data structure, and (b) at least another one of the frames assigned to at least another one of the temporal layers of the data structure. Further, the system outputs the data structure.

公开(公告)号：US20230147442A1

公开(公告)日：2023-05-11

申请号：US17831738

申请日：2022-06-03

Applicant: Apple Inc.

Inventor： Shujie Liu ,  Jiefu Zhai ,  Xiaosong Zhou ,  Hsi-Jung Wu ,  Ke Zhang ,  Xiaoxia Sun ,  Jian Li

IPC: G06N3/045

CPC classification number: G06N3/045

Abstract: In an example method, a system accesses first input data and a machine learning architecture. The machine learning architecture includes a first module having a first neural network, a second module having a second neural network, and a third module having a third neural network. The system generates a first feature set representing a first portion of the first input data using the first neural network, and a second feature set representing a second portion of the first input data using the second neural network. The system generates, using the third neural network, first output data based on the first feature set and the second feature set.

公开(公告)号：US20230098082A1

公开(公告)日：2023-03-30

申请号：US17485298

申请日：2021-09-24

Applicant: Apple Inc.

Inventor： Sudeng Hu ,  David L. Biderman ,  Christopher M. Garrido ,  Hsi-Jung Wu ,  Xiaosong Zhou ,  Dazhong Zhang ,  Jinbo Qiu ,  Karthick Santhanam ,  Hang Yuan ,  Joshua L. Hare ,  Luciano M. Verger ,  Kevin Arthur Robertson ,  Sasanka Vemuri

IPC: H04N19/105 ,  H04N19/177 ,  H04N19/124 ,  H04N19/146 ,  H04N19/172

Abstract: In an example method, a system receives a plurality of frames of a video, and generates a data structure representing the video and representing a plurality of temporal layers. Generating the data structure includes: (i) determining a plurality of quality levels for presenting the video, where each of the quality levels corresponds to a different respective sampling period for sampling the frames of the video, (ii) assigning, based on the sampling periods, each of the frames to a respective one of the temporal layers of the data structure, and (iii) indicating, in the data structure, one or more relationships between (a) at least one the frames assigned to at least one of the temporal layers of the data structure, and (b) at least another one of the frames assigned to at least another one of the temporal layers of the data structure. Further, the system outputs the data structure.

公开(公告)号：US11606574B2

公开(公告)日：2023-03-14

申请号：US16882819

申请日：2020-05-26

Applicant: Apple Inc.

Inventor： Dazhong Zhang ,  Peikang Song ,  Beibei Wang ,  Giribalan Gopalan ,  Albert E. Keinath ,  Christopher M. Garrido ,  David R. Conrad ,  Hsi-Jung Wu ,  Ming Jin ,  Hang Yuan ,  Xiaohua Yang ,  Xiaosong Zhou ,  Vikrant Kasarabada ,  Davide Concion ,  Eric L. Chien ,  Bess C. Chan ,  Karthick Santhanam ,  Gurtej Singh Chandok

IPC: H04N19/507 ,  H04N19/65

Abstract: Techniques are disclosed for coding video data in which frames from a video source are partitioned into a plurality of tiles of common size, and the tiles are coded as a virtual video sequence according to motion-compensated prediction, each tile treated as having respective temporal location of the virtual video sequence. The coding scheme permits relative allocation of coding resources to tiles that are likely to have greater significance in a video coding session, which may lead to certain tiles that have low complexity or low motion content to be skipped during coding of the tiles for select source frames. Moreover, coding of the tiles may be ordered to achieve low coding latencies during a coding session.