公开(公告)号：US20230269400A1

公开(公告)日：2023-08-24

申请号：US18181261

申请日：2023-03-09

Applicant: Apple Inc.

Inventor： Xiaohua YANG ,  Alexandros TOURAPIS ,  Dazhong ZHANG ,  Hang YUAN ,  Hsi-Jung WU ,  Jae Hoon KIM ,  Jiefu ZHAI ,  Ming CHEN ,  Xiaosong ZHOU

IPC: H04N19/90 ,  H04N19/52 ,  H04N19/597 ,  G06F3/01 ,  H04N21/2343

CPC classification number: H04N19/90 ,  H04N19/52 ,  H04N19/597 ,  G06F3/013 ,  H04N21/234345

Abstract: In communication applications, aggregate source image data at a transmitter exceeds the data that is needed to display a rendering of a viewport at a receiver. Improved streaming techniques that include estimating a location of a viewport at a future time. According to such techniques, the viewport may represent a portion of an image from a multi-directional video to be displayed at the future time, and tile(s) of the image may be identified in which the viewport is estimated to be located. In these techniques, the image data of tile(s) in which the viewport is estimated to be located may be requested at a first service tier, and the other tile in which the viewport is not estimated to be located may be requested at a second service tier, lower than the first service tier.

公开(公告)号：US20200304807A1

公开(公告)日：2020-09-24

申请号：US16879007

申请日：2020-05-20

Applicant: Apple Inc.

Inventor： Alexandros Michael TOURAPIS ,  Yeping SU ,  David SINGER ,  Hsi-Jung WU

IPC: H04N19/159 ,  H04N19/567 ,  H04N19/147 ,  H04N19/109 ,  H04N19/176 ,  H04N19/513 ,  H04N19/70

Abstract: The present disclosure describes techniques for coding and decoding video in which a plurality of coding hypotheses are developed for an input pixel block of frame content. Each coding hypothesis may include generation of prediction data for the input pixel block according to a respective prediction search. The input pixel block may be coded with reference to a prediction block formed from prediction data derived according to plurality of hypotheses. Data of the coded pixel block may be transmitted to a decoder along with data identifying a number of the hypotheses used during the coding to a channel. At a decoder, an inverse process may be performed, which may include generation of a counterpart prediction block from prediction data derived according to the hypothesis identified with the coded pixel block data, then decoding of the coded pixel block according to the prediction data.

公开(公告)号：US20160353118A1

公开(公告)日：2016-12-01

申请号：US15169072

申请日：2016-05-31

Applicant: Apple Inc.

Inventor： Dazhong ZHANG ,  Hsi-Jung WU ,  Peikang SONG ,  Yunfei ZHENG ,  Chris Y. CHUNG ,  Jae Hoon KIM ,  Xiaosong ZHOU

IPC: H04N19/184 ,  H04N19/44 ,  H04N19/37 ,  H04N19/40

CPC classification number: H04N19/44 ,  H04N19/85

Abstract: A method of managing resources on a terminal includes determining a number of downloaded video streams active at the terminal, prioritizing the active video streams, assigning a decoding quality level to each active video stream based on a priority assignment for each active video stream, and apportioning reception bandwidth to each active video stream based on an assigned quality level of each active video stream.

Abstract translation: 一种在终端上管理资源的方法包括：确定在终端处活动的下载的视频流的数量，对活动视频流进行优先排序，基于每个活动视频流的优先级分配向每个活动视频流分配解码质量等级，以及分配 基于每个活动视频流的分配质量水平对每个活动视频流的接收带宽。

公开(公告)号：US20250159164A9

公开(公告)日：2025-05-15

申请号：US18056915

申请日：2022-11-18

Applicant: APPLE INC.

Inventor： Alexandros TOURAPIS ,  Yeping SU ,  David SINGER ,  Hsi-Jung WU

IPC: H04N19/124 ,  H04N19/176 ,  H04N19/18 ,  H04N19/60 ,  H04N19/91

Abstract: Video compression and decompression techniques are disclosed that provide improved bandwidth control for video compression and decompression systems. In particular, video coding and decoding techniques quantize input video in multiple dimensions. According to these techniques, pixel residuals may be generated from a comparison of an array of input data to an array of prediction data. The pixel residuals may be quantized in a first dimension. After the quantization, the quantized pixel residuals may be transformed to an array of transform coefficients. The transform coefficients may be quantized in a second dimension and entropy coded. Decoding techniques invert these processes. In still other embodiments, multiple quantizers may be provided upstream of the transform stage, either in parallel or in cascade, which provide greater flexibility to video coders to quantize data in different dimensions in an effort to balance the competing interest in compression efficiency and quality of reconstructed video.

公开(公告)号：US20250080759A1

公开(公告)日：2025-03-06

申请号：US18794601

申请日：2024-08-05

Applicant: APPLE INC.

Inventor： Guoxin JIN ,  Yeqing WU ,  Yunfei ZHENG ,  Dazhong ZHANG ,  Dzung T. HOANG ,  Felix C. FERNANDES ,  Van Luong PHAM ,  Jiancong LUO ,  Yixin DU ,  Hilmi Enes EGILMEZ ,  Alican NALCI ,  Jun XIN ,  Hsi-Jung WU

IPC: H04N19/176 ,  H04N19/117 ,  H04N19/159 ,  H04N19/46 ,  H04N19/70 ,  H04N19/82

Abstract: Techniques are disclosed for coding video in applications where regions of video are inactive on a frame to frame basis. According to the techniques, coding processes update and reconstruct only a subset of pixel blocks of pixels within a frame, while other pixel blocks are retained from a previously coded frame stored in a coder's or decoder's reference frame buffer. The technique is called Backward Reference Updating (or “BRU”) for convenience. At a desired pixel block granularity, based on the activity between a current frame to be coded and its reference frame(s), BRU will only perform prediction, transform, quantization, and reconstruction on selected regions that are determined to be active. The reconstructed pixels in these active regions are directly placed onto a specified reference frame in memory instead of creating a new frame. Therefore, fewer memory transfers need to be performed.

公开(公告)号：US20240397119A1

公开(公告)日：2024-11-28

申请号：US18797415

申请日：2024-08-07

Applicant: Apple Inc.

Inventor： Xiaohua YANG ,  Alexandros TOURAPIS ,  Dazhong ZHANG ,  Hang YUAN ,  Hsi-Jung WU ,  Jae Hoon KIM ,  Jiefu ZHAI ,  Ming CHEN ,  Xiaosong ZHOU

IPC: H04N19/90 ,  G06F3/01 ,  H04N19/52 ,  H04N19/597 ,  H04N21/2343

Abstract: In communication applications, aggregate source image data at a transmitter exceeds the data that is needed to display a rendering of a viewport at a receiver. Improved streaming techniques that include estimating a location of a viewport at a future time. According to such techniques, the viewport may represent a portion of an image from a multi-directional video to be displayed at the future time, and tile(s) of the image may be identified in which the viewport is estimated to be located. In these techniques, the image data of tile(s) in which the viewport is estimated to be located may be requested at a first service tier, and the other tile in which the viewport is not estimated to be located may be requested at a second service tier, lower than the first service tier.

公开(公告)号：US20240073438A1

公开(公告)日：2024-02-29

申请号：US18452194

申请日：2023-08-18

Applicant: Apple Inc.

Inventor： Yeqing WU ,  Yunfei ZHENG ,  Guoxin JIN ,  Yixin DU ,  Alican NALCI ,  Hilmi Enes EGILMEZ ,  Jun XIN ,  Hsi-Jung WU

IPC: H04N19/513 ,  H04N19/176

CPC classification number: H04N19/513 ,  H04N19/176

Abstract: Techniques are disclosed for improved video coding with virtual reference frames. A motion vector for prediction of a pixel block from a reference may be constrained based on the reference. In as aspect, if the reference is a temporally interpolated virtual reference frame with corresponding time close to the time of the current pixel block, the motion vector for prediction may be constrained magnitude and/or precision. In another aspect, a bitstream syntax for encoding the constrained motion vector may also be constrained. In this manner, the techniques proposed herein contribute to improved coding efficiencies.

公开(公告)号：US20230394081A1

公开(公告)日：2023-12-07

申请号：US18327125

申请日：2023-06-01

Applicant: Apple Inc.

Inventor： Shujie LIU ,  Xiaosong ZHOU ,  Hsi-Jung WU ,  Jiefu ZHAI ,  Ke ZHANG ,  Ming CHEN

IPC: G06F16/783 ,  G06T7/62 ,  G06F16/75

CPC classification number: G06F16/7837 ,  G06T7/62 ,  G06F16/75

Abstract: A video classification, indexing, and retrieval system is disclosed that classifies and retrieves video along multiple indexing dimensions. A search system may field queries identifying desired parameters of video, search an indexed database for videos that match the query parameters, and create clips extracted from responsive videos that are provided in response. In this manner, different queries may cause different clips to be created from a single video, each clip tailored to the parameters of the query that is received.

公开(公告)号：US20230300341A1

公开(公告)日：2023-09-21

申请号：US18157360

申请日：2023-01-20

Applicant: APPLE INC.

Inventor： Yeqing WU ,  Yunfei ZHENG ,  Alexandros TOURAPIS ,  Alican NALCI ,  Yixin DU ,  Hilmi Enes EGILMEZ ,  Albert E. KEINATH ,  Jun XIN ,  Hsi-Jung WU

IPC: H04N19/139 ,  H04N19/176

CPC classification number: H04N19/139 ,  H04N19/176

Abstract: Techniques are disclosed for generating virtual reference frames that may be used for prediction of input video frames. The virtual reference frames may be derived from already-coded reference frames and thereby incur reduced signaling overhead. Moreover, signaling of virtual reference frames may be avoided until an encoder selects the virtual reference frame as a prediction reference for a current frame. In this manner, the techniques proposed herein contribute to improved coding efficiencies.

公开(公告)号：US20230262196A1

公开(公告)日：2023-08-17

申请号：US18140449

申请日：2023-04-27

Applicant: Apple Inc.

Inventor： Elizabeth C. CRANFILL ,  Stephen O. LEMAY ,  Joe S. ABUAN ,  Hsi-Jung WU ,  Xiaosong ZHOU ,  Roberto GARCIA, JR.

IPC: H04N7/14 ,  G09G5/14 ,  G06F3/04886 ,  G06F9/451 ,  G06F3/04812 ,  G06F3/0482 ,  G06F3/0486 ,  G06F3/0488 ,  H04M1/72469 ,  H04N23/45 ,  H04N7/15 ,  G06F3/04842 ,  H04N5/262 ,  H04N5/272 ,  G06F3/04817

CPC classification number: H04N7/141 ,  G09G5/14 ,  H04N7/147 ,  G06F3/04886 ,  G06F9/451 ,  G06F3/04812 ,  G06F3/0482 ,  G06F3/0486 ,  G06F3/0488 ,  H04M1/72469 ,  H04N23/45 ,  H04N7/15 ,  G06F3/04842 ,  H04N5/2624 ,  H04N5/272 ,  G06F3/04817

Abstract: Some embodiments provide a method for initiating a video conference using a first mobile device. The method presents, during an audio call through a wireless communication network with a second device, a selectable user-interface (UI) item on the first mobile device for switching from the audio call to the video conference. The method receives a selection of the selectable UI item. The method initiates the video conference without terminating the audio call. The method terminates the audio call before allowing the first and second devices to present audio and video data exchanged through the video conference.