公开(公告)号：US20250080759A1

公开(公告)日：2025-03-06

申请号：US18794601

申请日：2024-08-05

Applicant: APPLE INC.

Inventor： Guoxin JIN ,  Yeqing WU ,  Yunfei ZHENG ,  Dazhong ZHANG ,  Dzung T. HOANG ,  Felix C. FERNANDES ,  Van Luong PHAM ,  Jiancong LUO ,  Yixin DU ,  Hilmi Enes EGILMEZ ,  Alican NALCI ,  Jun XIN ,  Hsi-Jung WU

IPC: H04N19/176 ,  H04N19/117 ,  H04N19/159 ,  H04N19/46 ,  H04N19/70 ,  H04N19/82

Abstract: Techniques are disclosed for coding video in applications where regions of video are inactive on a frame to frame basis. According to the techniques, coding processes update and reconstruct only a subset of pixel blocks of pixels within a frame, while other pixel blocks are retained from a previously coded frame stored in a coder's or decoder's reference frame buffer. The technique is called Backward Reference Updating (or “BRU”) for convenience. At a desired pixel block granularity, based on the activity between a current frame to be coded and its reference frame(s), BRU will only perform prediction, transform, quantization, and reconstruction on selected regions that are determined to be active. The reconstructed pixels in these active regions are directly placed onto a specified reference frame in memory instead of creating a new frame. Therefore, fewer memory transfers need to be performed.

公开(公告)号：US20240397119A1

公开(公告)日：2024-11-28

申请号：US18797415

申请日：2024-08-07

Applicant: Apple Inc.

Inventor： Xiaohua YANG ,  Alexandros TOURAPIS ,  Dazhong ZHANG ,  Hang YUAN ,  Hsi-Jung WU ,  Jae Hoon KIM ,  Jiefu ZHAI ,  Ming CHEN ,  Xiaosong ZHOU

IPC: H04N19/90 ,  G06F3/01 ,  H04N19/52 ,  H04N19/597 ,  H04N21/2343

Abstract: In communication applications, aggregate source image data at a transmitter exceeds the data that is needed to display a rendering of a viewport at a receiver. Improved streaming techniques that include estimating a location of a viewport at a future time. According to such techniques, the viewport may represent a portion of an image from a multi-directional video to be displayed at the future time, and tile(s) of the image may be identified in which the viewport is estimated to be located. In these techniques, the image data of tile(s) in which the viewport is estimated to be located may be requested at a first service tier, and the other tile in which the viewport is not estimated to be located may be requested at a second service tier, lower than the first service tier.

公开(公告)号：US20240073438A1

公开(公告)日：2024-02-29

申请号：US18452194

申请日：2023-08-18

Applicant: Apple Inc.

Inventor： Yeqing WU ,  Yunfei ZHENG ,  Guoxin JIN ,  Yixin DU ,  Alican NALCI ,  Hilmi Enes EGILMEZ ,  Jun XIN ,  Hsi-Jung WU

IPC: H04N19/513 ,  H04N19/176

CPC classification number: H04N19/513 ,  H04N19/176

Abstract: Techniques are disclosed for improved video coding with virtual reference frames. A motion vector for prediction of a pixel block from a reference may be constrained based on the reference. In as aspect, if the reference is a temporally interpolated virtual reference frame with corresponding time close to the time of the current pixel block, the motion vector for prediction may be constrained magnitude and/or precision. In another aspect, a bitstream syntax for encoding the constrained motion vector may also be constrained. In this manner, the techniques proposed herein contribute to improved coding efficiencies.

公开(公告)号：US20230394081A1

公开(公告)日：2023-12-07

申请号：US18327125

申请日：2023-06-01

Applicant: Apple Inc.

Inventor： Shujie LIU ,  Xiaosong ZHOU ,  Hsi-Jung WU ,  Jiefu ZHAI ,  Ke ZHANG ,  Ming CHEN

IPC: G06F16/783 ,  G06T7/62 ,  G06F16/75

CPC classification number: G06F16/7837 ,  G06T7/62 ,  G06F16/75

Abstract: A video classification, indexing, and retrieval system is disclosed that classifies and retrieves video along multiple indexing dimensions. A search system may field queries identifying desired parameters of video, search an indexed database for videos that match the query parameters, and create clips extracted from responsive videos that are provided in response. In this manner, different queries may cause different clips to be created from a single video, each clip tailored to the parameters of the query that is received.

公开(公告)号：US20230300341A1

公开(公告)日：2023-09-21

申请号：US18157360

申请日：2023-01-20

Applicant: APPLE INC.

Inventor： Yeqing WU ,  Yunfei ZHENG ,  Alexandros TOURAPIS ,  Alican NALCI ,  Yixin DU ,  Hilmi Enes EGILMEZ ,  Albert E. KEINATH ,  Jun XIN ,  Hsi-Jung WU

IPC: H04N19/139 ,  H04N19/176

CPC classification number: H04N19/139 ,  H04N19/176

Abstract: Techniques are disclosed for generating virtual reference frames that may be used for prediction of input video frames. The virtual reference frames may be derived from already-coded reference frames and thereby incur reduced signaling overhead. Moreover, signaling of virtual reference frames may be avoided until an encoder selects the virtual reference frame as a prediction reference for a current frame. In this manner, the techniques proposed herein contribute to improved coding efficiencies.

公开(公告)号：US20230262196A1

公开(公告)日：2023-08-17

申请号：US18140449

申请日：2023-04-27

Applicant: Apple Inc.

Inventor： Elizabeth C. CRANFILL ,  Stephen O. LEMAY ,  Joe S. ABUAN ,  Hsi-Jung WU ,  Xiaosong ZHOU ,  Roberto GARCIA, JR.

IPC: H04N7/14 ,  G09G5/14 ,  G06F3/04886 ,  G06F9/451 ,  G06F3/04812 ,  G06F3/0482 ,  G06F3/0486 ,  G06F3/0488 ,  H04M1/72469 ,  H04N23/45 ,  H04N7/15 ,  G06F3/04842 ,  H04N5/262 ,  H04N5/272 ,  G06F3/04817

CPC classification number: H04N7/141 ,  G09G5/14 ,  H04N7/147 ,  G06F3/04886 ,  G06F9/451 ,  G06F3/04812 ,  G06F3/0482 ,  G06F3/0486 ,  G06F3/0488 ,  H04M1/72469 ,  H04N23/45 ,  H04N7/15 ,  G06F3/04842 ,  H04N5/2624 ,  H04N5/272 ,  G06F3/04817

Abstract: Some embodiments provide a method for initiating a video conference using a first mobile device. The method presents, during an audio call through a wireless communication network with a second device, a selectable user-interface (UI) item on the first mobile device for switching from the audio call to the video conference. The method receives a selection of the selectable UI item. The method initiates the video conference without terminating the audio call. The method terminates the audio call before allowing the first and second devices to present audio and video data exchanged through the video conference.

公开(公告)号：US20230142771A1

公开(公告)日：2023-05-11

申请号：US17979025

申请日：2022-11-02

Applicant: Apple Inc.

Inventor： Yixin DU ,  Alexandros TOURAPIS ,  Yunfei ZHENG ,  Jun XIN ,  Mukta S. Gore ,  Alican NALCI ,  Mei T. GUO ,  Yeqing WU ,  Hsi-Jung WU

IPC: H04N19/82 ,  H04N19/132 ,  H04N19/186 ,  H04N19/176

CPC classification number: H04N19/82 ,  H04N19/132 ,  H04N19/186 ,  H04N19/176

Abstract: A filtering system for video coders and decoders is disclosed that includes a feature detector having an input for samples reconstructed from coded video data representing a color component of source video, and having an output for data identifying a feature recognized therefrom, an offset calculator having an input for the feature identification data from the feature detector and having an output for a filter offset, and a filter having an input for the filter offset from the offset calculator and an input for the reconstructed samples, and having an output for filtered samples. The filtering system is expected to improve operations of video coder/decoder filtering systems by selecting filtering offsets from analysis of recovered video data in a common color plane as the samples that will be filtered.

公开(公告)号：US20200236349A1

公开(公告)日：2020-07-23

申请号：US16254528

申请日：2019-01-22

Applicant: Apple Inc.

Inventor： Jiefu ZHAI ,  Xingyu ZHANG ,  Xiaosong ZHOU ,  Jun XIN ,  Hsi-Jung WU ,  Yeping SU

IPC: H04N19/105 ,  H04N19/147 ,  H04N19/159 ,  H04N19/176 ,  H04N19/61 ,  G06N3/08

Abstract: Systems and methods disclosed for video compression, utilizing neural networks for predictive video coding. Processes employed combine multiple banks of neural networks with codec system components to carry out the coding and decoding of video data.

公开(公告)号：US20200120345A1

公开(公告)日：2020-04-16

申请号：US16156193

申请日：2018-10-10

Applicant: Apple Inc.

Inventor： Mei GUO ,  Jun XIN ,  Jun XU ,  Yeping SU ,  Chris CHUNG ,  Xiaosong ZHOU ,  Hsi-Jung WU

IPC: H04N19/186 ,  H04N19/12 ,  H04N19/136 ,  H04N19/51

Abstract: Systems and methods are disclosed for reshaping HDR video content to improve compression efficiency while using standard encoding/decoding techniques. Input HDR video frames, e.g., represented in an IPT color space, may be reshaped before the encoding/decoding process and the corresponding reconstructed HDR video frames may then be reverse reshaped. The disclosed reshaping methods may be combinations of scene-based or segment-based methods.

公开(公告)号：US20130254620A1

公开(公告)日：2013-09-26

申请号：US13785859

申请日：2013-03-05

Applicant: Apple Inc.

Inventor： Xiaosong ZHOU ,  Hyeonkuk JEONG ,  Yan YANG ,  Dazhong ZHANG ,  Hsi-Jung WU

IPC: H03M13/05 ,  H03M13/29

CPC classification number: H03M13/05 ,  H03M13/1102 ,  H03M13/1515 ,  H03M13/152 ,  H03M13/27 ,  H03M13/29 ,  H03M13/2957 ,  H03M13/373 ,  H03M13/3746 ,  H04L1/005 ,  H04L1/0057 ,  H04L1/008

Abstract: Coded video data may be transmitted between an encoder and a decoder using multiple FEC codes and/or packets for error detection and correction. Only a subset of the FEC packets need be transmitted between the encoder and decoder. The FEC packets of each FEC group may take, as inputs, data packets of a current FEC group and also an untransmitted FEC packet of a preceding FEC group. Due to relationships among the FEC packets, when transmission errors arise and data packets are lost, there remain opportunities for a decoder to recover lost data packets from earlier-received FEC groups when later-received FEC groups are decoded. This opportunity to recover data packets from earlier FEC groups may be useful in video coding and other systems, in which later-received data often cannot be decoded unless earlier-received data is decoded properly.

Abstract translation: 可以在编码器和解码器之间使用多个用于错误检测和校正的FEC码和/或包进行编码的视频数据。 只有FEC数据包的一部分需要在编码器和解码器之间传输。 每个FEC组的FEC分组可以采用当前FEC组的数据分组和前一个FEC组的未发送FEC分组的输入。 由于FEC分组之间的关系，当传输错误出现并且数据分组丢失时，当稍后接收的FEC组被解码时，解码器仍然有机会恢复来自早先接收的FEC组的丢失的数据分组。 从先前的FEC组恢复数据分组的机会在视频编码和其他系统中可能是有用的，其中后期接收的数据通常不能被解码，除非先前接收到的数据被正确解码。