公开(公告)号：US11871052B1

公开(公告)日：2024-01-09

申请号：US16580184

申请日：2019-09-24

Applicant: Apple Inc.

Inventor： Hao Pan ,  Haitao Guo ,  Ke Chen ,  Francesco Iacopino ,  Jim C. Chou ,  Xiaohua Yang ,  Linfeng Guo ,  Munehiro Nakazato ,  Krishnakanth Rapaka ,  Ye Cong

IPC: G06F15/16 ,  H04N21/2343 ,  G02B27/00 ,  G06T19/00 ,  H04N21/2662

CPC classification number: H04N21/2343 ,  G02B27/0093 ,  G06T19/006 ,  H04N21/2662

Abstract: In one implementation, a method of generating a bit stream encoding a video stream is performed by a device including one or more processors and non-transitory memory. The method includes decomposing a video stream into a plurality of frequency band video streams. The method includes determining a target bitrate and determining, for each frequency band video stream, a respective frequency band bit rate based on the target bit rate. The method includes encoding each of the plurality of frequency band video streams at its respective frequency band bit rate and transmitting, over a channel, each encoded frequency band video stream.

公开(公告)号：US11606574B2

公开(公告)日：2023-03-14

申请号：US16882819

申请日：2020-05-26

Applicant: Apple Inc.

Inventor： Dazhong Zhang ,  Peikang Song ,  Beibei Wang ,  Giribalan Gopalan ,  Albert E. Keinath ,  Christopher M. Garrido ,  David R. Conrad ,  Hsi-Jung Wu ,  Ming Jin ,  Hang Yuan ,  Xiaohua Yang ,  Xiaosong Zhou ,  Vikrant Kasarabada ,  Davide Concion ,  Eric L. Chien ,  Bess C. Chan ,  Karthick Santhanam ,  Gurtej Singh Chandok

IPC: H04N19/507 ,  H04N19/65

Abstract: Techniques are disclosed for coding video data in which frames from a video source are partitioned into a plurality of tiles of common size, and the tiles are coded as a virtual video sequence according to motion-compensated prediction, each tile treated as having respective temporal location of the virtual video sequence. The coding scheme permits relative allocation of coding resources to tiles that are likely to have greater significance in a video coding session, which may lead to certain tiles that have low complexity or low motion content to be skipped during coding of the tiles for select source frames. Moreover, coding of the tiles may be ordered to achieve low coding latencies during a coding session.

公开(公告)号：US20180352240A1

公开(公告)日：2018-12-06

申请号：US15613172

申请日：2017-06-03

Applicant: Apple Inc.

Inventor： Krishnakanth Rapaka ,  Mukta Gore ,  Sunder Venkateswaran ,  Xiaohua Yang ,  Xiang Fu ,  Francesco Iacopino ,  Linfeng Guo

IPC: H04N19/187 ,  H04N19/51 ,  H04N19/31 ,  H04N19/39

Abstract: Techniques for encoding video with temporal layering are described, comprising predicting a sequence of pictures with a motion prediction reference pattern having a number of virtual temporal layers, and encoding the sequence of pictures into an encoded bitstream with a temporal layering syntax, wherein a number of signaled temporal layers is less than the number of virtual temporal layers. The number of signaled temporal layers may be determined from a target highest frame rate, a target base layer frame rate, and the number of virtual temporal layers.

公开(公告)号：US20180302621A1

公开(公告)日：2018-10-18

申请号：US15487853

申请日：2017-04-14

Applicant: Apple Inc.

Inventor： Xiang Fu ,  Xiaohua Yang ,  Linfeng Guo ,  Francesco Iacopino ,  Krishna Rapaka ,  Felix Chou ,  Mukta Gore

IPC: H04N19/124 ,  H04L29/06 ,  H04N19/105 ,  H04N19/117 ,  H04N19/176 ,  H04N19/61 ,  H04N19/85

CPC classification number: H04N19/124 ,  H04L65/4069 ,  H04L65/602 ,  H04L65/607 ,  H04N19/105 ,  H04N19/117 ,  H04N19/126 ,  H04N19/136 ,  H04N19/154 ,  H04N19/176 ,  H04N19/463 ,  H04N19/61 ,  H04N19/85

Abstract: Techniques are disclosed for developing quantization matrices for use in video coding. According to these techniques a first quantization matrix may be derived from a second quantization matrix by scaling quantization values of the second quantization matrix by scaling parameters. The scaling parameters may increase according to distance between each matrix position and a matrix origin, they may be derived from characteristics of a video sequence to be coded, or both. The first quantization matrix may be communicated to a decoder. Thereafter, a video sequence may be coded predictively. As part of the coding, pixel data of the video sequence may be transformed to a plurality of frequency domain coefficients, and the frequency domain coefficients may be quantized according to the first quantization matrix.

公开(公告)号：US20170272780A1

公开(公告)日：2017-09-21

申请号：US15070620

申请日：2016-03-15

Applicant: Apple Inc.

Inventor： Hao Pan ,  Yingjun Bai ,  Xuemei Zhang ,  Haitao Guo ,  Munehiro Nakazato ,  Xiaohua Yang

IPC: H04N19/86 ,  H04N19/44 ,  H04N19/186 ,  H04N19/12 ,  H04N19/156

CPC classification number: H04N19/86 ,  H04N1/6058 ,  H04N19/12 ,  H04N19/156 ,  H04N19/186 ,  H04N19/44 ,  H04N19/85

Abstract: This disclosure relates to a wide gamut encoder capable of receiving a wide gamut color image in accordance with a wide gamut standard. The encoder can encode one or more wide gamut color image pixel values into portions of narrow gamut encoding elements for transmission to a video encoder. The encoder can implement an advanced extended YCC format that is backward compatible with a P3 color gamut.

公开(公告)号：US20160360234A1

公开(公告)日：2016-12-08

申请号：US15172064

申请日：2016-06-02

Applicant: Apple Inc.

Inventor： Alexandros Michael Tourapis ,  David William Singer ,  Haitao Guo ,  Hsi-Jung Wu ,  Sorin C. Cismas ,  Xiaohua Yang ,  Yeping Su ,  Dazhong Zhang

IPC: H04N19/593 ,  H04N19/182 ,  H04N19/176

CPC classification number: H04N19/593 ,  H04N19/117 ,  H04N19/156 ,  H04N19/174 ,  H04N19/176 ,  H04N19/182

Abstract: Methods are described for encoding and decoding blocks of image data using intra block copying (IBC). A source block for intra block copying is selected from a source region of a current image that is closer to the current block than a threshold, wherein the source region does not include a portion of the current image that is further from the current block than the threshold.

Abstract translation: 描述了使用块内复制（IBC）对图像数据块进行编码和解码的方法。 从当前图像的比当前块更靠近阈值的源区域中选择用于帧内块复制的源块，其中源区域不包括当前图像的比当前块更远的部分， 阈。

公开(公告)号：US20250111541A1

公开(公告)日：2025-04-03

申请号：US18477256

申请日：2023-09-28

Applicant: Apple Inc.

Inventor： Frederic Cao ,  Xiaohua Yang ,  Hao Pan ,  Giribalan Gopalan

IPC: G06T9/00 ,  G06T3/40 ,  H04N7/01

Abstract: This disclosure describes techniques to concurrently capture several redundant (e.g., overlapping) video image streams on electronic devices having multiple image capture devices (e.g., on mobile devices having two or more digital video cameras). The techniques described herein advantageously capture at least one “compressed” video image stream, such that the overall multi-video image stream capture process uses significantly less power than capturing each stream independently in an “uncompressed” fashion. These techniques provide an electronic device with the ability to provide a user with more video streams that are of a higher frame rate and/or higher quality for a longer capture time-without exceeding the device's thermal limits. In particular, a “compressed” amount of image information may be processed and saved from at least one camera at capture time, and then deferred processing operations may be used to reconstruct any missing information and produce the higher frame rate/higher quality video image streams.

公开(公告)号：US20210096023A1

公开(公告)日：2021-04-01

申请号：US16586411

申请日：2019-09-27

Applicant: Apple Inc.

Inventor： Xiaohua Yang ,  Ruiqi Hu ,  Hao Pan ,  Vaidyanath Mani ,  Qiang Wang ,  Haiyan He ,  Xin Wang ,  Gui Xie ,  Jin Wook Chang

IPC: G01J1/42 ,  G06T5/00 ,  G06T7/90 ,  G06T7/11 ,  H04N1/60

Abstract: A device comprises memory, a display characterized by a display characteristic, and processors coupled to the memory. The processors execute instructions causing the processors to receive data indicative of the display characteristic, data indicative of ambient lighting, and data indicative of content characteristics for a content item; determine a tone mapping curve for the content item based on the data indicative of content characteristics; determine a first, so-called “anchor” point along the tone mapping curve; modify a first portion of the tone mapping curve below the anchor point based on the data indicative of ambient lighting; modify a second portion of the tone mapping curve above the anchor point based on the data indicative of the display characteristic; perform tone mapping for the content item based on the modified toned mapping curve to obtain a tone mapped content item; and cause the display to display the tone mapped content item.

公开(公告)号：US10757445B2

公开(公告)日：2020-08-25

申请号：US16173105

申请日：2018-10-29

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  David W. Singer ,  Haitao Guo ,  Hsi-Jung Wu ,  Sorin C. Cismas ,  Xiaohua Yang ,  Yeping Su ,  Dazhong Zhang

IPC: H04N19/593 ,  H04N19/156 ,  H04N19/44 ,  H04N19/176 ,  H04N19/182 ,  H04N19/174

Abstract: Methods are described for encoding and decoding blocks of image data using intra block copying (IBC). A source block for intra block copying is selected from a source region of a current image that is closer to the current block than a threshold, wherein the source region does not include a portion of the current image that is further from the current block than the threshold.

公开(公告)号：US20160353107A1

公开(公告)日：2016-12-01

申请号：US14721903

申请日：2015-05-26

Applicant: Apple Inc.

Inventor： Jian Lou ,  Congxia Dai ,  Hao Pan ,  Xiaohua Yang

IPC: H04N19/126 ,  H04N19/184 ,  H04N19/172 ,  H04N19/182 ,  H04N19/176

CPC classification number: H04N19/176 ,  H04N19/124 ,  H04N19/136 ,  H04N19/167 ,  H04N19/182

Abstract: Methods and systems provide an adaptive quantization parameter (QP) modulation scheme for video coding and compression that is sensitive to user visual perception. In an embodiment, the method includes detecting an eye sensitive region, where a region is considered sensitive based on a noticeability of a visual effect. The method includes estimating encoding parameters for image content in the detected eye sensitive region. The method further includes encoding the detected eye sensitive region with the estimated encoding parameters. The estimating the encoding parameters may be based on, among other things, a variance, a motion vector, a DC value, an edge value, and external information such as a user command or screen content. The encoding may include storing an average or maximum sum of square differences (SSD) value for a detected eye sensitive area and adjusting a QP value based on a comparison of the SSD value to generated threshold values.

Abstract translation: 方法和系统为视频编码和压缩提供了一种对用户视觉感知敏感的自适应量化参数（QP）调制方案。 在一个实施例中，该方法包括基于视觉效果的显着性检测区域被认为是敏感的眼睛敏感区域。 该方法包括估计检测到的眼睛敏感区域中的图像内容的编码参数。 该方法还包括用所估计的编码参数来编码检测到的眼睛敏感区域。 估计编码参数可以基于方差，运动矢量，DC值，边缘值以及诸如用户命令或屏幕内容的外部信息。 编码可以包括存储检测到的眼睛敏感区域的平均差异（SSD）值的平均或最大和，并且基于SSD值与生成的阈值的比较来调整QP值。