公开(公告)号：US20180184121A1

公开(公告)日：2018-06-28

申请号：US15390202

申请日：2016-12-23

Applicant: Apple Inc.

Inventor： Jae Hoon Kim ,  Xiaosong Zhou ,  Dazhong Zhang ,  Hang Yuan ,  Jiefu Zhai ,  Chris Y. Chung ,  Hsi-Jung Wu

IPC: H04N19/597 ,  H04N19/176 ,  H04N19/105

CPC classification number: H04N19/597 ,  H04N19/105 ,  H04N19/176 ,  H04N19/547

Abstract: Techniques are disclosed for coding video data predictively based on predictions made from spherical-domain projections of input pictures to be coded and reference pictures that are prediction candidates. Spherical projection of an input picture and the candidate reference pictures may be generated. Thereafter, a search may be conducted for a match between the spherical-domain representation of a pixel block to be coded and a spherical-domain representation of the reference picture. On a match, an offset may be determined between the spherical-domain representation of the pixel block to a matching portion of the of the reference picture in the spherical-domain representation. The spherical-domain offset may be transformed to a motion vector in a source-domain representation of the input picture, and the pixel block may be coded predictively with reference to a source-domain representation of the matching portion of the reference picture.

公开(公告)号：US20180109824A1

公开(公告)日：2018-04-19

申请号：US15845287

申请日：2017-12-18

Applicant: Apple Inc.

Inventor： Yeping Su ,  Chris Y. Chung ,  Xiaosong Zhou ,  James Oliver Normile ,  Hsi-Jung Wu ,  Thomas Jansen ,  Hyeonkuk Jeong ,  Joe S. Abuan ,  Douglas Scott Price

IPC: H04N21/2343 ,  H04N21/44 ,  H04N21/438 ,  H04N21/2381

CPC classification number: H04N21/234372 ,  H04N21/23439 ,  H04N21/2381 ,  H04N21/4384 ,  H04N21/44004

Abstract: A video streaming method for transitioning between multiple sequences of coded video data may include receiving and decoding transmission units from a first sequence of coded video data. In response to a request to transition to a second sequence of coded video data, the method may determine whether a time to transition to the second sequence of coded video data can be reduced by transitioning to the second sequence of coded video data via an intermediate sequence of coded video data. If the time can be reduced, the method may include receiving at least one transmission unit from an intermediate sequence of coded video data that corresponds to the request to transition, decoding the transmission unit from the intermediate sequence, and transitioning from the first sequence to the second sequence via the decoded transmission unit from the intermediate sequence.

公开(公告)号：US09888240B2

公开(公告)日：2018-02-06

申请号：US14056043

申请日：2013-10-17

Applicant: Apple Inc.

Inventor： Yeping Su ,  Chris Y. Chung ,  Hao Pan ,  Hsi-Jung Wu ,  Ke Zhang

IPC: H04N19/117 ,  H04N19/136

CPC classification number: H04N19/117 ,  H04N19/136

Abstract: Video coding systems and methods are provided that protect against various artifacts (e.g., banding artifacts) in decoded frame content. The embodiments to protect against introducing artifacts include pre-processing the input video frame, controlling the encoding parameters and/or post-processing the decoded video frame. A method for encoding a frame may include calculating a dark-scene score for the frame based on measured statistics of the frame. The dark-scene score may be compared to a threshold to determine if the banding artifacts may be present in the frame. Based on the comparison, filtering parameters for the frame may be altered to reduce the amount of noise filtered from the frame. The frame may be filtered based on the altered filtering parameters and encoded.

公开(公告)号：US09876964B2

公开(公告)日：2018-01-23

申请号：US14290351

申请日：2014-05-29

Applicant: Apple Inc.

Inventor： Xiaosong Zhou ,  Hsi-Jung Wu ,  Chris Y. Chung ,  James O. Normile ,  Dazhong Zhang

IPC: H04N7/12 ,  H04N5/262 ,  H04N19/167 ,  H04N19/132 ,  H04N19/115 ,  H04N19/17 ,  H04N19/124 ,  H04N19/136

CPC classification number: H04N5/262 ,  H04N19/115 ,  H04N19/124 ,  H04N19/132 ,  H04N19/136 ,  H04N19/167 ,  H04N19/17

Abstract: Techniques for coding video data estimate depths of different elements within video content and identify regions within the video content based on the estimated depths. One of the regions may be assigned as an area of interest. Thereafter, video content of a region that is not an area of interest may be masked out and the resultant video content obtained from the masking may be coded. The coded video content may be transmitted to a channel. These techniques permit a coding terminal to mask out captured video content prior to coding in order to support coding policies that account for privacy interests or video composition features during a video coding session.

公开(公告)号：US20170359590A1

公开(公告)日：2017-12-14

申请号：US15585581

申请日：2017-05-03

Applicant: Apple Inc.

Inventor： Dazhong Zhang ,  Hang Yuan ,  Peikang Song ,  Jae Hoon Kim ,  Xing Wen ,  Sudeng Hu ,  Xiaosong Zhou ,  Chris Y. Chung ,  Hsi-Jung Wu

IPC: H04N19/423

CPC classification number: H04N19/423 ,  H04N19/463 ,  H04N21/44004 ,  H04N21/6373 ,  H04N21/6379

Abstract: Techniques are disclosed for managing memory allocations when coding video data according to multiple codec configurations. According to these techniques, devices may negotiate parameters of a coding session that include parameters of a plurality of different codec configurations that may be used during the coding session. A device may estimate sizes of decoded picture buffers for each of the negotiated codec configurations and allocate in its memory a portion of memory sized according to a largest size of the estimated decoded picture buffers. Thereafter, the devices may exchange coded video data. The exchange may involve decoding coded data of reference pictures and storing the decoded reference pictures in the allocated memory. During the coding session, the devices may toggle among the different negotiated codec configurations. As they do, reallocations of memory may be avoided.

公开(公告)号：US20170358059A1

公开(公告)日：2017-12-14

申请号：US15618967

申请日：2017-06-09

Applicant: Apple Inc.

Inventor： Ke Zhang ,  Jiefu Zhai ,  Yunfei Zheng ,  Shujie Liu ,  Albert E. Keinath ,  Xiaosong Zhou ,  Chris Y. Chung ,  Hsi-Jung Wu

IPC: G06T5/00 ,  G06T7/194 ,  G06T7/11 ,  G11B27/031

CPC classification number: G06T7/194 ,  G06K9/3233 ,  G06K9/346 ,  G06T7/11 ,  G06T2207/20132 ,  G11B27/031

Abstract: Techniques for cropping images containing an occlusion are presented. A method for image editing is presented comprising, when an occlusion is detected in an original digital image, determining an area occupied by the occlusion, assigning importance scores to different content elements of the original digital image, defining a cropping window around an area of the original digital image that does not include the area occupied by the occlusion and that is based on the importance scores, and cropping the original digital image to the cropping window.

公开(公告)号：US09654727B2

公开(公告)日：2017-05-16

申请号：US14727471

申请日：2015-06-01

Applicant: Apple Inc.

Inventor： Chris Y. Chung ,  Dazhong Zhang ,  Hsi-Jung Wu ,  Xiaosong Zhou

IPC: H04N7/14 ,  H04N7/15 ,  H04L29/06 ,  G06F17/24

CPC classification number: H04N7/147 ,  G06F17/241 ,  H04L65/403 ,  H04L65/601 ,  H04N5/147 ,  H04N7/155 ,  H04N21/242 ,  H04N21/4307

Abstract: Techniques are disclosed for overcoming communication lag between interactive operations among devices in a streaming session. According to the techniques, a first device streaming video content to a second device and an annotation is entered to a first frame being displayed at the second device, which is communicated back to the first device. Responsive to a communication that identifies the annotation, a first device may identify an element of video content from the first frame to which the annotation applies and determine whether the identified element is present in a second frame of video content currently displayed at the first terminal. If so, the first device may display the annotation with the second frame in a location where the identified element is present. If not, the first device may display the annotation via an alternate technique.

公开(公告)号：US20160360220A1

公开(公告)日：2016-12-08

申请号：US14730830

申请日：2015-06-04

Applicant: Apple Inc.

Inventor： Peikang Song ,  Jae Hoon Kim ,  Xiaosong Zhou ,  Chris Y. Chung ,  Hsi-Jung Wu ,  Dazhong Zhang

IPC: H04N19/51 ,  H04N19/172 ,  H04N19/159 ,  H04N19/139 ,  H04N19/142

CPC classification number: H04N19/172 ,  H04N19/132 ,  H04N19/139 ,  H04N19/142 ,  H04N19/154 ,  H04N19/159 ,  H04N19/164

Abstract: Techniques are described for responding to changes in bandwidth that are available to transmit coded video data between an encoder and a decoder. When such changes in bandwidth occur, estimates may be derived of visual significance of coded video data that has not yet been transmitted and also video data that is next to be coded. These estimates may be compared to each other. When the estimated visual significance of the coded video data that has not yet been transmitted is greater than the estimated visual significance of the video data that is next to be coded, transmission of the coded video data that has not yet been transmitted may be prioritized over coding of the video data that is next to be coded. When the estimated visual significance of the video data that is next to be coded is greater than the estimated visual significance of the coded video data that has not yet been transmitted, coding of the video data that is next to be coded may be prioritized over transmission of the coded video data that has not yet been transmitted. Resources may be allocated to the prioritized coder operation.

Abstract translation: 描述了用于响应可用于在编码器和解码器之间传输编码视频数据的带宽变化的技术。 当这种带宽变化发生时，可能导出尚未被发送的编码视频数据的视觉重要性的估计，以及接下来被编码的视频数据。 这些估计可以相互比较。 当尚未被发送的编码视频数据的估计视觉含义大于接下来要被编码的视频数据的估计视觉有效性时，还没有发送的编码视频数据的传输可以优先于 对接下来被编码的视频数据进行编码。 当接下来被编码的视频数据的估计视觉含义大于尚未发送的编码视频数据的估计视觉有效性时，下一个被编码的视频数据的编码可以通过传输优先化 的尚未被发送的编码视频数据。 可以将资源分配给优先编码器操作。

公开(公告)号：US20160094823A1

公开(公告)日：2016-03-31

申请号：US14603109

申请日：2015-01-22

Applicant: Apple Inc.

Inventor： Jiefu Zhai ,  Yeping Su ,  Hsi-Jung Wu ,  Chris Y. Chung ,  Xiaosong Zhou ,  Ke Zhang

IPC: H04N9/67 ,  H04N9/64

CPC classification number: H04N9/67 ,  H04N1/646 ,  H04N9/646

Abstract: An encoder may include a luma transform, a transformer, and a chroma transform. The luma transform may determine a linear luminance value based upon a plurality of primary color values of a pixel. The transformer may generate a transformed luminance value based upon the linear luminance value and a plurality of transformed color values based upon corresponding more than one of the primary color values of the pixel. The chroma transform may determine a plurality of chroma values based upon corresponding plurality of transformed color values and the transformed luminance value of the pixel.

Abstract translation: 编码器可以包括亮度变换，变压器和色度变换。 亮度变换可以基于像素的多个基色值来确定线性亮度值。 所述变压器可以基于所述线性亮度值和基于所述像素的主要颜色值中的多于一个的多个变换颜色值来生成经变换的亮度值。 色度变换可以基于对应的多个变换颜色值和像素的变换亮度值来确定多个色度值。

公开(公告)号：US09264661B2

公开(公告)日：2016-02-16

申请号：US14082852

申请日：2013-11-18

Applicant: Apple Inc.

Inventor： Jiefu Zhai ,  Chris Y. Chung ,  Xiaosong Zhou ,  Hsi-Jung Wu

IPC: H04N7/14 ,  H04N19/117

CPC classification number: H04N7/141 ,  H04N19/117

Abstract: A system may include a receiver, a decoder, a post-processor, and a controller. The receiver may receive encoded video data. The decoder may decode the encoded video data. The post-processor may perform post-processing on frames of decoded video sequence from the decoder. The controller may adjust post-processing of a current frame, based upon at least one condition parameters detected at the system.

Abstract translation: 系统可以包括接收器，解码器，后处理器和控制器。 接收机可以接收编码的视频数据。 解码器可以解码编码的视频数据。 后处理器可以对来自解码器的解码视频序列的帧执行后处理。 控制器可以基于在系统处检测到的至少一个条件参数来调整当前帧的后处理。