公开(公告)号：US20150350560A1

公开(公告)日：2015-12-03

申请号：US14290351

申请日：2014-05-29

Applicant: Apple Inc.

Inventor： Xiaosong Zhou ,  Hsi-Jung Wu ,  Chris Y. Chung ,  James O. Normile ,  Dazhong Zhang

IPC: H04N5/262 ,  H04N19/132 ,  H04N19/167

CPC classification number: H04N5/262 ,  H04N19/115 ,  H04N19/124 ,  H04N19/132 ,  H04N19/136 ,  H04N19/167 ,  H04N19/17

Abstract: Techniques for coding video data estimate depths of different elements within video content and identify regions within the video content based on the estimated depths. One of the regions may be assigned as an area of interest. Thereafter, video content of a region that is not an area of interest may be masked out and the resultant video content obtained from the masking may be coded. The coded video content may be transmitted to a channel. These techniques permit a coding terminal to mask out captured video content prior to coding in order to support coding policies that account for privacy interests or video composition features during a video coding session.

Abstract translation: 用于编码视频数据的技术估计视频内容中的不同元素的深度，并基于估计的深度识别视频内容内的区域。 其中一个地区可能被分配为感兴趣的区域。 此后，可以屏蔽不是感兴趣区域的区域的视频内容，并且可以对从屏蔽获得的结果视频内容进行编码。 编码的视频内容可以被发送到频道。 这些技术允许编码终端在编码之前掩蔽捕获的视频内容，以便在视频编码会话期间支持考虑隐私兴趣或视频合成特征的编码策略。

公开(公告)号：US20150341654A1

公开(公告)日：2015-11-26

申请号：US14284701

申请日：2014-05-22

Applicant: Apple Inc.

Inventor： Xiaosong Zhou ,  Hsi-Jung Wu ,  Chris Y. Chung

IPC: H04N19/50

CPC classification number: H04N19/50 ,  H04N19/105 ,  H04N19/142 ,  H04N19/172 ,  H04N19/59 ,  H04N19/87

Abstract: A video coder, responsive to detection of a zooming transition in source video, estimates a scale factor and a zooming rectangle for a reference frame, scales content of the reference frame within the zooming rectangle according to the scaling factor, codes content of a new frame of the source video predictively using the scaled reference frame as a basis of prediction, and transmits coded video data obtained from the predictive coding to a decoder along with an indication of the scaling factor and zooming rectangle.

Abstract translation: 视频编码器响应于源视频中的缩放转换的检测，估计用于参考帧的比例因子和缩放矩形，根据缩放因子缩放缩放矩形内的参考帧的内容，对新帧的内容进行编码 的源视频预测性地使用缩放参考帧作为预测的基础，并且将从预测编码获得的编码视频数据与缩放因子和缩放矩形的指示一起发送到解码器。

公开(公告)号：US20150326896A1

公开(公告)日：2015-11-12

申请号：US14710520

申请日：2015-05-12

Applicant: Apple Inc.

Inventor： Yeping Su ,  Jiefu Zhai ,  Ke Zhang ,  Xiaosong Zhou ,  Hsi-Jung Wu ,  Chris Y. Chung

IPC: H04N21/2343 ,  H04N21/2385 ,  H04N21/438 ,  H04N19/184 ,  H04N21/4402 ,  H04N19/50 ,  H04N19/186 ,  H04N21/234 ,  H04N21/44

CPC classification number: H04N19/30 ,  H04N19/46

Abstract: Systems and methods are provided for processing high quality video data, such as data having a higher than standard bit depth, a high dynamic range, or a wide or custom color gamut, to be compatible with conventional encoders and decoders without significant loss of quality. High quality data is encoded into a plurality of layers with a base layer having the standard quality data and one or more higher quality layers. Decoding systems and methods may map the base layer to the dynamic range or color gamut of the enhancement layer, combine the layers, and map the combined layers to a dynamic range or color gamut appropriate for the target display. Each of the standard quality and the high quality data may be encoded as a plurality of tiers of increasing quality and reference lower level tiers as sources of prediction during predictive coding.

Abstract translation: 提供了用于处理高质量视频数据的系统和方法，例如具有高于标准位深度，高动态范围或宽或定制色域的数据，以与常规编码器和解码器兼容，而没有显着的质量损失。 高质量数据被编码成具有基层的多层，具有标准质量数据和一个或多个更高质量的层。 解码系统和方法可以将基本层映射到增强层的动态范围或色域，组合层，并将组合层映射到适合于目标显示的动态范围或色域。 标准质量和高质量数据中的每一个可以被编码为增加质量的多个层级和作为预测编码期间的预测源的较低级别的参考。

公开(公告)号：US20140362927A1

公开(公告)日：2014-12-11

申请号：US14065981

申请日：2013-10-29

Applicant: Apple Inc.

Inventor： Chris Y. Chung ,  Douglas Scott Price ,  Hsi-Jung Wu ,  Xiaosong Zhou

IPC: H04N19/142 ,  H04N19/119 ,  H04N19/176

CPC classification number: H04N19/176 ,  H04N19/119 ,  H04N19/124 ,  H04N19/14 ,  H04N19/142

Abstract: A system may include a detector, a controller, and an encoder. The detector may receive data from video input to detect a group of pixels in a video sequence, and may determine whether the group of pixels needs additional bits for encoding. The controller may determine the number of bits for the additional bits and may allocate the additional bits with the number of bits in a data stream. The encoder may by controlled by the controller to encode the group of pixels with the additional bits, and output to the encoded output.

Abstract translation: 系统可以包括检测器，控制器和编码器。 检测器可以从视频输入接收数据以检测视频序列中的一组像素，并且可以确定像素组是否需要用于编码的附加位。 控制器可以确定附加比特的比特数，并且可以用数据流中的比特数分配附加比特。 编码器可以由控制器控制以用附加位对像素组进行编码，并输出到编码输出。

公开(公告)号：US11818502B2

公开(公告)日：2023-11-14

申请号：US17846896

申请日：2022-06-22

Applicant: Apple Inc.

Inventor： Jae Hoon Kim ,  Chris Y. Chung ,  Dazhong Zhang ,  Hang Yuan ,  Hsi-Jung Wu ,  Xiaosong Zhou ,  Jiefu Zhai

IPC: H04N7/14 ,  H04N7/15 ,  G06F3/0488 ,  H04N13/00 ,  H04N13/239

CPC classification number: H04N7/147 ,  G06F3/0488 ,  H04N7/15 ,  H04N13/239 ,  H04N2007/145 ,  H04N2013/0092

Abstract: Embodiments of the present disclosure provide systems and methods for perspective shifting in a video conferencing session. In one exemplary method, a video stream may be generated. A foreground element may be identified in a frame of the video stream and distinguished from a background element of the frame. Data may be received representing a viewing condition at a terminal that will display the generated video stream. The frame of the video stream may be modified based on the received data to shift of the foreground element relative to the background element. The modified video stream may be displayed at the displaying terminal.

公开(公告)号：US11259046B2

公开(公告)日：2022-02-22

申请号：US15433505

申请日：2017-02-15

Applicant: Apple Inc.

Inventor： Jae Hoon Kim ,  Chris Y. Chung ,  Dazhong Zhang ,  Hang Yuan ,  Hsi-Jung Wu ,  Jiefu Zhai ,  Xiaosong Zhou

IPC: H04N19/597 ,  H04N19/61 ,  H04N19/105 ,  H04N19/513 ,  H04N19/159 ,  H04N19/124 ,  H04N19/13 ,  H04N19/176 ,  H04N19/51 ,  H04N19/139 ,  H04N19/182 ,  H04N19/547 ,  H04N19/527

Abstract: Methods and Systems disclosed to counteract spatial distortions introduced by imaging processes of multi-directional video frames, where objects may be projected to spherical or equirectangular representations. Techniques provided to invert the spatial distortions in video frames used as reference picture data in predictive coding, by spatially transforming the image content of the reference picture data before this image content is being used for the prediction of input video data in prediction-based coders and decoders.

公开(公告)号：US11206371B2

公开(公告)日：2021-12-21

申请号：US15495095

申请日：2017-04-24

Applicant: Apple Inc.

Inventor： Chris Y. Chung ,  Dazhong Zhang ,  Hsi-Jung Wu ,  Xiaosong Zhou

IPC: H04N7/14 ,  H04N7/15 ,  H04L29/06 ,  H04N21/242 ,  H04N21/43 ,  H04N5/14 ,  G06F40/169 ,  H04N19/136

Abstract: Techniques are disclosed for overcoming communication lag between interactive operations among devices in a streaming session. According to the techniques, a first device streaming video content to a second device and an annotation is entered to a first frame being displayed at the second device, which is communicated back to the first device. Responsive to a communication that identifies the annotation, a first device may identify an element of video content from the first frame to which the annotation applies and determine whether the identified element is present in a second frame of video content currently displayed at the first terminal. If so, the first device may display the annotation with the second frame in a location where the identified element is present. If not, the first device may display the annotation via an alternate technique.

公开(公告)号：US10999602B2

公开(公告)日：2021-05-04

申请号：US15390202

申请日：2016-12-23

Applicant: Apple Inc.

Inventor： Jae Hoon Kim ,  Xiaosong Zhou ,  Dazhong Zhang ,  Hang Yuan ,  Jiefu Zhai ,  Chris Y. Chung ,  Hsi-Jung Wu

IPC: H04N19/176 ,  H04N19/105 ,  H04N19/597 ,  H04N19/547

Abstract: Techniques are disclosed for coding video data predictively based on predictions made from spherical-domain projections of input pictures to be coded and reference pictures that are prediction candidates. Spherical projection of an input picture and the candidate reference pictures may be generated. Thereafter, a search may be conducted for a match between the spherical-domain representation of a pixel block to be coded and a spherical-domain representation of the reference picture. On a match, an offset may be determined between the spherical-domain representation of the pixel block to a matching portion of the of the reference picture in the spherical-domain representation. The spherical-domain offset may be transformed to a motion vector in a source-domain representation of the input picture, and the pixel block may be coded predictively with reference to a source-domain representation of the matching portion of the reference picture.

公开(公告)号：US10715833B2

公开(公告)日：2020-07-14

申请号：US14289082

申请日：2014-05-28

Applicant: Apple Inc.

Inventor： Yunfei Zheng ,  Dazhong Zhang ,  Xiaosong Zhou ,  Chris Y. Chung ,  Hsi-Jung Wu

IPC: H04N19/70

Abstract: An encoding system may include a video source that captures video image, a video coder, and a controller to manage operation of the system. The video coder may encode the video image into encoded video data using a plurality of subgroup parameters corresponding to a plurality of subgroups of pixels within a group. The controller may set the subgroup parameters for at least one of the subgroups of pixels in the video coder, based upon at least one parameters corresponding to the group. A decoding system may decode the video data based upon the motion prediction parameters.

公开(公告)号：US20200213571A1

公开(公告)日：2020-07-02

申请号：US16725245

申请日：2019-12-23

Applicant: Apple Inc.

Inventor： Jae Hoon Kim ,  Ming Chen ,  Xiaosong Zhou ,  Hsi-Jung Wu ,  Dazhong Zhang ,  Hang Yuan ,  Jiefu Zhai ,  Chris Y. Chung

IPC: H04N13/161 ,  H04N13/243 ,  H04N5/232 ,  H04N19/70 ,  H04N19/597

Abstract: Frame packing techniques are disclosed for multi-directional images and video. According to an embodiment, a multi-directional source image is reformatted into a format in which image data from opposing fields of view are represented in respective regions of the packed image as flat image content. Image data from a multi-directional field of view of the source image between the opposing fields of view are represented in another region of the packed image as equirectangular image content. It is expected that use of the formatted frame will lead to coding efficiencies when the formatted image is processed by predictive video coding techniques and the like.