公开(公告)号：US20150350560A1

公开(公告)日：2015-12-03

申请号：US14290351

申请日：2014-05-29

Applicant: Apple Inc.

Inventor： Xiaosong Zhou ,  Hsi-Jung Wu ,  Chris Y. Chung ,  James O. Normile ,  Dazhong Zhang

IPC: H04N5/262 ,  H04N19/132 ,  H04N19/167

CPC classification number: H04N5/262 ,  H04N19/115 ,  H04N19/124 ,  H04N19/132 ,  H04N19/136 ,  H04N19/167 ,  H04N19/17

Abstract: Techniques for coding video data estimate depths of different elements within video content and identify regions within the video content based on the estimated depths. One of the regions may be assigned as an area of interest. Thereafter, video content of a region that is not an area of interest may be masked out and the resultant video content obtained from the masking may be coded. The coded video content may be transmitted to a channel. These techniques permit a coding terminal to mask out captured video content prior to coding in order to support coding policies that account for privacy interests or video composition features during a video coding session.

Abstract translation: 用于编码视频数据的技术估计视频内容中的不同元素的深度，并基于估计的深度识别视频内容内的区域。 其中一个地区可能被分配为感兴趣的区域。 此后，可以屏蔽不是感兴趣区域的区域的视频内容，并且可以对从屏蔽获得的结果视频内容进行编码。 编码的视频内容可以被发送到频道。 这些技术允许编码终端在编码之前掩蔽捕获的视频内容，以便在视频编码会话期间支持考虑隐私兴趣或视频合成特征的编码策略。

公开(公告)号：US20150341654A1

公开(公告)日：2015-11-26

申请号：US14284701

申请日：2014-05-22

Applicant: Apple Inc.

Inventor： Xiaosong Zhou ,  Hsi-Jung Wu ,  Chris Y. Chung

IPC: H04N19/50

CPC classification number: H04N19/50 ,  H04N19/105 ,  H04N19/142 ,  H04N19/172 ,  H04N19/59 ,  H04N19/87

Abstract: A video coder, responsive to detection of a zooming transition in source video, estimates a scale factor and a zooming rectangle for a reference frame, scales content of the reference frame within the zooming rectangle according to the scaling factor, codes content of a new frame of the source video predictively using the scaled reference frame as a basis of prediction, and transmits coded video data obtained from the predictive coding to a decoder along with an indication of the scaling factor and zooming rectangle.

Abstract translation: 视频编码器响应于源视频中的缩放转换的检测，估计用于参考帧的比例因子和缩放矩形，根据缩放因子缩放缩放矩形内的参考帧的内容，对新帧的内容进行编码 的源视频预测性地使用缩放参考帧作为预测的基础，并且将从预测编码获得的编码视频数据与缩放因子和缩放矩形的指示一起发送到解码器。

公开(公告)号：US20150334391A1

公开(公告)日：2015-11-19

申请号：US14723264

申请日：2015-05-27

Applicant: Apple Inc.

Inventor： Thomas Pun ,  Paul Chang ,  Hsi-Jung Wu

IPC: H04N19/105 ,  H04N19/52 ,  H04N19/157 ,  H04N19/182 ,  H04N19/176

CPC classification number: H04N19/105 ,  H04N19/102 ,  H04N19/134 ,  H04N19/157 ,  H04N19/176 ,  H04N19/182 ,  H04N19/436 ,  H04N19/44 ,  H04N19/46 ,  H04N19/52 ,  H04N19/61

Abstract: A method for decoding a compressed video data sequence containing one or more coded pixel blocks. The compressed video sequence is buffered. Prediction information for each of the coded pixel blocks is reviewed. One or more groups of coded pixel blocks are formed based on the reviewed prediction information such that the coded pixel blocks within a given group have similar prediction dependencies and/or at least do not depend on a reconstructed pixel within a group of received pixel blocks to enable parallel decoding. The formed groups are scheduled for processing and subsequently decoded to produce a decoded video data sequence.

Abstract translation: 一种用于解码包含一个或多个编码像素块的压缩视频数据序列的方法。 压缩视频序列被缓冲。 回顾每个编码像素块的预测信息。 基于所检查的预测信息形成一组或多组编码像素块，使得给定组内的编码像素块具有相似的预测依赖性和/或至少不依赖于所接收的像素块组内的重建像素 启用并行解码。 形成的组被调度用于处理并随后被解码以产生解码的视频数据序列。

公开(公告)号：US20150326896A1

公开(公告)日：2015-11-12

申请号：US14710520

申请日：2015-05-12

Applicant: Apple Inc.

Inventor： Yeping Su ,  Jiefu Zhai ,  Ke Zhang ,  Xiaosong Zhou ,  Hsi-Jung Wu ,  Chris Y. Chung

IPC: H04N21/2343 ,  H04N21/2385 ,  H04N21/438 ,  H04N19/184 ,  H04N21/4402 ,  H04N19/50 ,  H04N19/186 ,  H04N21/234 ,  H04N21/44

CPC classification number: H04N19/30 ,  H04N19/46

Abstract: Systems and methods are provided for processing high quality video data, such as data having a higher than standard bit depth, a high dynamic range, or a wide or custom color gamut, to be compatible with conventional encoders and decoders without significant loss of quality. High quality data is encoded into a plurality of layers with a base layer having the standard quality data and one or more higher quality layers. Decoding systems and methods may map the base layer to the dynamic range or color gamut of the enhancement layer, combine the layers, and map the combined layers to a dynamic range or color gamut appropriate for the target display. Each of the standard quality and the high quality data may be encoded as a plurality of tiers of increasing quality and reference lower level tiers as sources of prediction during predictive coding.

Abstract translation: 提供了用于处理高质量视频数据的系统和方法，例如具有高于标准位深度，高动态范围或宽或定制色域的数据，以与常规编码器和解码器兼容，而没有显着的质量损失。 高质量数据被编码成具有基层的多层，具有标准质量数据和一个或多个更高质量的层。 解码系统和方法可以将基本层映射到增强层的动态范围或色域，组合层，并将组合层映射到适合于目标显示的动态范围或色域。 标准质量和高质量数据中的每一个可以被编码为增加质量的多个层级和作为预测编码期间的预测源的较低级别的参考。

公开(公告)号：US20150193013A1

公开(公告)日：2015-07-09

申请号：US14664308

申请日：2015-03-20

Applicant: Apple Inc.

Inventor： Yao-Chung Lin ,  Xiaosong Zhou ,  Hsi-Jung Wu

IPC: G06F3/03 ,  H04N7/18

CPC classification number: G06F3/03 ,  G06F1/1694 ,  G06F2200/1636 ,  H04N7/183

Abstract: Embodiments of the present invention generate estimates of device motion from two data sources on a computing device—a motion sensor and a camera. The device may compare the estimates to each other to determine if they agree. If they agree, the device may confirm that device motion estimates based on the motion sensor are accurate and may output those estimates to an application within the device. If the device motion estimates disagree, the device may alter the motion estimates obtained from the motion sensor before outputting them to the application.

Abstract translation: 本发明的实施例从计算设备上的两个数据源（运动传感器和照相机）生成设备运动的估计。 设备可以将估计值相互比较以确定它们是否一致。 如果他们同意，设备可以确认基于运动传感器的设备运动估计是准确的，并且可以将这些估计值输出到设备内的应用。 如果设备运动估计不同意，则在将其输出到应用程序之前，设备可以改变从运动传感器获得的运动估计。

公开(公告)号：US20150103135A1

公开(公告)日：2015-04-16

申请号：US14579613

申请日：2014-12-22

Applicant: Apple Inc.

Inventor： Xiaosong Zhou ,  Hsi-Jung Wu ,  Joe Abuan ,  Jim Normile ,  Haitao Guo ,  Hyeonkuk Jeong

IPC: H04N5/262 ,  H04N7/15 ,  H04N5/272 ,  H04N7/14

CPC classification number: H04N7/141 ,  G06F3/04817 ,  G06F3/04842 ,  G06F3/04886 ,  G06F9/451 ,  G09G5/14 ,  H04M1/72583 ,  H04N5/2258 ,  H04N5/2624 ,  H04N5/272 ,  H04N7/147 ,  H04N7/15

Abstract: Some embodiments provide a novel method for in-conference adjustment of encoded video pictures captured by a mobile device having at least first and second cameras. The method may involve real-time modifications of composite video displays that are generated by the mobile devices involved in such a conference. Specifically, in some embodiments, the mobile devices generate composite displays that simultaneously display multiple videos captured by multiple cameras of one or more devices. In some cases, the composite displays place the videos in adjacent display areas (e.g., in adjacent windows). In other cases, the composite display is a picture-in-picture (PIP) display that includes at least two display areas that show two different videos where one of the display areas is a background main display area and the other is a foreground inset display area that overlaps the background main display area.

Abstract translation: 一些实施例提供了一种用于会议调整由具有至少第一和第二相机的移动设备捕获的编码视频图像的新颖方法。 该方法可以涉及由这样的会议中涉及的移动设备生成的复合视频显示的实时修改。 具体地，在一些实施例中，移动设备产生同时显示由一个或多个设备的多个摄像机捕获的多个视频的复合显示器。 在某些情况下，复合显示将视频放置在相邻的显示区域中（例如，在相邻窗口中）。 在其他情况下，复合显示器是画中画（PIP）显示器，其包括显示两个不同视频的至少两个显示区域，其中一个显示区域是背景主显示区域，另一个是前景插入显示 与背景主显示区域重叠的区域。

公开(公告)号：US20140362927A1

公开(公告)日：2014-12-11

申请号：US14065981

申请日：2013-10-29

Applicant: Apple Inc.

Inventor： Chris Y. Chung ,  Douglas Scott Price ,  Hsi-Jung Wu ,  Xiaosong Zhou

IPC: H04N19/142 ,  H04N19/119 ,  H04N19/176

CPC classification number: H04N19/176 ,  H04N19/119 ,  H04N19/124 ,  H04N19/14 ,  H04N19/142

Abstract: A system may include a detector, a controller, and an encoder. The detector may receive data from video input to detect a group of pixels in a video sequence, and may determine whether the group of pixels needs additional bits for encoding. The controller may determine the number of bits for the additional bits and may allocate the additional bits with the number of bits in a data stream. The encoder may by controlled by the controller to encode the group of pixels with the additional bits, and output to the encoded output.

Abstract translation: 系统可以包括检测器，控制器和编码器。 检测器可以从视频输入接收数据以检测视频序列中的一组像素，并且可以确定像素组是否需要用于编码的附加位。 控制器可以确定附加比特的比特数，并且可以用数据流中的比特数分配附加比特。 编码器可以由控制器控制以用附加位对像素组进行编码，并输出到编码输出。

公开(公告)号：US20140354759A1

公开(公告)日：2014-12-04

申请号：US14263889

申请日：2014-04-28

Applicant: Apple Inc.

Inventor： Elizabeth C. Cranfill ,  Stephen O. Lemay ,  Joe S. Abuan ,  Hsi-Jung Wu ,  Xiaosong Zhou ,  Roberto Garcia, JR.

IPC: H04N7/15 ,  G06F3/0484

CPC classification number: H04N7/141 ,  G06F3/04817 ,  G06F3/04842 ,  G06F3/04886 ,  G06F9/451 ,  G09G5/14 ,  H04M1/72583 ,  H04N5/2258 ,  H04N5/2624 ,  H04N5/272 ,  H04N7/147 ,  H04N7/15

Abstract: Some embodiments provide a method for initiating a video conference using a first mobile device. The method presents, during an audio call through a wireless communication network with a second device, a selectable user-interface (UI) item on the first mobile device for switching from the audio call to the video conference. The method receives a selection of the selectable UI item. The method initiates the video conference without terminating the audio call. The method terminates the audio call before allowing the first and second devices to present audio and video data exchanged through the video conference.

Abstract translation: 一些实施例提供了使用第一移动设备发起视频会议的方法。 该方法在通过具有第二设备的无线通信网络的音频呼叫期间呈现在第一移动设备上的用于从音频呼叫切换到视频会议的可选择的用户界面（UI）项目。 该方法接收可选UI项目的选择。 该方法启动视频会议而不终止音频通话。 该方法在允许第一和第二设备呈现通过视频会议交换的音频和视频数据之前终止音频呼叫。

公开(公告)号：US08897580B2

公开(公告)日：2014-11-25

申请号：US13664359

申请日：2012-10-30

Applicant: Apple Inc.

Inventor： Yeping Su ,  Jiefu Zhai ,  James Oliver Normile ,  Hsi-Jung Wu ,  Hao Pan

IPC: G06K9/36

CPC classification number: G09G3/2048 ,  G09G3/2066 ,  G09G2340/06 ,  G09G2350/00

Abstract: YCbCr image data may be dithered and converted into RGB data shown on a 8-bit or other bit display. Dither methods and image processors are provided which generate the banding artifact free image data during this process. Some methods and image processors may applying a stronger dither having a same mean with a larger variance to the image data before it is converted to RGB data. Others methods and image processors may calculate a quantization or encoding error and diffuse the calculated error among one or more neighboring pixel blocks.

Abstract translation: YCbCr图像数据可以抖动并转换成8位或其他位显示器上显示的RGB数据。 提供抖动方法和图像处理器，其在该处理期间产生无带纹带图像数据。 一些方法和图像处理器可以在将图像数据转换成RGB数据之前，对图像数据应用具有相同平均值的较强抖动。 其他方法和图像处理器可以计算量化或编码误差并且在一个或多个相邻像素块之间扩展所计算的误差。

公开(公告)号：US08683301B2

公开(公告)日：2014-03-25

申请号：US13785859

申请日：2013-03-05

Applicant: Apple Inc.

Inventor： Xiaosong Zhou ,  Hyeonkuk Jeong ,  Yan Yang ,  Dazhong Zhang ,  Hsi-Jung Wu

IPC: H03M13/00

CPC classification number: H03M13/05 ,  H03M13/1102 ,  H03M13/1515 ,  H03M13/152 ,  H03M13/27 ,  H03M13/29 ,  H03M13/2957 ,  H03M13/373 ,  H03M13/3746 ,  H04L1/005 ,  H04L1/0057 ,  H04L1/008

Abstract: Coded video data may be transmitted between an encoder and a decoder using multiple FEC codes and/or packets for error detection and correction. Only a subset of the FEC packets need be transmitted between the encoder and decoder. The FEC packets of each FEC group may take, as inputs, data packets of a current FEC group and also an untransmitted FEC packet of a preceding FEC group. Due to relationships among the FEC packets, when transmission errors arise and data packets are lost, there remain opportunities for a decoder to recover lost data packets from earlier-received FEC groups when later-received FEC groups are decoded. This opportunity to recover data packets from earlier FEC groups may be useful in video coding and other systems, in which later-received data often cannot be decoded unless earlier-received data is decoded properly.

Abstract translation: 可以在编码器和解码器之间使用多个用于错误检测和校正的FEC码和/或包进行编码的视频数据。 只有FEC数据包的一部分需要在编码器和解码器之间传输。 每个FEC组的FEC分组可以采用当前FEC组的数据分组和前一个FEC组的未发送FEC分组的输入。 由于FEC分组之间的关系，当传输错误出现并且数据分组丢失时，当稍后接收的FEC组被解码时，解码器仍然有机会恢复来自早先接收的FEC组的丢失的数据分组。 从先前的FEC组恢复数据分组的机会在视频编码和其他系统中可能是有用的，其中后期接收的数据通常不能被解码，除非先前接收到的数据被正确解码。