公开(公告)号：US09491487B2

公开(公告)日：2016-11-08

申请号：US13626730

申请日：2012-09-25

Applicant: Apple Inc.

Inventor： Dazhong Zhang ,  Xiaosong Zhou ,  Hsi-Jung Wu

IPC: H04N19/68 ,  H04N19/91 ,  H04N19/172 ,  H04N19/65 ,  H04N19/103 ,  H04N19/57 ,  H04N19/109 ,  H04N19/166 ,  H04N19/13 ,  H04N19/174 ,  H04N19/573 ,  H04N19/58

CPC classification number: H04N19/68 ,  H04N19/103 ,  H04N19/109 ,  H04N19/13 ,  H04N19/166 ,  H04N19/172 ,  H04N19/174 ,  H04N19/57 ,  H04N19/573 ,  H04N19/58 ,  H04N19/65 ,  H04N19/91

Abstract: Coding techniques for input video may include assigning picture identifiers to input frames in either long-form or short-form formats. If a network error has occurred that results in loss of previously-coded video data, a new input frame may be assigned a picture identifier that is coded in a long-form coding format. If no network error has occurred, the input frame may be assigned a picture identifier that is coded in a short-form coding format. Long-form coding may mitigate against loss of synchronization between an encoder and a decoder by picture identifiers.

Abstract translation: 用于输入视频的编码技术可以包括将图像标识符分配给长格式或短格式格式的输入帧。 如果发生导致先前编码的视频数据丢失的网络错误，则可以为新的输入帧分配以长格式编码格式编码的图像标识符。 如果没有发生网络错误，则可以为输入帧分配以短格式编码格式编码的图像标识符。 长格式编码可以通过图像标识符减轻编码器和解码器之间的同步丢失。

公开(公告)号：US09264737B2

公开(公告)日：2016-02-16

申请号：US13632913

申请日：2012-10-01

Applicant: Apple Inc.

Inventor： Xiaosong Zhou ,  Hsi-Jung Wu

IPC: H04N19/65 ,  H04N19/67 ,  H04N19/44 ,  H04N19/895

CPC classification number: H04N19/65 ,  H04N19/44 ,  H04N19/67 ,  H04N19/895

Abstract: Error mitigation techniques are provided for video coding system in which input frames are selected for coding either as a Random Access Pictures (“RAP frames”) or as a non-RAP frame. Coded RAP frames may include RAP identifiers that set an ID context for subsequent frames. Coded non-RAP frames may include RAP identifiers that match the RAP identifiers that were included in the coded RAP frames. Thus, in the absence of transmission errors, a coded non-RAP frame should include a RAP identifier that matches the identifier of the preceding RAP frame. If the identifier of a non-RAP frame does not match the identifier of the RAP frame that immediately preceded it, then it indicates that a RAP frame was lost during transmission. In this case, the decoder may engage error recovery processes.

Abstract translation: 为视频编码系统提供误差减轻技术，其中输入帧被选择用于编码为随机接入图像（“RAP帧”）或作为非RAP帧。 编码的RAP帧可以包括为后续帧设置ID上下文的RAP标识符。 编码的非RAP帧可以包括与包括在经编码的RAP帧中的RAP标识符匹配的RAP标识符。 因此，在没有传输错误的情况下，编码的非RAP帧应该包括与前一个RAP帧的标识符匹配的RAP标识符。 如果非RAP帧的标识符与其之前的RAP帧的标识符不匹配，则表示在传输期间RAP帧丢失。 在这种情况下，解码器可以进行错误恢复处理。

公开(公告)号：US09232188B2

公开(公告)日：2016-01-05

申请号：US14296354

申请日：2014-06-04

Applicant: Apple Inc.

Inventor： Xiaosong Zhou ,  Hsi-Jung Wu ,  Chris Y. Chung ,  James O. Normile ,  Joe S. Abuan ,  Hyeonkuk Jeong ,  Yan Yang ,  Gobind Johar ,  Thomas Jansen

IPC: H04N7/14 ,  H04M1/56 ,  H04M15/06 ,  H04N7/15

CPC classification number: H04N7/15 ,  H04L12/1818 ,  H04L51/04 ,  H04L51/046 ,  H04L51/10 ,  H04L65/1089 ,  H04L65/403 ,  H04N7/147

Abstract: Computing devices may implement dynamic transitions from video messages to video communications. Video communication data for a video message may be received at a recipient device. The video communication data may be displayed as it is received, and recorded for subsequent playback. An indication of a selection to establish a video communication with the sender of the video message may be received, or an indication that display of the video communication is to be ceased may be received. If a video communication is to be established, then a video communication connection with the sender of the video message may be created so that subsequent video communication data may be sent via the established connection.

Abstract translation: 计算设备可以实现从视频消息到视频通信的动态转换。 用于视频消息的视频通信数据可以在接收设备处被接收。 视频通信数据可以在它被接收时被显示，并被记录以用于随后的重放。 可以接收到与视频消息的发送者建立视频通信的选择的指示，或者可以接收到要停止视频通信的显示的指示。 如果要建立视频通信，则可以创建与视频消息的发送者的视频通信连接，以便可以经由建立的连接发送后续的视频通信数据。

公开(公告)号：US09232187B2

公开(公告)日：2016-01-05

申请号：US14296349

申请日：2014-06-04

Applicant: Apple Inc.

Inventor： Xiaosong Zhou ,  Hsi-Jung Wu ,  Chris Y. Chung ,  James O. Normile ,  Joe S. Abuan ,  Hyeonkuk Jeong ,  Yan Yang ,  Gobind Johar ,  Thomas Jansen

IPC: H04M7/14 ,  H04N7/15

CPC classification number: H04N7/15 ,  H04N7/147

Abstract: Computing devices may implement dynamic detection of pause and resume for video communications. Video communication data may be capture at a participant device in a video communication. The video communication data may be evaluated to detect a pause or resume event for the transmission of the video communication data. Various types of video, audio, and other sensor analysis may be used to detect when a pause event or a resume event may be triggered. For triggered pause events, at least some of the video communication data may no longer be transmitted as part of the video communication. For triggered resume events, a pause state may cease and all of the video communication data may be transmitted.

Abstract translation: 计算设备可以实现视频通信的暂停和恢复的动态检测。 可以在视频通信中的参与者设备处捕获视频通信数据。 可以评估视频通信数据以检测用于传输视频通信数据的暂停或恢复事件。 可以使用各种类型的视频，音频和其他传感器分析来检测何时可以触发暂停事件或恢复事件。 对于触发暂停事件，视频通信数据中的至少一些可能不再作为视频通信的一部分被发送。 对于触发的恢复事件，可以停止暂停状态，并且可以发送所有的视频通信数据。

公开(公告)号：US20150350650A1

公开(公告)日：2015-12-03

申请号：US14726365

申请日：2015-05-29

Applicant: Apple Inc.

Inventor： Jae Hoon Kim ,  Chris Y. Chung ,  Hsi-Jung Wu ,  Dazhong Zhang ,  Yunfei Zheng ,  Xiaosong Zhou

IPC: H04N19/129 ,  H04N19/186 ,  H04N19/184 ,  H04N19/136

CPC classification number: H04N19/129 ,  H04N19/117 ,  H04N19/136 ,  H04N19/176 ,  H04N19/184 ,  H04N19/186 ,  H04N19/46 ,  H04N19/70 ,  H04N19/82 ,  H04N19/86

Abstract: Methods and systems provide efficient sample adaptive offset (SAO) signaling by reducing a number of bits consumed for signaling SAO compared with conventional methods. In an embodiment, a single flag is used if a coding unit to a first scanning direction with respect to a given coding unit is off. In an embodiment, further bits may be saved if some neighboring coding units are not present, i.e. the given coding unit is an edge. For example, a flag may be skipped, e.g., not signaled, if the given coding unit does not have a neighbor. In an embodiment, a syntax element, one or more flags may signal whether SAO filtering is performed in a coding unit. Based on the syntax element, a merge flag may be skipped to save bits. In an embodiment, SAO syntax may be signaled at a slice level.

Abstract translation: 方法和系统通过减少与常规方法相比信号SAO消耗的比特数来提供有效的采样自适应偏移（SAO）信令。 在一个实施例中，如果关于给定编码单元的第一扫描方向的编码单元关闭，则使用单个标志。 在一个实施例中，如果一些相邻编码单元不存在，即给定的编码单元是边缘，则可以节省进一步的比特。 例如，如果给定的编码单元不具有邻居，则可以跳过标志，例如，不发信号通知。 在一个实施例中，语法元素，一个或多个标志可以发信号通知是否在编码单元中执行SAO滤波。 基于语法元素，可以跳过合并标志来保存位。 在一个实施例中，可以在切片级别发信号通知SAO语法。

公开(公告)号：US20150334397A1

公开(公告)日：2015-11-19

申请号：US14814446

申请日：2015-07-30

Applicant: Apple Inc.

Inventor： Thomas Pun ,  Roger Kumar ,  Xiaochun Nie ,  Hsi-Jung Wu

IPC: H04N19/126 ,  H04N19/146 ,  H04N19/625 ,  H04N19/176 ,  H04N19/61

CPC classification number: H04N19/126 ,  H04N19/146 ,  H04N19/149 ,  H04N19/176 ,  H04N19/196 ,  H04N19/197 ,  H04N19/61 ,  H04N19/625

Abstract: Method For Implementing A Quantizer In A Multimedia Compression And Encoding System is disclosed. In the Quantizer system of the present invention, several new quantization ideas are disclosed. In one embodiment, adjacent macroblocks are grouped together into macroblock groups. The macroblock groups are then assigned a common quantizer value. The common quantizer value may be selected based upon how the macroblocks are encoded, the type of macroblocks within the macroblock group (intra-blocks or inter-blocks), the history of the motion vectors associated with the macroblocks in the macroblock group, the residuals of the macroblocks in the macroblock group, and the energy of the macroblocks in the macroblock group. The quantizer value may be adjusted in a manner that is dependent on the current quantizer value. Specifically, if the quantizer value is at the low end of the quantizer scale, then only small adjustments are made. If the quantizer value is at the high end then larger adjustments may be made to the quantizer. Finally, in one embodiment, the quantizer is implemented along with an inverse quantizer for efficient operation.

Abstract translation: 公开了一种在多媒体压缩和编码系统中实现量化器的方法。 在本发明的量化器系统中，公开了几种新的量化思想。 在一个实施例中，相邻宏块被分组在一起成为宏块组。 然后向宏块组分配一个公共量化器值。 可以基于宏块如何编码，宏块组（块内或块内）中的宏块的类型，与宏块组中的宏块相关联的运动向量的历史来选择公共量化器值，残差 的宏块组中的宏块的能量，以及宏块组中的宏块的能量。 可以以取决于当前量化器值的方式来调整量化器值。 具体地，如果量化器值处于量化器标尺的低端，则仅进行小的调整。 如果量化器值处于高端，则可以对量化器进行较大的调整。 最后，在一个实施例中，量化器与用于有效操作的逆量化器一起被实现。

公开(公告)号：US09125138B2

公开(公告)日：2015-09-01

申请号：US13663005

申请日：2012-10-29

Applicant: Apple Inc.

Inventor： Joe S. Abuan ,  Xiaosong Zhou ,  Sundararaman V. Shiva ,  Hsi-Jung Wu ,  Yan Yang ,  Hyeonkuk Jeong ,  James O. Normile ,  Chris Y. Chung ,  Roberto Garcia ,  Thomas C. Jansen

IPC: H04W40/00 ,  H04W40/12 ,  H04N7/14 ,  H04L12/725 ,  H04W72/04 ,  H04W40/06 ,  H04L12/721

CPC classification number: H04W40/12 ,  H04L45/306 ,  H04L45/70 ,  H04N7/14 ,  H04W40/06 ,  H04W72/046 ,  Y02D70/1242 ,  Y02D70/1262 ,  Y02D70/142 ,  Y02D70/144 ,  Y02D70/146 ,  Y02D70/164 ,  Y02D70/322 ,  Y02D70/34

Abstract: A wireless device described herein can use information on data flow, in addition to indications from the physical network, to decide on suitable bandwidth usage for audio and video information. This data flow information is further used to determine an efficient network route to use for high-quality reception and transmission of audio and video data, as well as the appropriate time to switch between available network routes to improve bandwidth performance.

Abstract translation: 除了来自物理网络的指示之外，这里描述的无线设备可以使用关于数据流的信息来决定音频和视频信息的适当带宽使用。 该数据流信息还用于确定用于音频和视频数据的高质量接收和传输的有效网络路由，以及在可用网络路由之间切换以提高带宽性能的适当时间。

公开(公告)号：US09055185B2

公开(公告)日：2015-06-09

申请号：US13889261

申请日：2013-05-07

Applicant: Apple Inc.

Inventor： Joe S. Abuan ,  David A. Eldred ,  Hyeonkuk Jeong ,  Roberto Garcia, Jr. ,  Hsi-Jung Wu ,  Xiaosong Zhou ,  Elizabeth C. Cranfill ,  James O. Normile

IPC: H04N7/14 ,  H04N7/15 ,  G06F3/0484

CPC classification number: H04N7/141 ,  G06F3/04817 ,  G06F3/04842 ,  G06F3/04886 ,  G06F9/451 ,  G09G5/14 ,  H04M1/72583 ,  H04N5/2258 ,  H04N5/2624 ,  H04N5/272 ,  H04N7/147 ,  H04N7/15

Abstract: Some embodiments provide a method for conducting a video conference between a first mobile device and a second device. The first mobile device includes first and second cameras. The method selects the first camera for capturing images. The method transmits images captured by the first camera to the second device. The method receives selections of the second camera for capturing images during the video conference. The method terminates the transmission of images captured by the first camera and transmits images captured by the second camera of the first mobile device to the second device during the video conference.

Abstract translation: 一些实施例提供了一种用于在第一移动设备和第二设备之间进行视频会议的方法。 第一移动设备包括第一和第二相机。 该方法选择用于捕获图像的第一相机。 该方法将由第一相机拍摄的图像发送到第二设备。 该方法在视频会议期间接收用于捕获图像的第二相机的选择。 该方法终止由第一相机拍摄的图像的传输，并且在视频会议期间将由第一移动设备的第二相机拍摄的图像发送到第二设备。

公开(公告)号：US20150131712A1

公开(公告)日：2015-05-14

申请号：US14599285

申请日：2015-01-16

Applicant: Apple Inc.

Inventor： Barin Geoffry Haskell ,  David William Singer ,  Thomas Pun ,  Hsi-Jung Wu ,  James Oliver Normile

IPC: H04N19/30

CPC classification number: H04N19/30 ,  H04N19/132 ,  H04N19/187 ,  H04N19/196 ,  H04N19/33 ,  H04N19/46 ,  H04N19/61 ,  H04N21/234327 ,  H04N21/2389 ,  H04N21/2662 ,  H04N21/4385 ,  H04N21/64792 ,  H04N21/6582 ,  H04N21/8451

Abstract: Scalable video coding and multiplexing compatible with non-scalable decoders is disclosed. In some embodiments, video data is received and encoded in a manner that renders at least a base layer to be compatible with a non-scalable video encoding standard, including by assigning for at least the base layer default values to one or more scalability parameters. In some embodiments, video data is received and encoded to produce an encoded video data that includes a base layer that conforms to a non-scalable video encoding standard and one or more subordinate non-scalable layers, which subordinate non-scalable layers do not by themselves conform to the non-scalable video encoding standard but which can he combined with the base layer to produce a result that does conform to the non-scalable video encoding standard, such that the result can be decoded by a non-scalable decoder. An identification data identifying those portions of the encoded video data that are associated with a subordinate non-scalable layer is included in the encoded video data.

Abstract translation: 公开了与不可扩展解码器兼容的可扩展视频编码和复用。 在一些实施例中，视频数据以使至少基本层与不可扩展视频编码标准兼容的方式被接收和编码，包括通过将至少基本层默认值分配给一个或多个可伸缩性参数。 在一些实施例中，视频数据被接收和编码以产生编码的视频数据，该编码视频数据包括符合不可分级视频编码标准的基本层和一个或多个从属非可缩放层，其中不可扩展层不由 它们符合不可扩展视频编码标准，但是它可以与基本层组合以产生符合非可分级视频编码标准的结果，使得结果可以由不可扩展解码器解码。 识别与下级不可缩放层相关联的编码视频数据部分的识别数据被包括在编码视频数据中。

公开(公告)号：US20150016804A1

公开(公告)日：2015-01-15

申请号：US13941174

申请日：2013-07-12

Applicant: Apple Inc.

Inventor： David L. Biderman ,  Xiaosong Zhou ,  Douglas Scott Price ,  Yeping Su ,  Chris Y. Chung ,  Hsi-Jung Wu ,  Zhenheng Li ,  John Su ,  James D. Batson

IPC: G11B27/30 ,  G11B27/00

CPC classification number: H04N21/6125 ,  G06K9/00718 ,  G06K2009/00738 ,  G11B27/005 ,  G11B27/3081 ,  H04N21/262 ,  H04N21/440281 ,  H04N21/6587 ,  H04N21/8456

Abstract: System and methods for improved playback of a video stream are presented. Video snippets are identified that include a number of consecutive frames for playback. Snippets may be evenly temporally spaced in the video stream or may be content adaptive. Then the first frame of a snippet may be selected as the first frame of a scene or other appropriate stopping point. Scene detection, object detection, motion detection, video metadata, or other information generated during encoding or decoding of the video stream may aid in appropriate snippet selection.

Abstract translation: 介绍了改进视频流播放的系统和方法。 识别包括多个连续帧进行播放的视频片段。 片段可以在视频流中均匀地间隔开，或者可以是内容自适应的。 然后，片段的第一帧可以被选择为场景或其他适当停止点的第一帧。 在视频流的编码或解码过程中产生的场景检测，对象检测，运动检测，视频元数据或其他信息可能有助于适当的片段选择。