公开(公告)号：US09491487B2

公开(公告)日：2016-11-08

申请号：US13626730

申请日：2012-09-25

Applicant: Apple Inc.

Inventor： Dazhong Zhang ,  Xiaosong Zhou ,  Hsi-Jung Wu

IPC: H04N19/68 ,  H04N19/91 ,  H04N19/172 ,  H04N19/65 ,  H04N19/103 ,  H04N19/57 ,  H04N19/109 ,  H04N19/166 ,  H04N19/13 ,  H04N19/174 ,  H04N19/573 ,  H04N19/58

CPC classification number: H04N19/68 ,  H04N19/103 ,  H04N19/109 ,  H04N19/13 ,  H04N19/166 ,  H04N19/172 ,  H04N19/174 ,  H04N19/57 ,  H04N19/573 ,  H04N19/58 ,  H04N19/65 ,  H04N19/91

Abstract: Coding techniques for input video may include assigning picture identifiers to input frames in either long-form or short-form formats. If a network error has occurred that results in loss of previously-coded video data, a new input frame may be assigned a picture identifier that is coded in a long-form coding format. If no network error has occurred, the input frame may be assigned a picture identifier that is coded in a short-form coding format. Long-form coding may mitigate against loss of synchronization between an encoder and a decoder by picture identifiers.

Abstract translation: 用于输入视频的编码技术可以包括将图像标识符分配给长格式或短格式格式的输入帧。 如果发生导致先前编码的视频数据丢失的网络错误，则可以为新的输入帧分配以长格式编码格式编码的图像标识符。 如果没有发生网络错误，则可以为输入帧分配以短格式编码格式编码的图像标识符。 长格式编码可以通过图像标识符减轻编码器和解码器之间的同步丢失。

公开(公告)号：US09264737B2

公开(公告)日：2016-02-16

申请号：US13632913

申请日：2012-10-01

Applicant: Apple Inc.

Inventor： Xiaosong Zhou ,  Hsi-Jung Wu

IPC: H04N19/65 ,  H04N19/67 ,  H04N19/44 ,  H04N19/895

CPC classification number: H04N19/65 ,  H04N19/44 ,  H04N19/67 ,  H04N19/895

Abstract: Error mitigation techniques are provided for video coding system in which input frames are selected for coding either as a Random Access Pictures (“RAP frames”) or as a non-RAP frame. Coded RAP frames may include RAP identifiers that set an ID context for subsequent frames. Coded non-RAP frames may include RAP identifiers that match the RAP identifiers that were included in the coded RAP frames. Thus, in the absence of transmission errors, a coded non-RAP frame should include a RAP identifier that matches the identifier of the preceding RAP frame. If the identifier of a non-RAP frame does not match the identifier of the RAP frame that immediately preceded it, then it indicates that a RAP frame was lost during transmission. In this case, the decoder may engage error recovery processes.

Abstract translation: 为视频编码系统提供误差减轻技术，其中输入帧被选择用于编码为随机接入图像（“RAP帧”）或作为非RAP帧。 编码的RAP帧可以包括为后续帧设置ID上下文的RAP标识符。 编码的非RAP帧可以包括与包括在经编码的RAP帧中的RAP标识符匹配的RAP标识符。 因此，在没有传输错误的情况下，编码的非RAP帧应该包括与前一个RAP帧的标识符匹配的RAP标识符。 如果非RAP帧的标识符与其之前的RAP帧的标识符不匹配，则表示在传输期间RAP帧丢失。 在这种情况下，解码器可以进行错误恢复处理。

公开(公告)号：US09232188B2

公开(公告)日：2016-01-05

申请号：US14296354

申请日：2014-06-04

Applicant: Apple Inc.

Inventor： Xiaosong Zhou ,  Hsi-Jung Wu ,  Chris Y. Chung ,  James O. Normile ,  Joe S. Abuan ,  Hyeonkuk Jeong ,  Yan Yang ,  Gobind Johar ,  Thomas Jansen

IPC: H04N7/14 ,  H04M1/56 ,  H04M15/06 ,  H04N7/15

CPC classification number: H04N7/15 ,  H04L12/1818 ,  H04L51/04 ,  H04L51/046 ,  H04L51/10 ,  H04L65/1089 ,  H04L65/403 ,  H04N7/147

Abstract: Computing devices may implement dynamic transitions from video messages to video communications. Video communication data for a video message may be received at a recipient device. The video communication data may be displayed as it is received, and recorded for subsequent playback. An indication of a selection to establish a video communication with the sender of the video message may be received, or an indication that display of the video communication is to be ceased may be received. If a video communication is to be established, then a video communication connection with the sender of the video message may be created so that subsequent video communication data may be sent via the established connection.

Abstract translation: 计算设备可以实现从视频消息到视频通信的动态转换。 用于视频消息的视频通信数据可以在接收设备处被接收。 视频通信数据可以在它被接收时被显示，并被记录以用于随后的重放。 可以接收到与视频消息的发送者建立视频通信的选择的指示，或者可以接收到要停止视频通信的显示的指示。 如果要建立视频通信，则可以创建与视频消息的发送者的视频通信连接，以便可以经由建立的连接发送后续的视频通信数据。

公开(公告)号：US09232187B2

公开(公告)日：2016-01-05

申请号：US14296349

申请日：2014-06-04

Applicant: Apple Inc.

Inventor： Xiaosong Zhou ,  Hsi-Jung Wu ,  Chris Y. Chung ,  James O. Normile ,  Joe S. Abuan ,  Hyeonkuk Jeong ,  Yan Yang ,  Gobind Johar ,  Thomas Jansen

IPC: H04M7/14 ,  H04N7/15

CPC classification number: H04N7/15 ,  H04N7/147

Abstract: Computing devices may implement dynamic detection of pause and resume for video communications. Video communication data may be capture at a participant device in a video communication. The video communication data may be evaluated to detect a pause or resume event for the transmission of the video communication data. Various types of video, audio, and other sensor analysis may be used to detect when a pause event or a resume event may be triggered. For triggered pause events, at least some of the video communication data may no longer be transmitted as part of the video communication. For triggered resume events, a pause state may cease and all of the video communication data may be transmitted.

Abstract translation: 计算设备可以实现视频通信的暂停和恢复的动态检测。 可以在视频通信中的参与者设备处捕获视频通信数据。 可以评估视频通信数据以检测用于传输视频通信数据的暂停或恢复事件。 可以使用各种类型的视频，音频和其他传感器分析来检测何时可以触发暂停事件或恢复事件。 对于触发暂停事件，视频通信数据中的至少一些可能不再作为视频通信的一部分被发送。 对于触发的恢复事件，可以停止暂停状态，并且可以发送所有的视频通信数据。

公开(公告)号：US20150350650A1

公开(公告)日：2015-12-03

申请号：US14726365

申请日：2015-05-29

Applicant: Apple Inc.

Inventor： Jae Hoon Kim ,  Chris Y. Chung ,  Hsi-Jung Wu ,  Dazhong Zhang ,  Yunfei Zheng ,  Xiaosong Zhou

IPC: H04N19/129 ,  H04N19/186 ,  H04N19/184 ,  H04N19/136

CPC classification number: H04N19/129 ,  H04N19/117 ,  H04N19/136 ,  H04N19/176 ,  H04N19/184 ,  H04N19/186 ,  H04N19/46 ,  H04N19/70 ,  H04N19/82 ,  H04N19/86

Abstract: Methods and systems provide efficient sample adaptive offset (SAO) signaling by reducing a number of bits consumed for signaling SAO compared with conventional methods. In an embodiment, a single flag is used if a coding unit to a first scanning direction with respect to a given coding unit is off. In an embodiment, further bits may be saved if some neighboring coding units are not present, i.e. the given coding unit is an edge. For example, a flag may be skipped, e.g., not signaled, if the given coding unit does not have a neighbor. In an embodiment, a syntax element, one or more flags may signal whether SAO filtering is performed in a coding unit. Based on the syntax element, a merge flag may be skipped to save bits. In an embodiment, SAO syntax may be signaled at a slice level.

Abstract translation: 方法和系统通过减少与常规方法相比信号SAO消耗的比特数来提供有效的采样自适应偏移（SAO）信令。 在一个实施例中，如果关于给定编码单元的第一扫描方向的编码单元关闭，则使用单个标志。 在一个实施例中，如果一些相邻编码单元不存在，即给定的编码单元是边缘，则可以节省进一步的比特。 例如，如果给定的编码单元不具有邻居，则可以跳过标志，例如，不发信号通知。 在一个实施例中，语法元素，一个或多个标志可以发信号通知是否在编码单元中执行SAO滤波。 基于语法元素，可以跳过合并标志来保存位。 在一个实施例中，可以在切片级别发信号通知SAO语法。

公开(公告)号：US09125138B2

公开(公告)日：2015-09-01

申请号：US13663005

申请日：2012-10-29

Applicant: Apple Inc.

Inventor： Joe S. Abuan ,  Xiaosong Zhou ,  Sundararaman V. Shiva ,  Hsi-Jung Wu ,  Yan Yang ,  Hyeonkuk Jeong ,  James O. Normile ,  Chris Y. Chung ,  Roberto Garcia ,  Thomas C. Jansen

IPC: H04W40/00 ,  H04W40/12 ,  H04N7/14 ,  H04L12/725 ,  H04W72/04 ,  H04W40/06 ,  H04L12/721

CPC classification number: H04W40/12 ,  H04L45/306 ,  H04L45/70 ,  H04N7/14 ,  H04W40/06 ,  H04W72/046 ,  Y02D70/1242 ,  Y02D70/1262 ,  Y02D70/142 ,  Y02D70/144 ,  Y02D70/146 ,  Y02D70/164 ,  Y02D70/322 ,  Y02D70/34

Abstract: A wireless device described herein can use information on data flow, in addition to indications from the physical network, to decide on suitable bandwidth usage for audio and video information. This data flow information is further used to determine an efficient network route to use for high-quality reception and transmission of audio and video data, as well as the appropriate time to switch between available network routes to improve bandwidth performance.

Abstract translation: 除了来自物理网络的指示之外，这里描述的无线设备可以使用关于数据流的信息来决定音频和视频信息的适当带宽使用。 该数据流信息还用于确定用于音频和视频数据的高质量接收和传输的有效网络路由，以及在可用网络路由之间切换以提高带宽性能的适当时间。

公开(公告)号：US09055185B2

公开(公告)日：2015-06-09

申请号：US13889261

申请日：2013-05-07

Applicant: Apple Inc.

Inventor： Joe S. Abuan ,  David A. Eldred ,  Hyeonkuk Jeong ,  Roberto Garcia, Jr. ,  Hsi-Jung Wu ,  Xiaosong Zhou ,  Elizabeth C. Cranfill ,  James O. Normile

IPC: H04N7/14 ,  H04N7/15 ,  G06F3/0484

CPC classification number: H04N7/141 ,  G06F3/04817 ,  G06F3/04842 ,  G06F3/04886 ,  G06F9/451 ,  G09G5/14 ,  H04M1/72583 ,  H04N5/2258 ,  H04N5/2624 ,  H04N5/272 ,  H04N7/147 ,  H04N7/15

Abstract: Some embodiments provide a method for conducting a video conference between a first mobile device and a second device. The first mobile device includes first and second cameras. The method selects the first camera for capturing images. The method transmits images captured by the first camera to the second device. The method receives selections of the second camera for capturing images during the video conference. The method terminates the transmission of images captured by the first camera and transmits images captured by the second camera of the first mobile device to the second device during the video conference.

Abstract translation: 一些实施例提供了一种用于在第一移动设备和第二设备之间进行视频会议的方法。 第一移动设备包括第一和第二相机。 该方法选择用于捕获图像的第一相机。 该方法将由第一相机拍摄的图像发送到第二设备。 该方法在视频会议期间接收用于捕获图像的第二相机的选择。 该方法终止由第一相机拍摄的图像的传输，并且在视频会议期间将由第一移动设备的第二相机拍摄的图像发送到第二设备。

公开(公告)号：US20150016804A1

公开(公告)日：2015-01-15

申请号：US13941174

申请日：2013-07-12

Applicant: Apple Inc.

Inventor： David L. Biderman ,  Xiaosong Zhou ,  Douglas Scott Price ,  Yeping Su ,  Chris Y. Chung ,  Hsi-Jung Wu ,  Zhenheng Li ,  John Su ,  James D. Batson

IPC: G11B27/30 ,  G11B27/00

CPC classification number: H04N21/6125 ,  G06K9/00718 ,  G06K2009/00738 ,  G11B27/005 ,  G11B27/3081 ,  H04N21/262 ,  H04N21/440281 ,  H04N21/6587 ,  H04N21/8456

Abstract: System and methods for improved playback of a video stream are presented. Video snippets are identified that include a number of consecutive frames for playback. Snippets may be evenly temporally spaced in the video stream or may be content adaptive. Then the first frame of a snippet may be selected as the first frame of a scene or other appropriate stopping point. Scene detection, object detection, motion detection, video metadata, or other information generated during encoding or decoding of the video stream may aid in appropriate snippet selection.

Abstract translation: 介绍了改进视频流播放的系统和方法。 识别包括多个连续帧进行播放的视频片段。 片段可以在视频流中均匀地间隔开，或者可以是内容自适应的。 然后，片段的第一帧可以被选择为场景或其他适当停止点的第一帧。 在视频流的编码或解码过程中产生的场景检测，对象检测，运动检测，视频元数据或其他信息可能有助于适当的片段选择。

公开(公告)号：US20140362162A1

公开(公告)日：2014-12-11

申请号：US14465584

申请日：2014-08-21

Applicant: Apple Inc.

Inventor： Chris Y. Chung ,  Wen Zhao ,  Luciano M. Verger ,  Hyeonkuk Jeong ,  Gang Lu ,  Srinivasan Vasudevan ,  Xiaosong Zhou ,  Hsi-Jung Wu ,  James O. Normile

IPC: H04W52/02 ,  H04N7/15

CPC classification number: H04N7/15 ,  H04L12/1827 ,  H04L65/1069 ,  H04N5/23241 ,  H04N5/372 ,  H04W52/02 ,  H04W52/0209 ,  H04W52/0216 ,  Y02D70/00 ,  Y02D70/1224 ,  Y02D70/1242 ,  Y02D70/1262 ,  Y02D70/142 ,  Y02D70/144 ,  Y02D70/146 ,  Y02D70/164 ,  Y02D70/168 ,  Y02D70/24

Abstract: In video conferencing over a radio network, the radio equipment is a major power consumer especially in cellular networks such as LTE. In order to reduce the radio power consumption in video conferencing, it is important to introduce an enough radio inactive time. Several types of data buffering and bundling can be employed within a reasonable range of latency that doesn't significantly disrupt the real-time nature of video conferencing. In addition, the data transmission can be synchronized to the data reception in a controlled manner, which can result in an even longer radio inactive time and thus take advantage of radio power saving modes such as LTE C-DRX.

公开(公告)号：US20140362159A1

公开(公告)日：2014-12-11

申请号：US14082852

申请日：2013-11-18

Applicant: Apple Inc.

Inventor： Jiefu Zhai ,  Chris Y. Chung ,  Xiaosong Zhou ,  Hsi-Jung Wu

IPC: H04N7/14

CPC classification number: H04N7/141 ,  H04N19/117

Abstract: A system may include a receiver, a decoder, a post-processor, and a controller. The receiver may receive encoded video data. The decoder may decode the encoded video data. The post-processor may perform post-processing on frames of decoded video sequence from the decoder. The controller may adjust post-processing of a current frame, based upon at least one condition parameters detected at the system.

Abstract translation: 系统可以包括接收器，解码器，后处理器和控制器。 接收机可以接收编码的视频数据。 解码器可以解码编码的视频数据。 后处理器可以对来自解码器的解码视频序列的帧执行后处理。 控制器可以基于在系统处检测到的至少一个条件参数来调整当前帧的后处理。