公开(公告)号：US20170085836A1

公开(公告)日：2017-03-23

申请号：US15368371

申请日：2016-12-02

Applicant: Apple Inc.

Inventor： Xiaosong Zhou ,  Hsi-Jung Wu ,  Chris Y. Chung ,  James O. Normile ,  Joe S. Abuan ,  Hyeonkuk Jeong ,  Yan Yang ,  Gobind Johar ,  Thomas Jansen

IPC: H04N7/14 ,  H04L12/58 ,  H04L29/06 ,  H04N7/15

CPC classification number: H04N7/147 ,  H04L51/04 ,  H04L51/10 ,  H04L65/1069 ,  H04N7/15

Abstract: Computing devices may implement instant video communication connections for video communications. Connection information for mobile computing devices may be maintained. A request to initiate an instant video communication may be received, and if authorized, the connection information for the particular recipient mobile computing device may be accessed. Video communication data may then be sent to the recipient mobile computing device according to the connection information so that the video communication data may be displayed at the recipient device as it is received. New connection information for different mobile computing devices may be added, or updates to existing connection information may also be performed. Connection information for some mobile computing devices may be removed.

公开(公告)号：US20160360219A1

公开(公告)日：2016-12-08

申请号：US14732615

申请日：2015-06-05

Applicant: Apple Inc.

Inventor： Feng Yi ,  Yeping Su ,  Chris Y. Chung ,  Hsi-Jung Wu ,  Xiaosong Zhou

IPC: H04N19/50 ,  H04N19/61

CPC classification number: H04N19/105 ,  H04N19/107 ,  H04N19/124 ,  H04N19/157 ,  H04N19/172

Abstract: Methods and systems provide video compression to reduce a “popping” effect caused by differences in quality between a refresh frame (e.g., I-frame or IDR-frame) and neighboring frame(s). In an embodiment, a quality of a pre-definable number of frames preceding a refresh frame (“preceding frames”) may be increased. A quantization parameter may be decreased for a region within at least one of the preceding frame(s). In an embodiment, preceding frames may be coded according to an open group of pictures (“GOP”) structure. In an embodiment, a refresh frame may be first coded as a P-frame, then coded based on the coded P-frame. In an embodiment, preceding frames may be first coded based on the refresh frame, then coded based on the coded frames without referencing the refresh frame. Each of these methods may increase consistency of quality in a sequence of frames, and, correspondingly, minimize or remove I-frame popping.

Abstract translation: 方法和系统提供视频压缩以减少由刷新帧（例如，I帧或IDR帧）与相邻帧之间的质量差引起的“弹出”效应。 在一个实施例中，可以增加在刷新帧（“前一帧”）之前的可预定数量的帧的质量。 可以针对前一帧中的至少一个中的区域减小量化参数。 在一个实施例中，可以根据打开的图像组（“GOP”）结构对前面的帧进行编码。 在一个实施例中，可以将刷新帧首先编码为P帧，然后基于编码的P帧进行编码。 在一个实施例中，先前的帧可以基于刷新帧进行首先编码，然后基于编码的帧进行编码，而不参考刷新帧。 这些方法中的每一种可以增加帧序列中的质量的一致性，并且相应地最小化或去除I帧弹出。

公开(公告)号：US09516269B2

公开(公告)日：2016-12-06

申请号：US14296356

申请日：2014-06-04

Applicant: Apple Inc.

Inventor： Xiaosong Zhou ,  Hsi-Jung Wu ,  Chris Y. Chung ,  James O. Normile ,  Joe S. Abuan ,  Hyeonkuk Jeong ,  Yan Yang ,  Gobind Johar ,  Thomas Jansen

IPC: H04N7/15 ,  H04N7/14 ,  H04L29/06 ,  H04L12/58

CPC classification number: H04N7/147 ,  H04L51/04 ,  H04L51/10 ,  H04L65/1069 ,  H04N7/15

Abstract: Computing devices may implement instant video communication connections for video communications. Connection information for mobile computing devices may be maintained. A request to initiate an instant video communication may be received, and if authorized, the connection information for the particular recipient mobile computing device may be accessed. Video communication data may then be sent to the recipient mobile computing device according to the connection information so that the video communication data may be displayed at the recipient device as it is received. New connection information for different mobile computing devices may be added, or updates to existing connection information may also be performed. Connection information for some mobile computing devices may be removed.

Abstract translation: 计算设备可以实现用于视频通信的即时视频通信连接。 可以维护用于移动计算设备的连接信息。 可以接收到发起即时视频通信的请求，并且如果被授权，则可以访问特定接收者移动计算设备的连接信息。 然后可以根据连接信息将视频通信数据发送到接收者移动计算设备，使得视频通信数据可以在接收到设备时显示在接收方设备上。 可以添加用于不同移动计算设备的新连接信息，或者也可以执行对现有连接信息的更新。 某些移动计算设备的连接信息可能被删除。

公开(公告)号：US09344720B2

公开(公告)日：2016-05-17

申请号：US13715088

申请日：2012-12-14

Applicant: Apple Inc.

Inventor： David W. Singer ,  Alexandros Tourapis ,  Athanasios Leontaris ,  Xiaosong Zhou

IPC: H04N11/04 ,  H04N19/13 ,  H04N19/70 ,  H04N19/117 ,  H04N19/174 ,  H04N19/436

CPC classification number: H04N19/13 ,  H04N19/117 ,  H04N19/174 ,  H04N19/436 ,  H04N19/70

Abstract: In a communication system, parallel encoding and decoding of serially-coded data occurs in a manner that supports low latency communication. A plurality of data items may be coded as serially-coded data sequences and a transmission sequence may be built from them. An index table may be built having a plurality of entries representing respective start points of the serially-coded data sequences within the transmission sequence. The transmission sequence may be transmitted to a channel and, thereafter, the index table may be transmitted. Latencies otherwise involved in inserting an index table into the beginning of a transmission sequence may be avoided.

Abstract translation: 在通信系统中，串行编码数据的并行编码和解码以支持低延迟通信的方式发生。 多个数据项可以被编码为串行编码数据序列，并且可以从它们构建传输序列。 可以构建索引表，其具有表示传输序列内的串行编码数据序列的相应开始点的多个条目。 发送序列可以被发送到信道，此后可以发送索引表。 可以避免将索引表插入到传输序列的开始处的延迟。

公开(公告)号：US20160092561A1

公开(公告)日：2016-03-31

申请号：US14559705

申请日：2014-12-03

Applicant: Apple Inc.

Inventor： Shujie Liu ,  Ke Zhang ,  Xiaosong Zhou ,  Hsi-Jung Wu ,  Chris Y. Chung ,  James O. Normile ,  Douglas S. Price ,  Albert E. Keinath

IPC: G06F17/30 ,  G06K9/00 ,  G11B27/031 ,  G11B27/34 ,  G11B27/30

CPC classification number: G06F16/739 ,  G06F16/745 ,  G06F16/783 ,  G06F16/7837 ,  G06F16/7867 ,  G06K9/00718 ,  G06K9/00751 ,  G11B27/031 ,  G11B27/3081 ,  G11B27/34

Abstract: Systems and processes for improved video editing, summarization and navigation based on generation and analysis of metadata are described. The metadata may be content-based (e.g., differences between neighboring frames, exposure data, key frame identification data, motion data, or face detection data) or non-content-based (e.g., exposure, focus, location, time) and used to prioritize and/or classify portions of video. The metadata may be generated at the time of image capture or during post-processing. Prioritization information, such as a score for various portions of the image data may be based on the metadata and/or image data. Classification information such as the type or quality of a scene may be determined based on the metadata and/or image data. The classification and prioritization information may be metadata and may be used to automatically remove undesirable portions of the video, generate suggestions during editing or automatically generate summary video.

Abstract translation: 描述了基于元数据生成和分析改进视频编辑，汇总和导航的系统和过程。 元数据可以是基于内容的（例如，相邻帧之间的差异，曝光数据，关键帧识别数据，运动数据或面部检测数据）或非基于内容的（例如，曝光，焦点，位置，时间）并且被使用 对视频的部分进行优先排序和/或分类。 元数据可以在图像捕获时或在后处理期间生成。 诸如图像数据的各个部分的得分的优先级信息可以基于元数据和/或图像数据。 可以基于元数据和/或图像数据来确定诸如场景的类型或质量的分类信息。 分类和优先化信息可以是元数据，并且可以用于自动去除视频的不期望的部分，在编辑期间生成建议或自动生成汇总视频。

公开(公告)号：US20150358577A1

公开(公告)日：2015-12-10

申请号：US14296356

申请日：2014-06-04

Applicant: Apple Inc.

Inventor： Xiaosong Zhou ,  Hsi-Jung Wu ,  Chris Y. Chung ,  James O. Normile ,  Joe S. Abuan ,  Hyeonkuk Jeong ,  Yan Yang ,  Gobind Johar ,  Thomas Jansen

IPC: H04N7/14

CPC classification number: H04N7/147 ,  H04L51/04 ,  H04L51/10 ,  H04L65/1069 ,  H04N7/15

Abstract: Computing devices may implement instant video communication connections for video communications. Connection information for mobile computing devices may be maintained. A request to initiate an instant video communication may be received, and if authorized, the connection information for the particular recipient mobile computing device may be accessed. Video communication data may then be sent to the recipient mobile computing device according to the connection information so that the video communication data may be displayed at the recipient device as it is received. New connection information for different mobile computing devices may be added, or updates to existing connection information may also be performed. Connection information for some mobile computing devices may be removed.

Abstract translation: 计算设备可以实现用于视频通信的即时视频通信连接。 可以维护用于移动计算设备的连接信息。 可以接收到发起即时视频通信的请求，并且如果被授权，则可以访问特定接收者移动计算设备的连接信息。 然后可以根据连接信息将视频通信数据发送到接收者移动计算设备，使得视频通信数据可以在接收到设备时显示在接收方设备上。 可以添加用于不同移动计算设备的新连接信息，或者也可以执行对现有连接信息的更新。 某些移动计算设备的连接信息可能被删除。

公开(公告)号：US20150350714A1

公开(公告)日：2015-12-03

申请号：US14290227

申请日：2014-05-29

Applicant: Apple Inc.

Inventor： James O. Normile ,  Hsi-Jung Wu ,  Xiaosong Zhou ,  Chris Y. Chung ,  Ke Zhang ,  Yeping Su

IPC: H04N21/433 ,  H04N21/258 ,  H04N21/437 ,  H04N21/81

CPC classification number: H04N21/433 ,  H04L65/4084 ,  H04L67/1078 ,  H04L67/108 ,  H04N21/231 ,  H04N21/25891 ,  H04N21/26258 ,  H04N21/432 ,  H04N21/437 ,  H04N21/6587 ,  H04N21/812 ,  H04N21/8456 ,  H04N21/85406

Abstract: A method and system for caching and streaming media content, including predictively delivering and/or acquiring content is provided. In the system, client devices may be communicatively coupled in a network, and may access and share cached content. Video segments making up a media stream may be selectively delivered to the clients such that a complete media stream may be formed from the different segments delivered to the different clients. Video segments may be pushed by the server to the client or requested by the client according to a prioritization scheme, including downloading: partial items on a client's subscription log, lower quality version(s) of content before higher quality version(s), higher bitrate segments before lower bitrate segments, summaries of full-length content, advertisements and splash screens common to multiple video clips.

Abstract translation: 提供了一种用于缓存和流式传输媒体内容的方法和系统，包括预测地传递和/或获取内容。 在系统中，客户机设备可以通信地耦合在网络中，并且可以访问和共享缓存的内容。 构成媒体流的视频片段可以被选择性地传递到客户端，使得可以从递送到不同客户端的不同片段形成完整的媒体流。 视频片段可以由服务器推送到客户端或由客户端根据优先化方案请求，包括下载：客户端订阅日志上的部分项目，较高质量版本之前的较低质量版本的内容，更高质量版本 低比特率段之间的比特率段，多个视频剪辑共有的全长内容，广告和闪屏的总结。

公开(公告)号：US20150350687A1

公开(公告)日：2015-12-03

申请号：US14290873

申请日：2014-05-29

Applicant: Apple Inc.

Inventor： Jiefu Zhai ,  Dazhong Zhang ,  Xiaosong Zhou ,  Chris Y. Chung ,  Hsi-Jung Wu ,  Peikang Song ,  David R. Conrad ,  Jae Hoon Kim ,  Yunfei Zheng

IPC: H04N19/86 ,  H04N19/80 ,  H04N19/44

CPC classification number: H04N19/82 ,  H04N19/186

Abstract: Chroma deblock filtering of reconstructed video samples may be performed to remove blockiness artifacts and reduce color artifacts without over-smoothing. In a first method, chroma deblocking may be performed for boundary samples of a smallest transform size, regardless of partitions and coding modes. In a second method, chroma deblocking may be performed when a boundary strength is greater than 0. In a third method, chroma deblocking may be performed regardless of boundary strengths. In a fourth method, the type of chroma deblocking to be performed may be signaled in a slice header by a flag. Furthermore, luma deblock filtering techniques may be applied to chroma deblock filtering.

Abstract translation: 可以执行重构的视频样本的色度去块滤波以去除块状伪影并且减少颜色伪影而不会过度平滑。 在第一种方法中，可以对最小变换大小的边界样本执行色度解块，而与分区和编码模式无关。 在第二种方法中，当边界强度大于0时，可以执行色度去块。在第三种方法中，可以执行色度去块，而不管边界强度如何。 在第四种方法中，要执行的色度去块的类型可以通过标志在片头中发出信号。 此外，亮度去块滤波技术可以应用于色度去块滤波。

公开(公告)号：US20150350653A1

公开(公告)日：2015-12-03

申请号：US14288969

申请日：2014-05-28

Applicant: Apple Inc.

Inventor： Jae Hoon Kim ,  Shujie Liu ,  Dazhong Zhang ,  Xiaosong Zhou ,  Chris Y. Chung ,  Hsi-Jung Wu

IPC: H04N19/137 ,  H04N19/142 ,  H04N19/51

CPC classification number: H04N19/137 ,  H04N19/142 ,  H04N19/51 ,  H04N19/52

Abstract: An encoding system may include a video source that provides video data to be coded, a video coder, a transmitter, and a controller to manage operation of the system. The controller may control the video coder to code and compress the image information from the video source into video data, based upon one or more motion prediction parameters. The transmitter may transmit the video data. A decoding system may decode the video data based upon the motion prediction parameters.

Abstract translation: 编码系统可以包括提供要编码的视频数据的视频源，视频编码器，发射机和控制器，以管理系统的操作。 控制器可以基于一个或多个运动预测参数来控制视频编码器对来自视频源的图像信息进行编码和压缩成视频数据。 发射机可以发送视频数据。 解码系统可以基于运动预测参数解码视频数据。

公开(公告)号：US08988341B2

公开(公告)日：2015-03-24

申请号：US13631263

申请日：2012-09-28

Applicant: Apple Inc.

Inventor： Yao-Chung Lin ,  Xiaosong Zhou ,  Hsi-Jung Wu

IPC: G09G5/00 ,  G06F1/16

CPC classification number: G06F3/03 ,  G06F1/1694 ,  G06F2200/1636 ,  H04N7/183

Abstract: Embodiments of the present invention generate estimates of device motion from two data sources on a computing device—a motion sensor and a camera. The device may compare the estimates to each other to determine if they agree. If they agree, the device may confirm that device motion estimates based on the motion sensor are accurate and may output those estimates to an application within the device. If the device motion estimates disagree, the device may alter the motion estimates obtained from the motion sensor before outputting them to the application.

Abstract translation: 本发明的实施例从计算设备上的两个数据源（运动传感器和照相机）生成设备运动的估计。 设备可以将估计值相互比较以确定它们是否一致。 如果他们同意，设备可以确认基于运动传感器的设备运动估计是准确的，并且可以将这些估计值输出到设备内的应用。 如果设备运动估计不同意，则在将其输出到应用程序之前，设备可以改变从运动传感器获得的运动估计。