公开(公告)号：US20160092561A1

公开(公告)日：2016-03-31

申请号：US14559705

申请日：2014-12-03

Applicant: Apple Inc.

Inventor： Shujie Liu ,  Ke Zhang ,  Xiaosong Zhou ,  Hsi-Jung Wu ,  Chris Y. Chung ,  James O. Normile ,  Douglas S. Price ,  Albert E. Keinath

IPC: G06F17/30 ,  G06K9/00 ,  G11B27/031 ,  G11B27/34 ,  G11B27/30

CPC classification number: G06F16/739 ,  G06F16/745 ,  G06F16/783 ,  G06F16/7837 ,  G06F16/7867 ,  G06K9/00718 ,  G06K9/00751 ,  G11B27/031 ,  G11B27/3081 ,  G11B27/34

Abstract: Systems and processes for improved video editing, summarization and navigation based on generation and analysis of metadata are described. The metadata may be content-based (e.g., differences between neighboring frames, exposure data, key frame identification data, motion data, or face detection data) or non-content-based (e.g., exposure, focus, location, time) and used to prioritize and/or classify portions of video. The metadata may be generated at the time of image capture or during post-processing. Prioritization information, such as a score for various portions of the image data may be based on the metadata and/or image data. Classification information such as the type or quality of a scene may be determined based on the metadata and/or image data. The classification and prioritization information may be metadata and may be used to automatically remove undesirable portions of the video, generate suggestions during editing or automatically generate summary video.

Abstract translation: 描述了基于元数据生成和分析改进视频编辑，汇总和导航的系统和过程。 元数据可以是基于内容的（例如，相邻帧之间的差异，曝光数据，关键帧识别数据，运动数据或面部检测数据）或非基于内容的（例如，曝光，焦点，位置，时间）并且被使用 对视频的部分进行优先排序和/或分类。 元数据可以在图像捕获时或在后处理期间生成。 诸如图像数据的各个部分的得分的优先级信息可以基于元数据和/或图像数据。 可以基于元数据和/或图像数据来确定诸如场景的类型或质量的分类信息。 分类和优先化信息可以是元数据，并且可以用于自动去除视频的不期望的部分，在编辑期间生成建议或自动生成汇总视频。

公开(公告)号：US20150358577A1

公开(公告)日：2015-12-10

申请号：US14296356

申请日：2014-06-04

Applicant: Apple Inc.

Inventor： Xiaosong Zhou ,  Hsi-Jung Wu ,  Chris Y. Chung ,  James O. Normile ,  Joe S. Abuan ,  Hyeonkuk Jeong ,  Yan Yang ,  Gobind Johar ,  Thomas Jansen

IPC: H04N7/14

CPC classification number: H04N7/147 ,  H04L51/04 ,  H04L51/10 ,  H04L65/1069 ,  H04N7/15

Abstract: Computing devices may implement instant video communication connections for video communications. Connection information for mobile computing devices may be maintained. A request to initiate an instant video communication may be received, and if authorized, the connection information for the particular recipient mobile computing device may be accessed. Video communication data may then be sent to the recipient mobile computing device according to the connection information so that the video communication data may be displayed at the recipient device as it is received. New connection information for different mobile computing devices may be added, or updates to existing connection information may also be performed. Connection information for some mobile computing devices may be removed.

Abstract translation: 计算设备可以实现用于视频通信的即时视频通信连接。 可以维护用于移动计算设备的连接信息。 可以接收到发起即时视频通信的请求，并且如果被授权，则可以访问特定接收者移动计算设备的连接信息。 然后可以根据连接信息将视频通信数据发送到接收者移动计算设备，使得视频通信数据可以在接收到设备时显示在接收方设备上。 可以添加用于不同移动计算设备的新连接信息，或者也可以执行对现有连接信息的更新。 某些移动计算设备的连接信息可能被删除。

公开(公告)号：US20150350714A1

公开(公告)日：2015-12-03

申请号：US14290227

申请日：2014-05-29

Applicant: Apple Inc.

Inventor： James O. Normile ,  Hsi-Jung Wu ,  Xiaosong Zhou ,  Chris Y. Chung ,  Ke Zhang ,  Yeping Su

IPC: H04N21/433 ,  H04N21/258 ,  H04N21/437 ,  H04N21/81

CPC classification number: H04N21/433 ,  H04L65/4084 ,  H04L67/1078 ,  H04L67/108 ,  H04N21/231 ,  H04N21/25891 ,  H04N21/26258 ,  H04N21/432 ,  H04N21/437 ,  H04N21/6587 ,  H04N21/812 ,  H04N21/8456 ,  H04N21/85406

Abstract: A method and system for caching and streaming media content, including predictively delivering and/or acquiring content is provided. In the system, client devices may be communicatively coupled in a network, and may access and share cached content. Video segments making up a media stream may be selectively delivered to the clients such that a complete media stream may be formed from the different segments delivered to the different clients. Video segments may be pushed by the server to the client or requested by the client according to a prioritization scheme, including downloading: partial items on a client's subscription log, lower quality version(s) of content before higher quality version(s), higher bitrate segments before lower bitrate segments, summaries of full-length content, advertisements and splash screens common to multiple video clips.

Abstract translation: 提供了一种用于缓存和流式传输媒体内容的方法和系统，包括预测地传递和/或获取内容。 在系统中，客户机设备可以通信地耦合在网络中，并且可以访问和共享缓存的内容。 构成媒体流的视频片段可以被选择性地传递到客户端，使得可以从递送到不同客户端的不同片段形成完整的媒体流。 视频片段可以由服务器推送到客户端或由客户端根据优先化方案请求，包括下载：客户端订阅日志上的部分项目，较高质量版本之前的较低质量版本的内容，更高质量版本 低比特率段之间的比特率段，多个视频剪辑共有的全长内容，广告和闪屏的总结。

公开(公告)号：US20140072000A1

公开(公告)日：2014-03-13

申请号：US14020606

申请日：2013-09-06

Applicant: Apple Inc.

Inventor： Sundararaman V. Shiva ,  Hyeonkuk Jeong ,  Roberto Garcia ,  Nirav R. Patel ,  James O. Normile

IPC: H04J3/06

CPC classification number: H04J3/062 ,  H04J3/0632 ,  H04L47/12 ,  H04L47/14 ,  H04L47/283 ,  H04L47/38

Abstract: An apparatus and method for detecting and analyzing spikes in network jitter and the estimation of a jitter buffer target size is disclosed. Detected spikes may be classified as jump spikes or slope spikes, and a clipped size of detected spikes may be used in the estimation of the jitter buffer target. Network characteristics and conditions may also be used in the estimation of the jitter buffer target size. Samples may be modified during playback adaptation to improve audio quality and maintain low delay of a receive chain.

Abstract translation: 公开了一种用于检测和分析网络抖动尖峰和抖动缓冲器目标尺寸估计的装置和方法。 检测到的尖峰可以被分类为跳跃尖峰或斜率尖峰，并且可以在抖动缓冲器目标的估计中使用检测到的尖峰的限幅大小。 网络特性和条件也可用于估计抖动缓冲区目标大小。 可以在回放适应期间修改样本以改善音频质量并维持接收链的低延迟。

公开(公告)号：US20140064165A1

公开(公告)日：2014-03-06

申请号：US13667814

申请日：2012-11-02

Applicant: APPLE INC.

Inventor： Chris Y. Chung ,  Wen Zhao ,  Luciano M. Verger ,  Hyeonkuk Jeong ,  Gang Lu ,  Srinivasan Vasudevan ,  Xiaosong Zhou ,  Hsi-Jung Wu ,  James O. Normile

IPC: H04W52/02

CPC classification number: H04N7/15 ,  H04L12/1827 ,  H04L65/1069 ,  H04N5/23241 ,  H04N5/372 ,  H04W52/02 ,  H04W52/0209 ,  H04W52/0216 ,  Y02D70/00 ,  Y02D70/1224 ,  Y02D70/1242 ,  Y02D70/1262 ,  Y02D70/142 ,  Y02D70/144 ,  Y02D70/146 ,  Y02D70/164 ,  Y02D70/168 ,  Y02D70/24

Abstract: In video conferencing over a radio network, the radio equipment is a major power consumer especially in cellular networks such as LTE. In order to reduce the radio power consumption in video conferencing, it is important to introduce an enough radio inactive time. Several types of data buffering and bundling can be employed within a reasonable range of latency that doesn't significantly disrupt the real-time nature of video conferencing. In addition, the data transmission can be synchronized to the data reception in a controlled manner, which can result in an even longer radio inactive time and thus take advantage of radio power saving modes such as LTE C-DRX.

Abstract translation: 在无线电网络的视频会议中，无线电设备是主要的电力消费者，特别是在诸如LTE的蜂窝网络中。 为了降低视频会议中的无线电功耗，重要的是要引入足够的无线电时间。 几种类型的数据缓冲和捆绑可以在合理的延迟范围内使用，不会显着破坏视频会议的实时性质。 此外，可以以受控的方式将数据传输同步到数据接收，这可以导致更长的无线电时间，从而利用诸如LTE C-DRX之类的无线电节能模式。

公开(公告)号：US10452713B2

公开(公告)日：2019-10-22

申请号：US14559705

申请日：2014-12-03

Applicant: Apple Inc.

Inventor： Shujie Liu ,  Ke Zhang ,  Xiaosong Zhou ,  Hsi-Jung Wu ,  Chris Y. Chung ,  James O. Normile ,  Douglas S. Price ,  Albert E. Keinath

IPC: G06F16/738 ,  G06F16/78 ,  G06F16/74 ,  G11B27/34 ,  G06K9/00 ,  G11B27/031 ,  G11B27/30 ,  G06F16/783

Abstract: Systems and processes for improved video editing, summarization and navigation based on generation and analysis of metadata are described. The metadata may be content-based (e.g., differences between neighboring frames, exposure data, key frame identification data, motion data, or face detection data) or non-content-based (e.g., exposure, focus, location, time) and used to prioritize and/or classify portions of video. The metadata may be generated at the time of image capture or during post-processing. Prioritization information, such as a score for various portions of the image data may be based on the metadata and/or image data. Classification information such as the type or quality of a scene may be determined based on the metadata and/or image data. The classification and prioritization information may be metadata and may be used to automatically remove undesirable portions of the video, generate suggestions during editing or automatically generate summary video.

公开(公告)号：US09876964B2

公开(公告)日：2018-01-23

申请号：US14290351

申请日：2014-05-29

Applicant: Apple Inc.

Inventor： Xiaosong Zhou ,  Hsi-Jung Wu ,  Chris Y. Chung ,  James O. Normile ,  Dazhong Zhang

IPC: H04N7/12 ,  H04N5/262 ,  H04N19/167 ,  H04N19/132 ,  H04N19/115 ,  H04N19/17 ,  H04N19/124 ,  H04N19/136

CPC classification number: H04N5/262 ,  H04N19/115 ,  H04N19/124 ,  H04N19/132 ,  H04N19/136 ,  H04N19/167 ,  H04N19/17

Abstract: Techniques for coding video data estimate depths of different elements within video content and identify regions within the video content based on the estimated depths. One of the regions may be assigned as an area of interest. Thereafter, video content of a region that is not an area of interest may be masked out and the resultant video content obtained from the masking may be coded. The coded video content may be transmitted to a channel. These techniques permit a coding terminal to mask out captured video content prior to coding in order to support coding policies that account for privacy interests or video composition features during a video coding session.

公开(公告)号：US09246843B2

公开(公告)日：2016-01-26

申请号：US14018348

申请日：2013-09-04

Applicant: Apple Inc.

Inventor： Yan Yang ,  Sundararaman V. Shiva ,  Roberto Garcia ,  Joe S. Abuan ,  Hyeonkuk Jeong ,  James O. Normile

IPC: H04L12/923 ,  H04W36/00 ,  H04L12/859 ,  H04L12/875 ,  H04L12/823 ,  H04L12/801 ,  H04L29/06

CPC classification number: H04L47/762 ,  H04L47/2475 ,  H04L47/32 ,  H04L47/34 ,  H04L47/564 ,  H04L67/145 ,  H04L69/00 ,  H04W36/00

Abstract: A method for detecting and recovering from a transmission channel change during a streaming media session is disclosed. The method can include a wireless communication device detecting a stall condition resulting from a transmission channel change. The method can further include the wireless communication device capturing a snapshot of a current transmission parameter state of the streaming media session in response to detecting the stall condition. The method can also include the wireless communication device using the snapshot to restore the streaming media session to the transmission parameter state captured by the snapshot following completion of the transmission channel change.

Abstract translation: 公开了一种在流媒体会话期间从传输信道进行检测和恢复的方法的改变。 该方法可以包括检测由传输信道改变导致的停顿状态的无线通信设备。 响应于检测到失速状态，该方法还可以包括无线通信设备捕获流媒体会话的当前传输参数状态的快照。 该方法还可以包括使用快照的无线通信设备将流媒体会话恢复到完成传输信道改变之后由快照捕获的传输参数状态。

公开(公告)号：US20150358581A1

公开(公告)日：2015-12-10

申请号：US14296349

申请日：2014-06-04

Applicant: Apple Inc.

Inventor： Xiaosong Zhou ,  Hsi-Jung Wu ,  Chris Y. Chung ,  James O. Normile ,  Joe S. Abuan ,  Hyeonkuk Jeong ,  Yan Yang ,  Gobind Johar ,  Thomas Jansen

IPC: H04N7/15

CPC classification number: H04N7/15 ,  H04N7/147

Abstract: Computing devices may implement dynamic detection of pause and resume for video communications. Video communication data may be capture at a participant device in a video communication. The video communication data may be evaluated to detect a pause or resume event for the transmission of the video communication data. Various types of video, audio, and other sensor analysis may be used to detect when a pause event or a resume event may be triggered. For triggered pause events, at least some of the video communication data my no longer be transmitted as part of the video communication. For triggered resume events, a pause state may cease and all of the video communication data may be transmitted.

Abstract translation: 计算设备可以实现视频通信的暂停和恢复的动态检测。 可以在视频通信中的参与者设备处捕获视频通信数据。 可以评估视频通信数据以检测用于传输视频通信数据的暂停或恢复事件。 可以使用各种类型的视频，音频和其他传感器分析来检测何时可以触发暂停事件或恢复事件。 对于触发暂停事件，视频通信数据中的至少一些不再作为视频通信的一部分传送。 对于触发的恢复事件，可以停止暂停状态，并且可以发送所有的视频通信数据。

公开(公告)号：US20150358580A1

公开(公告)日：2015-12-10

申请号：US14296348

申请日：2014-06-04

Applicant: Apple Inc.

Inventor： Xiaosong Zhou ,  Hsi-Jung Wu ,  Chris Y. Chung ,  James O. Normile ,  Joe S. Abuan ,  Hyeonkuk Jeong ,  Yan Yang ,  Gobind Johar ,  Thomas Jansen

IPC: H04N7/15

CPC classification number: H04N7/15 ,  H04L51/04 ,  H04L51/10 ,  H04N7/147

Abstract: Computing devices may implement dynamic display of video communication data. Video communication data for a video communication may be received at a computing device where another application is currently displaying image data on an electronic display. A display location may be determined for the video communication data according to display attributes that are configured by the other application at runtime. Once determined, the video communication data may then be displayed in the determined location. In some embodiments, the video communication data may be integrated with other data displayed on the electronic display for the other application.

Abstract translation: 计算设备可以实现视频通信数据的动态显示。 用于视频通信的视频通信数据可以在其他应用当前正在电子显示器上显示图像数据的计算设备处被接收。 可以根据在运行时由其他应用配置的显示属性来确定视频通信数据的显示位置。 一旦确定，则可以在确定的位置显示视频通信数据。 在一些实施例中，视频通信数据可以与用于另一应用的电子显示器上显示的其他数据集成。