公开(公告)号：US09661665B2

公开(公告)日：2017-05-23

申请号：US14842730

申请日：2015-09-01

Applicant: Apple Inc.

Inventor： Yan Yang ,  Berkat S. Tung ,  Hyeonkuk Jeong ,  Justin N. Wood ,  Pierre J. De Filippis

IPC: H04W76/02 ,  H04L29/06 ,  H04W4/12 ,  H04W40/02 ,  H04W40/24 ,  H04W84/12

CPC classification number: H04W76/10 ,  H04L65/10 ,  H04L65/1069 ,  H04L65/80 ,  H04L69/14 ,  H04W4/12 ,  H04W40/02 ,  H04W40/246 ,  H04W84/12

Abstract: Apparatus and methods to evaluate connectivity between a primary device and a secondary device to support a connection for a real-time application to a remote device are disclosed. The primary device receives a connection request from the remote device and sends invitations to one or more secondary devices to connect with the remote device, the invitations sent through a first communication path. A secondary device that receives the invitation sends a connectivity evaluation packet to the primary device through a second communication path. When a connectivity response is received from the primary device through the second communication path and a user accepts the invitation, the secondary device sends an invitation response to the primary device and subsequently establishes a connection to the primary device through the second communication path. In some embodiments, the first communication path includes a cloud-based server that provides a guaranteed delivery message service.

公开(公告)号：US20170099338A1

公开(公告)日：2017-04-06

申请号：US15379592

申请日：2016-12-15

Applicant: Apple Inc.

Inventor： Yan Yang ,  Xiasong Zhou ,  Hyeonkuk Jeong ,  Joe S. Abuan ,  Gobind Johar ,  Yichao Shen

IPC: H04L29/06 ,  H04W36/14 ,  H04N7/15

CPC classification number: H04L65/80 ,  H04L65/1083 ,  H04N7/147 ,  H04N7/15 ,  H04W36/14 ,  H04W84/045

Abstract: Performing a real-time application on a mobile device, involving communication of audio/video packets with a remote device. The mobile device may initially communicate the audio/video packets on a first communication channel with the remote device. During the real-time communication, the mobile device may determine if no packets have been received by the mobile device from the remote device for a first threshold period of time. If no packets have been received by the mobile device from the remote device for the first threshold period of time, the mobile device may establish a second communication channel for transmission of the audio/video packets with the remote device. In response to using the second communication channel, the mobile device may modify a resolution or bit rate of the audio/video packets transmitted to the remote device.

公开(公告)号：US09544540B2

公开(公告)日：2017-01-10

申请号：US14296348

申请日：2014-06-04

Applicant: Apple Inc.

Inventor： Xiaosong Zhou ,  Hsi-Jung Wu ,  Chris Y. Chung ,  James O. Normile ,  Joe S. Abuan ,  Hyeonkuk Jeong ,  Yan Yang ,  Gobind Johar ,  Thomas Jansen

IPC: H04N7/14 ,  H04N7/15 ,  H04L12/58

CPC classification number: H04N7/15 ,  H04L51/04 ,  H04L51/10 ,  H04N7/147

Abstract: Computing devices may implement dynamic display of video communication data. Video communication data for a video communication may be received at a computing device where another application is currently displaying image data on an electronic display. A display location may be determined for the video communication data according to display attributes that are configured by the other application at runtime. Once determined, the video communication data may then be displayed in the determined location. In some embodiments, the video communication data may be integrated with other data displayed on the electronic display for the other application.

Abstract translation: 计算设备可以实现视频通信数据的动态显示。 用于视频通信的视频通信数据可以在其他应用当前正在电子显示器上显示图像数据的计算设备处被接收。 可以根据在运行时由其他应用配置的显示属性来确定视频通信数据的显示位置。 一旦确定，则可以在确定的位置显示视频通信数据。 在一些实施例中，视频通信数据可以与用于另一应用的电子显示器上显示的其他数据集成。

公开(公告)号：US09451425B2

公开(公告)日：2016-09-20

申请号：US14475236

申请日：2014-09-02

Applicant: Apple Inc.

Inventor： Daniel B. Pollack ,  Pierre Jonathan De Filippis ,  Hyeonkuk Jeong ,  Berkat S. Tung ,  Yan Yang ,  Gobind Johar ,  Justin Wood ,  Roberto Garcia ,  Gokul Thirumalai

IPC: H04W4/00 ,  H04W4/12 ,  H04W40/02 ,  H04L12/707 ,  H04L12/703 ,  H04W84/12 ,  H04W88/04

CPC classification number: H04W4/12 ,  H04L45/22 ,  H04L45/28 ,  H04L51/36 ,  H04L67/1087 ,  H04W4/80 ,  H04W40/02 ,  H04W76/11 ,  H04W76/15 ,  H04W84/12 ,  H04W88/04

Abstract: A unified message delivery between multiple devices is disclosed. Sending messages through a local communications link, such as but not limited to at least one of a Bluetooth connection and a peer-to-peer WiFi connection, can lead to faster transmission times and reduced server load. When the local communications link is unavailable or not suitable, the messages can be sent through a network and a push server. In some examples, messages can be sent through both the local communications link and through the network and the push server. Duplicates of a received message can be avoided by utilizing indicators. In some examples, one or more devices can include queue(s) to ensure ordered delivery of a plurality of messages when a local communications link and network connection become unavailable.

Abstract translation: 披露了多个设备之间的统一消息传递。 通过本地通信链路（例如但不限于蓝牙连接和对等WiFi连接中的至少一个）发送消息可以导致更快的传输时间和减少的服务器负载。 当本地通信链路不可用或不合适时，可以通过网络和推送服务器发送消息。 在一些示例中，可以通过本地通信链路和通过网络和推送服务器发送消息。 通过利用指标可以避免收到的消息的重复。 在一些示例中，当本地通信链路和网络连接变得不可用时，一个或多个设备可以包括用于确保多个消息的有序传送的队列。

公开(公告)号：US20160100131A1

公开(公告)日：2016-04-07

申请号：US14968025

申请日：2015-12-14

Applicant: Apple Inc.

Inventor： Chris Y. Chung ,  Wen Zhao ,  Luciano M. Verger ,  Hyeonkuk Jeong ,  Gang Lu ,  Srinivasan Vasudevan ,  Xiaosong Zhou ,  Hsi-Jung Wu ,  James O. Normile

IPC: H04N7/15 ,  H04N5/232 ,  H04N5/372 ,  H04L29/06

CPC classification number: H04N7/15 ,  H04L12/1827 ,  H04L65/1069 ,  H04N5/23241 ,  H04N5/372 ,  H04W52/02 ,  H04W52/0209 ,  H04W52/0216 ,  Y02D70/00 ,  Y02D70/1224 ,  Y02D70/1242 ,  Y02D70/1262 ,  Y02D70/142 ,  Y02D70/144 ,  Y02D70/146 ,  Y02D70/164 ,  Y02D70/168 ,  Y02D70/24

Abstract: In video conferencing over a radio network, the radio equipment is a major power consumer especially in cellular networks such as LTE. In order to reduce the radio power consumption in video conferencing, it is important to introduce an enough radio inactive time. Several types of data buffering and bundling can be employed within a reasonable range of latency that doesn't significantly disrupt the real-time nature of video conferencing. In addition, the data transmission can be synchronized to the data reception in a controlled manner, which can result in an even longer radio inactive time and thus take advantage of radio power saving modes such as LTE C-DRX.

Abstract translation: 在无线电网络的视频会议中，无线电设备是主要的电力消费者，尤其是在诸如LTE的蜂窝网络中。 为了降低视频会议中的无线电功耗，重要的是要引入足够的无线电时间。 几种类型的数据缓冲和捆绑可以在合理的延迟范围内使用，不会显着破坏视频会议的实时性质。 此外，可以以受控的方式将数据传输同步到数据接收，这可以导致更长的无线电时间，从而利用诸如LTE C-DRX之类的无线电节能模式。

公开(公告)号：US20150358582A1

公开(公告)日：2015-12-10

申请号：US14296354

申请日：2014-06-04

Applicant: Apple Inc.

Inventor： Xiaosong Zhou ,  Hsi-Jung Wu ,  Chris Y. Chung ,  James O. Normile ,  Joe S. Abuan ,  Hyeonkuk Jeong ,  Yan Yang ,  Gobind Johar ,  Thomas Jansen

IPC: H04N7/15

CPC classification number: H04N7/15 ,  H04L12/1818 ,  H04L51/04 ,  H04L51/046 ,  H04L51/10 ,  H04L65/1089 ,  H04L65/403 ,  H04N7/147

Abstract: Computing devices may implement dynamic transitions from video messages to video communications. Video communication data for a video message may be received at a recipient device. The video communication data may be displayed as it is received, and recorded for subsequent playback. An indication of a selection to establish a video communication with the sender of the video message may be received, or an indication that display of the video communication is to be ceased may be received. If a video communication is to be established, then a video communication connection with the sender of the video message may be created so that subsequent video communication data may be sent via the established connection.

Abstract translation: 计算设备可以实现从视频消息到视频通信的动态转换。 用于视频消息的视频通信数据可以在接收设备处被接收。 视频通信数据可以在它被接收时被显示，并被记录以用于随后的重放。 可以接收到与视频消息的发送者建立视频通信的选择的指示，或者可以接收到要停止视频通信的显示的指示。 如果要建立视频通信，则可以创建与视频消息的发送者的视频通信连接，以便可以经由建立的连接发送后续的视频通信数据。

公开(公告)号：US20150350290A1

公开(公告)日：2015-12-03

申请号：US14338734

申请日：2014-07-23

Applicant: Apple Inc.

Inventor： Yan Yang ,  Xiasong Zhou ,  Hyeonkuk Jeong ,  Joe S. Abuan ,  Gobind Johar ,  Yichao Shen

IPC: H04L29/06 ,  H04W36/14 ,  H04N7/15

CPC classification number: H04L65/80 ,  H04L65/1083 ,  H04N7/147 ,  H04N7/15 ,  H04W36/14 ,  H04W84/045

Abstract: Performing a real-time application on a mobile device, involving communication of audio/video packets with a remote device. The mobile device may initially communicate the audio/video packets on a first communication channel with the remote device. During the real-time communication, the mobile device may determine if no packets have been received by the mobile device from the remote device for a first threshold period of time. If no packets have been received by the mobile device from the remote device for the first threshold period of time, the mobile device may establish a second communication channel for transmission of the audio/video packets with the remote device. In response to using the second communication channel, the mobile device may modify a resolution or bit rate of the audio/video packets transmitted to the remote device.

Abstract translation: 在移动设备上执行实时应用，涉及音频/视频数据包与远程设备的通信。 移动设备可以最初在第一通信信道上与远程设备通信音频/视频分组。 在实时通信期间，移动设备可以确定在第一阈值时间段内移动设备是否已经从远程设备接收到分组。 如果移动设备在第一阈值时段内没有从远程设备接收到分组，则移动设备可以建立用于与远程设备传输音频/视频分组的第二通信信道。 响应于使用第二通信信道，移动设备可以修改发送到远程设备的音频/视频分组的分辨率或比特率。

公开(公告)号：US09055010B2

公开(公告)日：2015-06-09

申请号：US14018344

申请日：2013-09-04

Applicant: Apple Inc.

Inventor： Hassan Shojania ,  Nirav R. Patel ,  Hyeonkuk Jeong ,  Yan Yang ,  Roberto Garcia ,  Sundararaman V. Shiva

IPC: H04L12/56 ,  H04L12/861 ,  H04L12/841 ,  H04L12/823 ,  H04L29/06 ,  H04L12/853

CPC classification number: H04L49/90 ,  H04L47/2416 ,  H04L47/28 ,  H04L47/32 ,  H04L65/4084 ,  H04L65/80

Abstract: A method for refreshing blocked media packets for a streaming media session over a wireless network in a stall condition is disclosed. The method can include a wireless communication device maintaining a buffer at an application layer. The buffer can contain at least a portion of media packets provided to a baseband layer by the application layer for transmission. Media packets provided to the baseband layer can be queued in a baseband queue prior to transmission. The method can further include the wireless communication device generating at least one new media packet for the streaming media session during the stall condition; flushing at least a portion of the media packets queued in the baseband queue; and replenishing the baseband queue by providing the baseband layer with at least a portion of the media packets contained in the buffer and at least one new media packet.

Abstract translation: 公开了一种用于在失速状态下通过无线网络刷新流媒体会话的阻塞媒体分组的方法。 该方法可以包括在应用层保持缓冲器的无线通信设备。 缓冲器可以包含由应用层提供给基带层的至少一部分媒体分组用于传输。 提供给基带层的媒体分组可以在传输之前在基带队列中排队。 该方法还可以包括无线通信装置，在失速状态期间为流媒体会话生成至少一个新的媒体分组; 刷新在基带队列中排队的媒体分组的至少一部分; 以及通过向所述基带层提供包含在所述缓冲器中的所述媒体分组的至少一部分和至少一个新的媒体分组来补充所述基带队列。

公开(公告)号：US20150103135A1

公开(公告)日：2015-04-16

申请号：US14579613

申请日：2014-12-22

Applicant: Apple Inc.

Inventor： Xiaosong Zhou ,  Hsi-Jung Wu ,  Joe Abuan ,  Jim Normile ,  Haitao Guo ,  Hyeonkuk Jeong

IPC: H04N5/262 ,  H04N7/15 ,  H04N5/272 ,  H04N7/14

CPC classification number: H04N7/141 ,  G06F3/04817 ,  G06F3/04842 ,  G06F3/04886 ,  G06F9/451 ,  G09G5/14 ,  H04M1/72583 ,  H04N5/2258 ,  H04N5/2624 ,  H04N5/272 ,  H04N7/147 ,  H04N7/15

Abstract: Some embodiments provide a novel method for in-conference adjustment of encoded video pictures captured by a mobile device having at least first and second cameras. The method may involve real-time modifications of composite video displays that are generated by the mobile devices involved in such a conference. Specifically, in some embodiments, the mobile devices generate composite displays that simultaneously display multiple videos captured by multiple cameras of one or more devices. In some cases, the composite displays place the videos in adjacent display areas (e.g., in adjacent windows). In other cases, the composite display is a picture-in-picture (PIP) display that includes at least two display areas that show two different videos where one of the display areas is a background main display area and the other is a foreground inset display area that overlaps the background main display area.

Abstract translation: 一些实施例提供了一种用于会议调整由具有至少第一和第二相机的移动设备捕获的编码视频图像的新颖方法。 该方法可以涉及由这样的会议中涉及的移动设备生成的复合视频显示的实时修改。 具体地，在一些实施例中，移动设备产生同时显示由一个或多个设备的多个摄像机捕获的多个视频的复合显示器。 在某些情况下，复合显示将视频放置在相邻的显示区域中（例如，在相邻窗口中）。 在其他情况下，复合显示器是画中画（PIP）显示器，其包括显示两个不同视频的至少两个显示区域，其中一个显示区域是背景主显示区域，另一个是前景插入显示 与背景主显示区域重叠的区域。

公开(公告)号：US08683301B2

公开(公告)日：2014-03-25

申请号：US13785859

申请日：2013-03-05

Applicant: Apple Inc.

Inventor： Xiaosong Zhou ,  Hyeonkuk Jeong ,  Yan Yang ,  Dazhong Zhang ,  Hsi-Jung Wu

IPC: H03M13/00

CPC classification number: H03M13/05 ,  H03M13/1102 ,  H03M13/1515 ,  H03M13/152 ,  H03M13/27 ,  H03M13/29 ,  H03M13/2957 ,  H03M13/373 ,  H03M13/3746 ,  H04L1/005 ,  H04L1/0057 ,  H04L1/008

Abstract: Coded video data may be transmitted between an encoder and a decoder using multiple FEC codes and/or packets for error detection and correction. Only a subset of the FEC packets need be transmitted between the encoder and decoder. The FEC packets of each FEC group may take, as inputs, data packets of a current FEC group and also an untransmitted FEC packet of a preceding FEC group. Due to relationships among the FEC packets, when transmission errors arise and data packets are lost, there remain opportunities for a decoder to recover lost data packets from earlier-received FEC groups when later-received FEC groups are decoded. This opportunity to recover data packets from earlier FEC groups may be useful in video coding and other systems, in which later-received data often cannot be decoded unless earlier-received data is decoded properly.

Abstract translation: 可以在编码器和解码器之间使用多个用于错误检测和校正的FEC码和/或包进行编码的视频数据。 只有FEC数据包的一部分需要在编码器和解码器之间传输。 每个FEC组的FEC分组可以采用当前FEC组的数据分组和前一个FEC组的未发送FEC分组的输入。 由于FEC分组之间的关系，当传输错误出现并且数据分组丢失时，当稍后接收的FEC组被解码时，解码器仍然有机会恢复来自早先接收的FEC组的丢失的数据分组。 从先前的FEC组恢复数据分组的机会在视频编码和其他系统中可能是有用的，其中后期接收的数据通常不能被解码，除非先前接收到的数据被正确解码。