公开(公告)号：US20170064253A1

公开(公告)日：2017-03-02

申请号：US15350617

申请日：2016-11-14

Applicant: APPLE INC.

Inventor： Yan YANG ,  Thomas JANSEN ,  Hyeonkuk JEONG ,  Joe S. ABUAN

IPC: H04N7/14 ,  H04L29/08 ,  H04L29/12 ,  H04L29/06

CPC classification number: H04N7/147 ,  H04L61/2503 ,  H04L63/029 ,  H04L65/1069 ,  H04L67/104 ,  H04L69/28 ,  H04N7/148

Abstract: A system and method for conducting a video call between an originating device and a terminating device by establishing a peer-to-peer (P2P) connection between the devices. The originating and terminating devices exchange candidate information through a P2P server, except that the candidate information for the terminating device is altered before arriving at the originating device. The altering includes changing the IP address and corresponding port for each candidate. The originating device uses the altered candidate information to derive new candidate pairs that are sent to the terminating device, which uses the new candidate pairs to also derive a second candidate list. If the candidate pairs match, a P2P connection is established between the devices.

Abstract translation: 一种用于通过在设备之间建立对等（P2P）连接来在始发设备和终端设备之间进行视频呼叫的系统和方法。 始发和终端设备通过P2P服务器交换候选信息，除了终端设备的候选信息在到达始发设备之前被改变。 更改包括更改每个候选人的IP地址和相应的端口。 始发设备使用改变的候选信息来导出发送到终端设备的新的候选对，其使用新的候选对也导出第二候选列表。 如果候选对匹配，则在设备之间建立P2P连接。

公开(公告)号：US20160066352A1

公开(公告)日：2016-03-03

申请号：US14842730

申请日：2015-09-01

Applicant: Apple Inc.

Inventor： Yan YANG ,  Berkat S. TUNG ,  Hyeonkuk JEONG ,  Justin N. WOOD ,  Pierre J. DE FILIPPIS

IPC: H04W76/02 ,  H04W4/12 ,  H04W28/02 ,  H04L29/06

CPC classification number: H04W76/10 ,  H04L65/10 ,  H04L65/1069 ,  H04L65/80 ,  H04L69/14 ,  H04W4/12 ,  H04W40/02 ,  H04W40/246 ,  H04W84/12

Abstract: Apparatus and methods to evaluate connectivity between a primary device and a secondary device to support a connection for a real-time application to a remote device are disclosed. The primary device receives a connection request from the remote device and sends invitations to one or more secondary devices to connect with the remote device, the invitations sent through a first communication path. A secondary device that receives the invitation sends a connectivity evaluation packet to the primary device through a second communication path. When a connectivity response is received from the primary device through the second communication path and a user accepts the invitation, the secondary device sends an invitation response to the primary device and subsequently establishes a connection to the primary device through the second communication path. In some embodiments, the first communication path includes a cloud-based server that provides a guaranteed delivery message service.

Abstract translation: 公开了用于评估主设备和辅助设备之间的连接以支持用于远程设备的实时应用的连接的设备和方法。 主设备从远程设备接收连接请求，并向一个或多个辅助设备发送邀请以与远程设备连接，通过第一通信路径发送邀请。 接收邀请的辅助设备通过第二通信路径向主设备发送连接性评估分组。 当通过第二通信路径从主设备接收到连接响应并且用户接受邀请时，辅助设备向主设备发送邀请响应，并随后通过第二通信路径建立与主设备的连接。 在一些实施例中，第一通信路径包括提供有保证的传递消息服务的基于云的服务器。

公开(公告)号：US20150350854A1

公开(公告)日：2015-12-03

申请号：US14475236

申请日：2014-09-02

Applicant: Apple Inc.

Inventor： Daniel B. POLLACK ,  Pierre Jonathan DE FILIPPIS ,  Hyeonkuk JEONG ,  Berkat S. TUNG ,  Yan YANG ,  Gobind JOHAR ,  Justin WOOD ,  Roberto GARCIA ,  Gokul THIRUMALAI

IPC: H04W4/12 ,  H04W40/02

CPC classification number: H04W4/12 ,  H04L45/22 ,  H04L45/28 ,  H04L51/36 ,  H04L67/1087 ,  H04W4/80 ,  H04W40/02 ,  H04W76/11 ,  H04W76/15 ,  H04W84/12 ,  H04W88/04

Abstract: A unified message delivery between multiple devices is disclosed. Sending messages through a local communications link, such as but not limited to at least one of a Bluetooth connection and a peer-to-peer WiFi connection, can lead to faster transmission times and reduced server load. When the local communications link is unavailable or not suitable, the messages can be sent through a network and a push server. In some examples, messages can be sent through both the local communications link and through the network and the push server. Duplicates of a received message can be avoided by utilizing indicators. In some examples, one or more devices can include queue(s) to ensure ordered delivery of a plurality of messages when a local communications link and network connection become unavailable.

Abstract translation: 披露了多个设备之间的统一消息传递。 通过本地通信链路（例如但不限于蓝牙连接和对等WiFi连接中的至少一个）发送消息可以导致更快的传输时间和减少的服务器负载。 当本地通信链路不可用或不合适时，可以通过网络和推送服务器发送消息。 在一些示例中，可以通过本地通信链路和通过网络和推送服务器发送消息。 通过利用指标可以避免收到的消息的重复。 在一些示例中，当本地通信链路和网络连接变得不可用时，一个或多个设备可以包括用于确保多个消息的有序传送的队列。

公开(公告)号：US20130254620A1

公开(公告)日：2013-09-26

申请号：US13785859

申请日：2013-03-05

Applicant: Apple Inc.

Inventor： Xiaosong ZHOU ,  Hyeonkuk JEONG ,  Yan YANG ,  Dazhong ZHANG ,  Hsi-Jung WU

IPC: H03M13/05 ,  H03M13/29

CPC classification number: H03M13/05 ,  H03M13/1102 ,  H03M13/1515 ,  H03M13/152 ,  H03M13/27 ,  H03M13/29 ,  H03M13/2957 ,  H03M13/373 ,  H03M13/3746 ,  H04L1/005 ,  H04L1/0057 ,  H04L1/008

Abstract: Coded video data may be transmitted between an encoder and a decoder using multiple FEC codes and/or packets for error detection and correction. Only a subset of the FEC packets need be transmitted between the encoder and decoder. The FEC packets of each FEC group may take, as inputs, data packets of a current FEC group and also an untransmitted FEC packet of a preceding FEC group. Due to relationships among the FEC packets, when transmission errors arise and data packets are lost, there remain opportunities for a decoder to recover lost data packets from earlier-received FEC groups when later-received FEC groups are decoded. This opportunity to recover data packets from earlier FEC groups may be useful in video coding and other systems, in which later-received data often cannot be decoded unless earlier-received data is decoded properly.

Abstract translation: 可以在编码器和解码器之间使用多个用于错误检测和校正的FEC码和/或包进行编码的视频数据。 只有FEC数据包的一部分需要在编码器和解码器之间传输。 每个FEC组的FEC分组可以采用当前FEC组的数据分组和前一个FEC组的未发送FEC分组的输入。 由于FEC分组之间的关系，当传输错误出现并且数据分组丢失时，当稍后接收的FEC组被解码时，解码器仍然有机会恢复来自早先接收的FEC组的丢失的数据分组。 从先前的FEC组恢复数据分组的机会在视频编码和其他系统中可能是有用的，其中后期接收的数据通常不能被解码，除非先前接收到的数据被正确解码。

公开(公告)号：US20220103611A1

公开(公告)日：2022-03-31

申请号：US17168107

申请日：2021-02-04

Applicant: Apple Inc.

Inventor： Daniel B. POLLACK ,  Karthick SANTHANAM ,  Christopher M. GARRIDO ,  Jingyao ZHANG ,  Ming JIN ,  Hyeonkuk JEONG

IPC: H04L29/06 ,  H04W16/14 ,  H04N21/24

Abstract: A device implementing cellular communication protocol aware multimedia streaming may include at least one processor configured to establish a link for communicating with another device, wherein the link utilizes at least one of a first cellular communication protocol or a second cellular communication protocol. The at least one processor may be configured to determine a bit rate for a video stream to be provided to the other device based at least in part on whether the link utilizes the first cellular communication protocol or the second cellular communication protocol, wherein a first bit rate is determined when the link utilizes the first cellular communication protocol and a second bit rate is determined when the link utilizes the second cellular communication protocol. The at least one processor may be configured to provide, for transmission over the link to the other electronic device, the video stream at the determined bit rate.

公开(公告)号：US20140139612A1

公开(公告)日：2014-05-22

申请号：US14164856

申请日：2014-01-27

Applicant: APPLE INC.

Inventor： Hyeonkuk JEONG ,  Joe ABUAN ,  Jim NORMILE

IPC: H04N7/15

CPC classification number: H04N7/152 ,  H04N7/147

Abstract: Some embodiments provide an architecture for establishing multi-participant video conferences. This architecture has a central distributor that receives video images from two or more participants. From the received images, the central distributor generates composite images that the central distributor transmits back to the participants. Each composite image includes a set of sub images, where each sub image belongs to one participant. In some embodiments, the central distributor saves network bandwidth by removing each particular participant's image from the composite image that the central distributor sends to the particular participant. In some embodiments, images received from each participant are arranged in the composite in a non-interleaved manner. For instance, in some embodiments, the composite image includes at most one sub-image for each participant, and no two sub-images are interleaved.

Abstract translation: 一些实施例提供了用于建立多参与者视频会议的架构。 这种架构有一个中央分配器，可以接收来自两个或更多参与者的视频图像。 从接收到的图像中，中心分配器生成中央分配器传送回参与者的合成图像。 每个合成图像包括一组子图像，其中每个子图像属于一个参与者。 在一些实施例中，中央分配器通过从中央分配器向特定参与者发送的合成图像中移除每个特定参与者的图像来节省网络带宽。 在一些实施例中，从每个参与者接收的图像以非交错方式排列在复合体中。 例如，在一些实施例中，合成图像对于每个参与者至多包括一个子图像，并且没有两个子图像被交织。

公开(公告)号：US20170006441A1

公开(公告)日：2017-01-05

申请号：US15265696

申请日：2016-09-14

Applicant: Apple Inc.

Inventor： Daniel B. POLLACK ,  Pierre Jonathan DE FILIPPIS ,  Hyeonkuk JEONG ,  Berkat S. TUNG ,  Yan YANG ,  Gobind JOHAR ,  Justin WOOD ,  Roberto GARCIA ,  Gokul THIRUMALAI

IPC: H04W4/12 ,  H04L12/58 ,  H04W4/00

CPC classification number: H04W4/12 ,  H04L45/22 ,  H04L45/28 ,  H04L51/36 ,  H04L67/1087 ,  H04W4/80 ,  H04W40/02 ,  H04W76/11 ,  H04W76/15 ,  H04W84/12 ,  H04W88/04

Abstract: A unified message delivery between multiple devices is disclosed. Sending messages through a local communications link, such as but not limited to at least one of a Bluetooth connection and a peer-to-peer WiFi connection, can lead to faster transmission times and reduced server load. When the local communications link is unavailable or not suitable, the messages can be sent through a network and a push server. In some examples, messages can be sent through both the local communications link and through the network and the push server. Duplicates of a received message can be avoided by utilizing indicators. In some examples, one or more devices can include queue(s) to ensure ordered delivery of a plurality of messages when a local communications link and network connection become unavailable.

Abstract translation: 披露了多个设备之间的统一消息传递。 通过本地通信链路（例如但不限于蓝牙连接和对等WiFi连接中的至少一个）发送消息可以导致更快的传输时间和减少的服务器负载。 当本地通信链路不可用或不合适时，可以通过网络和推送服务器发送消息。 在一些示例中，可以通过本地通信链路和通过网络和推送服务器发送消息。 通过利用指标可以避免收到的消息的重复。 在一些示例中，当本地通信链路和网络连接变得不可用时，一个或多个设备可以包括用于确保多个消息的有序传送的队列。

公开(公告)号：US20150281642A1

公开(公告)日：2015-10-01

申请号：US14537519

申请日：2014-11-10

Applicant: APPLE INC.

Inventor： Yan YANG ,  Thomas JANSEN ,  Hyeonkuk JEONG ,  Joe S. ABUAN

IPC: H04N7/14 ,  H04L29/06

CPC classification number: H04N7/147 ,  H04L61/2503 ,  H04L63/029 ,  H04L65/1069 ,  H04L67/104 ,  H04L69/28 ,  H04N7/148

Abstract: A system and method for conducting a video call between an originating device and a terminating device by establishing a peer-to-peer (P2P) connection between the devices. The originating and terminating devices exchange candidate information through a P2P server, except that the candidate information for the terminating device is altered before arriving at the originating device. The altering includes changing the IP address and corresponding port for each candidate. The originating device uses the altered candidate information to derive new candidate pairs that are sent to the terminating device, which uses the new candidate pairs to also derive a second candidate list. If the candidate pairs match, a P2P connection is established between the devices.

Abstract translation: 一种用于通过在设备之间建立对等（P2P）连接来在始发设备和终端设备之间进行视频呼叫的系统和方法。 始发和终端设备通过P2P服务器交换候选信息，除了终端设备的候选信息在到达始发设备之前被改变。 更改包括更改每个候选人的IP地址和相应的端口。 始发设备使用改变的候选信息来导出发送到终端设备的新的候选对，其使用新的候选对也导出第二候选列表。 如果候选对匹配，则在设备之间建立P2P连接。

公开(公告)号：US20140269932A1

公开(公告)日：2014-09-18

申请号：US13800905

申请日：2013-03-13

Applicant: Apple Inc.

Inventor： Yeping SU ,  Chris Y. CHUNG ,  Xiaosong ZHOU ,  James Oliver NORMILE ,  Hsi-Jung WU ,  Thomas JANSEN ,  Hyeonkuk JEONG ,  Joe S. ABUAN ,  Douglas Scott PRICE

IPC: H04N7/26

CPC classification number: H04N21/234372 ,  H04N21/23439 ,  H04N21/2381 ,  H04N21/4384 ,  H04N21/44004

Abstract: A video streaming method for transitioning between multiple sequences of coded video data may include receiving and decoding transmission units from a first sequence of coded video data. In response to a request to transition to a second sequence of coded video data, the method may determine whether a time to transition to the second sequence of coded video data can be reduced by transitioning to the second sequence of coded video data via an intermediate sequence of coded video data. If the time can be reduced, the method may include receiving at least one transmission unit from an intermediate sequence of coded video data that corresponds to the request to transition, decoding the transmission unit from the intermediate sequence, and transitioning from the first sequence to the second sequence via the decoded transmission unit from the intermediate sequence.

Abstract translation: 用于在多个编码视频数据序列之间转换的视频流方法可以包括从第一编码视频数据序列接收和解码传输单元。 响应于转换到第二编码视频数据序列的请求，该方法可以通过经由中间序列转换到第二编码视频数据序列来确定是否可以减少转换到第二编码视频数据序列的时间 的编码视频数据。 如果可以减少时间，则该方法可以包括从与转换请求对应的编码视频数据的中间序列接收至少一个传输单元，从中间序列解码传输单元，以及从第一序列转换到 通过来自中间序列的解码传输单元的第二序列。