公开(公告)号：US12200401B2

公开(公告)日：2025-01-14

申请号：US17661947

申请日：2022-05-04

Applicant: Apple Inc.

Inventor： Gurtej Singh G. Chandok ,  Christopher M. Garrido ,  Chieh Lu ,  Daniel B. Pollack ,  Karthick Santhanam ,  David L. Biderman ,  Jinbo Qui ,  Dazhong Zhang ,  Jose A. Lozano Hinojosa ,  Igor Kobzar

IPC: H04N7/15 ,  H04N19/40

Abstract: Participant systems in an audiovisual (AV) conferencing can, in one embodiment, use methods to ensure that all participants have a common platform to support AV conferencing, such as a common codec, and also attempt to provide higher quality AV conferencing (e.g., better than the common codec) based on available bandwidth and other criteria. The participant systems can use the common codec as a fallback platform when bandwidth or other criteria dictate a reduction in the quality of the AV conferencing. Other embodiments are also disclosed.

公开(公告)号：US11991566B2

公开(公告)日：2024-05-21

申请号：US16145071

申请日：2018-09-27

Applicant: Apple Inc.

Inventor： Joe S. Abuan ,  Ian J. Baird ,  Xiaosong Zhou ,  Christopher M. Garrido ,  Dazhong Zhang ,  Keith W. Rauenbuehler ,  Yan Yang ,  Patrick Miauton ,  Eric L. Chien ,  Berkat S. Tung ,  Karthick Santhanam

IPC: H04W36/00 ,  G06F9/48 ,  H04B17/318 ,  H04B17/336 ,  H04L9/08 ,  H04L9/40 ,  H04L12/18 ,  H04L65/403 ,  H04L67/14 ,  H04L67/141 ,  H04L67/143 ,  H04W4/08 ,  H04W12/0433 ,  H04W12/06 ,  H04W36/02

CPC classification number: H04W36/0033 ,  G06F9/4856 ,  H04L9/0819 ,  H04L12/1822 ,  H04L12/1827 ,  H04L12/185 ,  H04L12/189 ,  H04L63/065 ,  H04L65/403 ,  H04L67/14 ,  H04L67/141 ,  H04L67/143 ,  H04W4/08 ,  H04W12/0433 ,  H04W12/06 ,  H04W36/0009 ,  H04W36/0016 ,  H04W36/0022 ,  H04W36/0027 ,  H04W36/0058 ,  H04W36/02 ,  H04B17/318 ,  H04B17/336

Abstract: A device implementing the subject technology may include at least one processor configured to transmit an allocation request requesting allocation of a group communication session with a plurality of devices and receive an allocation response in response to the allocation request, the allocation response including credential information for the device to use to join the group communication session. The at least one processor may be further configured to transmit an allocation bind request with the credential information to join the group communication session using the credential information and receive an allocation bind success response in response to the allocation bind request, the allocation bind success response indicating that the device has joined the group communication session. The at least one processor may be further configured to provide a join notification to the plurality of devices via an intermediary device to notify that the device has joined the group communication session.

公开(公告)号：US11818394B2

公开(公告)日：2023-11-14

申请号：US17207267

申请日：2021-03-19

Applicant: Apple Inc.

Inventor： Jae Hoon Kim ,  Xiaosong Zhou ,  Dazhong Zhang ,  Hang Yuan ,  Jiefu Zhai ,  Chris Y. Chung ,  Hsi-Jung Wu

IPC: H04N19/176 ,  H04N19/105 ,  H04N19/597 ,  H04N19/547

CPC classification number: H04N19/597 ,  H04N19/105 ,  H04N19/176 ,  H04N19/547

Abstract: Techniques are disclosed for coding video data predictively based on predictions made from spherical-domain projections of input pictures to be coded and reference pictures that are prediction candidates. Spherical projection of an input picture and the candidate reference pictures may be generated. Thereafter, a search may be conducted for a match between the spherical-domain representation of a pixel block to be coded and a spherical-domain representation of the reference picture. On a match, an offset may be determined between the spherical-domain representation of the pixel block to a matching portion of the of the reference picture in the spherical-domain representation. The spherical-domain offset may be transformed to a motion vector in a source-domain representation of the input picture, and the pixel block may be coded predictively with reference to a source-domain representation of the matching portion of the reference picture.

公开(公告)号：US11627343B2

公开(公告)日：2023-04-11

申请号：US17188473

申请日：2021-03-01

Applicant: Apple Inc.

Inventor： Xiaohua Yang ,  Alexandros Tourapis ,  Dazhong Zhang ,  Hang Yuan ,  Hsi-Jung Wu ,  Jae Hoon Kim ,  Jiefu Zhai ,  Ming Chen ,  Xiaosong Zhou

IPC: H04N19/52 ,  H04N19/90 ,  H04N19/597 ,  H04N21/2343 ,  G06F3/01

Abstract: In communication applications, aggregate source image data at a transmitter exceeds the data that is needed to display a rendering of a viewport at a receiver. Improved streaming techniques that include estimating a location of a viewport at a future time. According to such techniques, the viewport may represent a portion of an image from a multi-directional video to be displayed at the future time, and tile(s) of the image may be identified in which the viewport is estimated to be located. In these techniques, the image data of tile(s) in which the viewport is estimated to be located may be requested at a first service tier, and the other tile in which the viewport is not estimated to be located may be requested at a second service tier, lower than the first service tier.

公开(公告)号：US20210227236A1

公开(公告)日：2021-07-22

申请号：US17221299

申请日：2021-04-02

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Dazhong Zhang ,  Hang Yuan ,  Hsi-Jung Wu ,  Jae Hoon Kim ,  Jiefu Zhai ,  Ming Chen ,  Xiaosong Zhou

IPC: H04N19/29 ,  H04N19/103 ,  G09G5/14 ,  H04N21/44

Abstract: Aspects of the present disclosure provide techniques for reducing latency and improving image quality of a viewport extracted from multi-directional video communications. According to such techniques, first streams of coded video data are received from a source. The first streams include coded data for each of a plurality of tiles representing a multi-directional video, where each tile corresponding to a predetermined spatial region of the multi-directional video, and at least one tile of the plurality of tiles in the first streams contains a current viewport location at a receiver. The techniques include decoding the first streams and displaying the tile containing the current viewport location. When the viewport location at the receiver changes to include a new tile of the plurality of tiles, retrieving and decoding first streams for the new tile, displaying the decoded content for the changed viewport location, and transmitting the changed viewport location to the source.

公开(公告)号：US10999767B2

公开(公告)日：2021-05-04

申请号：US16145078

申请日：2018-09-27

Applicant: Apple Inc.

Inventor： Joe S. Abuan ,  Ian J. Baird ,  Xiaosong Zhou ,  Christopher M. Garrido ,  Dazhong Zhang ,  Keith W. Rauenbuehler ,  Yan Yang ,  Patrick Miauton ,  Eric L. Chien ,  Berkat S. Tung ,  Karthick Santhanam

IPC: H04W36/00 ,  H04L29/08 ,  H04W4/08 ,  H04L29/06 ,  H04W12/04 ,  H04W12/06 ,  G06F9/48 ,  H04W36/02 ,  H04L12/18 ,  H04L9/08 ,  H04B17/318 ,  H04B17/336

Abstract: A device implementing the subject technology may include at least one processor configured to receive an indication of a task being performed at an other device. The at least one processor is further configured to perform, in response to receipt of the indication, one or more preliminary operations in anticipation of receiving a handoff of the task. The at least one processor is further configured to receive, after performing the one or more preliminary operations, a notification that the task is being handed off. The at least one processor is further configured to receive the handoff of the task from the other device. The at least one processor is further configured to continue to perform the task based at least in part on the one or more preliminary operations that were performed prior to receiving the notification that the task is being handed off.

公开(公告)号：US10939139B2

公开(公告)日：2021-03-02

申请号：US16204792

申请日：2018-11-29

Applicant: Apple Inc.

Inventor： Xiaohua Yang ,  Alexandros Tourapis ,  Dazhong Zhang ,  Hang Yuan ,  Hsi-Jung Wu ,  Jae Hoon Kim ,  Jiefu Zhai ,  Ming Chen ,  Xiaosong Zhou

IPC: H04N19/52 ,  H04N19/90 ,  H04N19/597 ,  H04N21/2343 ,  G06F3/01

Abstract: In communication applications, aggregate source image data at a transmitter exceeds the data that is needed to display a rendering of a viewport at a receiver. Improved streaming techniques that include estimating a location of a viewport at a future time. According to such techniques, the viewport may represent a portion of an image from a multi-directional video to be displayed at the future time, and tile(s) of the image may be identified in which the viewport is estimated to be located. In these techniques, the image data of tile(s) in which the viewport is estimated to be located may be requested at a first service tier, and the other tile in which the viewport is not estimated to be located may be requested at a second service tier, lower than the first service tier.

公开(公告)号：US10931725B2

公开(公告)日：2021-02-23

申请号：US16147527

申请日：2018-09-28

Applicant: Apple Inc.

Inventor： Christopher M. Garrido ,  Thomas P. Devanneaux ,  Yan Yang ,  Ming Jin ,  Vu H. Chiem ,  Patrick Miauton ,  Karthick Santhanam ,  David L. Biderman ,  Hsien-Po Shiang ,  Eric L. Chien ,  Xiaoxiao Zheng ,  Bess C. Chan ,  Komei Harada ,  Dazhong Zhang

IPC: H04L29/06 ,  H04N7/14 ,  H04N7/15

Abstract: A device implementing a system for audio-video conferencing using multiple stream identifiers includes a processor configured to receive, from a sending device, indication of a first content stream and a first stream identifier, and indication of a second content stream and a second stream identifier associated. The first content stream and the second content stream correspond to different bit rates of streaming content. The processor is configured to receive, from a receiving device, a request to subscribe to the second content stream, the request including the second stream identifier, and receive, from the sending device, an indication that the second stream identifier has been associated with the first content stream. The processor is configured to forward, to the receiving device, the first content stream based on the request to subscribe to the second content stream and on the indication that the second stream identifier has been associated with the first content stream.

公开(公告)号：US20200296426A1

公开(公告)日：2020-09-17

申请号：US16890245

申请日：2020-06-02

Applicant: Apple Inc.

Inventor： Jiefu Zhai ,  Dazhong Zhang ,  Xiaosong Zhou ,  Chris Y. Chung ,  Hsi-Jung Wu ,  Peikang Song ,  David R. Conrad ,  Jae Hoon Kim ,  Yunfei Zheng

IPC: H04N19/82 ,  H04N19/186

Abstract: Chroma deblock filtering of reconstructed video samples may be performed to remove blockiness artifacts and reduce color artifacts without over-smoothing. In a first method, chroma deblocking may be performed for boundary samples of a smallest transform size, regardless of partitions and coding modes. In a second method, chroma deblocking may be performed when a boundary strength is greater than 0. In a third method, chroma deblocking may be performed regardless of boundary strengths. In a fourth method, the type of chroma deblocking to be performed may be signaled in a slice header by a flag. Furthermore, luma deblock filtering techniques may be applied to chroma deblock filtering.

公开(公告)号：US10708623B2

公开(公告)日：2020-07-07

申请号：US16050744

申请日：2018-07-31

Applicant: Apple Inc.

Inventor： Jiefu Zhai ,  Dazhong Zhang ,  Xiaosong Zhou ,  Chris Y. Chung ,  Hsi-Jung Wu ,  Peikang Song ,  David R. Conrad ,  Jae Hoon Kim ,  Yunfei Zheng

IPC: H04N19/82 ,  H04N19/186

Abstract: Chroma deblock filtering of reconstructed video samples may be performed to remove blockiness artifacts and reduce color artifacts without over-smoothing. In a first method, chroma deblocking may be performed for boundary samples of a smallest transform size, regardless of partitions and coding modes. In a second method, chroma deblocking may be performed when a boundary strength is greater than 0. In a third method, chroma deblocking may be performed regardless of boundary strengths. In a fourth method, the type of chroma deblocking to be performed may be signaled in a slice header by a flag. Furthermore, luma deblock filtering techniques may be applied to chroma deblock filtering.