公开(公告)号：US20150350654A1

公开(公告)日：2015-12-03

申请号：US14290432

申请日：2014-05-29

Applicant: Apple Inc.

Inventor： Chris Y. Chung ,  Hsi-Jung Wu ,  Xiaosong Zhou ,  Dazhong Zhang

IPC: H04N19/146 ,  H04N19/156 ,  H04N19/51 ,  H04N19/172 ,  H04N19/46 ,  H04N19/127 ,  H04N19/44

CPC classification number: H04N19/46 ,  H04N19/132 ,  H04N19/154 ,  H04N19/156 ,  H04N19/164 ,  H04N19/172 ,  H04N19/587

Abstract: During video coding, frame rate conversion (FRC) capabilities of a decoder may be estimated. Based on the estimated FRC capabilities, an encoder may select a frame rate for a video coding session and may alter a frame rate of source video to match the selected frame rate. Thereafter, the resultant video may be coded and output to a channel. By incorporating knowledge of a decoder's FRC capabilities as source video is being coded, an encoder may reduce the frame rate of source video opportunistically. Bandwidth that is conserved by avoiding coding of video data in excess of the selected frame rate may be directed to coding of the remaining video at a higher bitrate, which can lead to increased quality of the coding session as a whole.

Abstract translation: 在视频编码期间，可以估计解码器的帧速率转换（FRC）能力。 基于估计的FRC能力，编码器可以选择用于视频编码会话的帧速率，并且可以改变源视频的帧速率以匹配所选择的帧速率。 此后，所得到的视频可被编码并输出到频道。 当编码源视频时，通过结合解码器的FRC能力的知识，编码器可以机会地降低源视频的帧速率。 通过避免超过所选帧速率的视频数据的编码而节省的带宽可以以更高的比特率对剩余视频进行编码，这可以导致整个编码会话的质量提高。

公开(公告)号：US20150350514A1

公开(公告)日：2015-12-03

申请号：US14726331

申请日：2015-05-29

Applicant: Apple Inc.

Inventor： Jiefu Zhai ,  Xiaosong Zhou ,  Chris Y. Chung ,  Hsi-Jung Wu

IPC: H04N5/235 ,  H04N19/59

CPC classification number: H04N5/2355 ,  H04N5/23219 ,  H04N5/2351 ,  H04N5/2353 ,  H04N19/115 ,  H04N19/117 ,  H04N19/14 ,  H04N19/154 ,  H04N19/156 ,  H04N19/176

Abstract: Systems and methods are provided for capturing high quality video data, including data having a high dynamic range, for use with conventional encoders and decoders. High dynamic range data is captured using multiple groups of pixels where each group is captured using different exposure times to create groups of pixels. The pixels that are captured at different exposure times may be determined adaptively based on the content of the image, the parameters of the encoding system, or on the available resources within the encoding system. The transition from single exposure to using two different exposure times may be implemented gradually.

Abstract translation: 提供了系统和方法，用于捕获高质量视频数据，包括具有高动态范围的数据，用于常规编码器和解码器。 使用多组像素捕获高动态范围数据，其中使用不同的曝光时间拍摄每组，以创建像素组。 可以基于图像的内容，编码系统的参数或编码系统内的可用资源自适应地确定在不同曝光时间捕获的像素。 从单次曝光到使用两种不同曝光时间的过渡可能逐渐实现。

公开(公告)号：US08830892B2

公开(公告)日：2014-09-09

申请号：US13667814

申请日：2012-11-02

Applicant: Apple Inc.

Inventor： Chris Y. Chung ,  Wen Zhao ,  Luciano M. Verger ,  Hyeonkuk Jeong ,  Gang Lu ,  Srinivasan Vasudevan ,  Xiaosong Zhou ,  Hsi-Jung Wu ,  James O. Normile

IPC: G08C17/00

CPC classification number: H04N7/15 ,  H04L12/1827 ,  H04L65/1069 ,  H04N5/23241 ,  H04N5/372 ,  H04W52/02 ,  H04W52/0209 ,  H04W52/0216 ,  Y02D70/00 ,  Y02D70/1224 ,  Y02D70/1242 ,  Y02D70/1262 ,  Y02D70/142 ,  Y02D70/144 ,  Y02D70/146 ,  Y02D70/164 ,  Y02D70/168 ,  Y02D70/24

Abstract: In video conferencing over a radio network, the radio equipment is a major power consumer especially in cellular networks such as LTE. In order to reduce the radio power consumption in video conferencing, it is important to introduce an enough radio inactive time. Several types of data buffering and bundling can be employed within a reasonable range of latency that doesn't significantly disrupt the real-time nature of video conferencing. In addition, the data transmission can be synchronized to the data reception in a controlled manner, which can result in an even longer radio inactive time and thus take advantage of radio power saving modes such as LTE C-DRX.

Abstract translation: 在无线电网络的视频会议中，无线电设备是主要的电力消费者，特别是在诸如LTE的蜂窝网络中。 为了降低视频会议中的无线电功耗，重要的是要引入足够的无线电时间。 几种类型的数据缓冲和捆绑可以在合理的延迟范围内使用，不会显着破坏视频会议的实时性质。 此外，可以以受控的方式将数据传输同步到数据接收，这可以导致更长的无线电时间，从而利用诸如LTE C-DRX之类的无线电节能模式。

公开(公告)号：US20140044194A1

公开(公告)日：2014-02-13

申请号：US13715088

申请日：2012-12-14

Applicant: APPLE INC.

Inventor： David W. Singer ,  Alexandros Tourapis ,  Athanasios Leontaris ,  Xiaosong Zhou

IPC: H04N7/26

CPC classification number: H04N19/13 ,  H04N19/117 ,  H04N19/174 ,  H04N19/436 ,  H04N19/70

Abstract: In a communication system, parallel encoding and decoding of serially-coded data occurs in a manner that supports low latency communication. A plurality of data items may be coded as serially-coded data sequences and a transmission sequence may be built from them. An index table may be built having a plurality of entries representing respective start points of the serially-coded data sequences within the transmission sequence. The transmission sequence may be transmitted to a channel and, thereafter, the index table may be transmitted. Latencies otherwise involved in inserting an index table into the beginning of a transmission sequence may be avoided.

Abstract translation: 在通信系统中，串行编码数据的并行编码和解码以支持低延迟通信的方式发生。 多个数据项可以被编码为串行编码数据序列，并且可以从它们构建传输序列。 可以构建索引表，其具有表示传输序列内的串行编码数据序列的相应开始点的多个条目。 发送序列可以被发送到信道，此后可以发送索引表。 可以避免将索引表插入到传输序列的开始处的延迟。

公开(公告)号：US20130265378A1

公开(公告)日：2013-10-10

申请号：US13889261

申请日：2013-05-07

Applicant: APPLE INC.

Inventor： Joe S. Abuan ,  David A. Eldred ,  Hyeonkuk Jeong ,  Roberto Garcia, JR. ,  Hsi-Jung Wu ,  Xiaosong Zhou ,  Elizabeth C. Cranfill ,  James O. Normile

IPC: H04N7/14

CPC classification number: H04N7/141 ,  G06F3/04817 ,  G06F3/04842 ,  G06F3/04886 ,  G06F9/451 ,  G09G5/14 ,  H04M1/72583 ,  H04N5/2258 ,  H04N5/2624 ,  H04N5/272 ,  H04N7/147 ,  H04N7/15

Abstract: Some embodiments provide a method for conducting a video conference between a first mobile device and a second device. The first mobile device includes first and second cameras. The method selects the first camera for capturing images. The method transmits images captured by the first camera to the second device. The method receives selections of the second camera for capturing images during the video conference. The method terminates the transmission of images captured by the first camera and transmits images captured by the second camera of the first mobile device to the second device during the video conference.

Abstract translation: 一些实施例提供了一种用于在第一移动设备和第二设备之间进行视频会议的方法。 第一移动设备包括第一和第二相机。 该方法选择用于捕获图像的第一相机。 该方法将由第一相机拍摄的图像发送到第二设备。 该方法在视频会议期间接收用于捕获图像的第二相机的选择。 该方法终止由第一相机拍摄的图像的传输，并且在视频会议期间将由第一移动设备的第二相机拍摄的图像发送到第二设备。

公开(公告)号：US20240146892A1

公开(公告)日：2024-05-02

申请号：US18407198

申请日：2024-01-08

Applicant: Apple Inc.

Inventor： Fanyi Duanmu ,  Jun Xin ,  Hsi-Jung Wu ,  Xiaosong Zhou

IPC: H04N13/117 ,  H04N13/178 ,  H04N21/218 ,  H04N21/24

CPC classification number: H04N13/117 ,  H04N13/178 ,  H04N21/21805 ,  H04N21/2401 ,  H04N21/2402

Abstract: A system obtains a data set representing immersive video content for display at a display time, including first data representing the content according to a first level of detail, and second data representing the content according to a second higher level of detail. During one or more first times prior to the display time, the system causes at least a portion of the first data to be stored in a buffer. During one or more second times prior to the display time, the system generates a prediction of a viewport for displaying the content to a user at the display time, identifies a portion of the second data corresponding to the prediction of the viewport, and causes the identified portion of the second data to be stored in the video buffer. At the display time, the system causes the content to be displayed to the user using the video buffer.

公开(公告)号：US11956295B2

公开(公告)日：2024-04-09

申请号：US16825381

申请日：2020-03-20

Applicant: Apple Inc.

Inventor： Fanyi Duanmu ,  Alexandros Tourapis ,  Jun Xin ,  Hsi-Jung Wu ,  Xiaosong Zhou

IPC: H04L65/75 ,  H04L65/70 ,  H04N13/111 ,  H04N13/161 ,  H04N13/194 ,  H04N13/344

CPC classification number: H04L65/764 ,  H04L65/70 ,  H04N13/111 ,  H04N13/161 ,  H04N13/194 ,  H04N13/344

Abstract: Techniques for multi-view video streaming are described in the present disclosure, wherein a viewport prediction may be employed at a client-end based on analysis of pre-fetched media item data and ancillary information. A streaming method may first prefetch a portion of content of a multi-view media item. The method may next identify a salient region from the prefetched content and may then download additional content of the media item that corresponds to the identified salient region.

公开(公告)号：US11553200B2

公开(公告)日：2023-01-10

申请号：US16871378

申请日：2020-05-11

Applicant: Apple Inc.

Inventor： Xing Wen ,  Dazhong Zhang ,  Peikang Song ,  Xiaosong Zhou ,  Sudeng Hu ,  Hsi-Jung Wu ,  Jae Hoon Kim

IPC: H04N19/51 ,  H04N19/44 ,  H04N19/65 ,  H04N19/176 ,  H04N19/91

Abstract: Techniques are disclosed for coding and decoding video data using object recognition and object modeling as a basis of coding and error recovery. A video decoder may decode coded video data received from a channel. The video decoder may perform object recognition on decoded video data obtained therefrom, and, when an object is recognized in the decoded video data, the video decoder may generate a model representing the recognized object. It may store data representing the model locally. The video decoder may communicate the model data to an encoder, which may form a basis of error mitigation and recovery. The video decoder also may monitor deviation patterns in the object model and associated patterns in audio content; if/when video decoding is suspended due to operational errors, the video decoder may generate simulated video data by analyzing audio data received during the suspension period and developing video data from the data model and deviation(s) associated with patterns detected from the audio data.

公开(公告)号：US11184415B2

公开(公告)日：2021-11-23

申请号：US16405864

申请日：2019-05-07

Applicant: Apple Inc.

Inventor： Christopher M. Garrido ,  Dazhong Zhang ,  Karthick Santhanam ,  Patrick Miauton ,  Xiaoxiao Zheng ,  Bess Chan ,  Peter Shiang ,  Sudeng Hu ,  Peikang Song ,  Xiaosong Zhou

IPC: H04L29/06 ,  H04L29/08 ,  H04N21/235 ,  H04N21/6583

Abstract: Techniques presented herein provide an improved relay user experience and improved management of scarce computing and network resources as the number of relay endpoints increases. A sourcing endpoint device may generate a media feed, such as video and/or audio feed, representing contribution from a conference participant. The sourcing endpoint device may generate a priority value for the media feed, and the priority value may be transmitted to other members of the relay along with the input feed. Priority values of the different relay participants may be used by other devices, for example, intermediate servers or receiving endpoint devices, to manage aspects of the relay. For example, a relay server may prune streams from select endpoint devices based on relative priority values received from those devices. Alternatively, receiving endpoint devices may alter presentation of received feeds based on their associated priority values.

公开(公告)号：US11102515B2

公开(公告)日：2021-08-24

申请号：US16890245

申请日：2020-06-02

Applicant: Apple Inc.

Inventor： Jiefu Zhai ,  Dazhong Zhang ,  Xiaosong Zhou ,  Chris Y. Chung ,  Hsi-Jung Wu ,  Peikang Song ,  David R. Conrad ,  Jae Hoon Kim ,  Yunfei Zheng

IPC: H04N19/82 ,  H04N19/186

Abstract: Chroma deblock filtering of reconstructed video samples may be performed to remove blockiness artifacts and reduce color artifacts without over-smoothing. In a first method, chroma deblocking may be performed for boundary samples of a smallest transform size, regardless of partitions and coding modes. In a second method, chroma deblocking may be performed when a boundary strength is greater than 0. In a third method, chroma deblocking may be performed regardless of boundary strengths. In a fourth method, the type of chroma deblocking to be performed may be signaled in a slice header by a flag. Furthermore, luma deblock filtering techniques may be applied to chroma deblock filtering.