公开(公告)号：US20180035113A1

公开(公告)日：2018-02-01

申请号：US15682922

申请日：2017-08-22

Applicant: Apple Inc.

Inventor： Jae Hoon Kim ,  Chris Y. Chung ,  Hsi-Jung Wu ,  Dazhong Zhang ,  Yunfei Zheng ,  Xiaosong Zhou

IPC: H04N19/129 ,  H04N19/184

CPC classification number: H04N19/129 ,  H04N19/117 ,  H04N19/136 ,  H04N19/176 ,  H04N19/184 ,  H04N19/186 ,  H04N19/46 ,  H04N19/70 ,  H04N19/82 ,  H04N19/86

Abstract: Methods and systems provide efficient sample adaptive offset (SAO) signaling by reducing a number of bits consumed for signaling SAO compared with conventional methods. In an embodiment, a single flag is used if a coding unit to a first scanning direction with respect to a given coding unit is off. In an embodiment, further bits may be saved if some neighboring coding units are not present, i.e. the given coding unit is an edge. For example, a flag may be skipped, e.g., not signaled, if the given coding unit does not have a neighbor. In an embodiment, a syntax element, one or more flags may signal whether SAO filtering is performed in a coding unit. Based on the syntax element, a merge flag may be skipped to save bits. In an embodiment, SAO syntax may be signaled at a slice level.

公开(公告)号：US20150350646A1

公开(公告)日：2015-12-03

申请号：US14289082

申请日：2014-05-28

Applicant: Apple Inc.

Inventor： Yunfei Zheng ,  Dazhong Zhang ,  Xiaosong Zhou ,  Chris Y. Chung ,  Hsi-Jung Wu

IPC: H04N19/115 ,  H04N19/44 ,  H04N19/176 ,  H04N19/96 ,  H04N19/157

CPC classification number: H04N19/70

Abstract: An encoding system may include a video source that captures video image, a video coder, and a controller to manage operation of the system. The video coder may encode the video image into encoded video data using a plurality of subgroup parameters corresponding to a plurality of subgroups of pixels within a group. The controller may set the subgroup parameters for at least one of the subgroups of pixels in the video coder, based upon at least one parameters corresponding to the group. A decoding system may decode the video data based upon the motion prediction parameters.

Abstract translation: 编码系统可以包括捕获视频图像的视频源，视频编码器和用于管理系统的操作的控制器。 视频编码器可以使用与组内的多个像素组对应的多个子组参数将视频图像编码成编码视频数据。 基于对应于该组的至少一个参数，控制器可以为视频编码器中的至少一个像素组设置子组参数。 解码系统可以基于运动预测参数解码视频数据。

公开(公告)号：US20150350560A1

公开(公告)日：2015-12-03

申请号：US14290351

申请日：2014-05-29

Applicant: Apple Inc.

Inventor： Xiaosong Zhou ,  Hsi-Jung Wu ,  Chris Y. Chung ,  James O. Normile ,  Dazhong Zhang

IPC: H04N5/262 ,  H04N19/132 ,  H04N19/167

CPC classification number: H04N5/262 ,  H04N19/115 ,  H04N19/124 ,  H04N19/132 ,  H04N19/136 ,  H04N19/167 ,  H04N19/17

Abstract: Techniques for coding video data estimate depths of different elements within video content and identify regions within the video content based on the estimated depths. One of the regions may be assigned as an area of interest. Thereafter, video content of a region that is not an area of interest may be masked out and the resultant video content obtained from the masking may be coded. The coded video content may be transmitted to a channel. These techniques permit a coding terminal to mask out captured video content prior to coding in order to support coding policies that account for privacy interests or video composition features during a video coding session.

Abstract translation: 用于编码视频数据的技术估计视频内容中的不同元素的深度，并基于估计的深度识别视频内容内的区域。 其中一个地区可能被分配为感兴趣的区域。 此后，可以屏蔽不是感兴趣区域的区域的视频内容，并且可以对从屏蔽获得的结果视频内容进行编码。 编码的视频内容可以被发送到频道。 这些技术允许编码终端在编码之前掩蔽捕获的视频内容，以便在视频编码会话期间支持考虑隐私兴趣或视频合成特征的编码策略。

公开(公告)号：US08683301B2

公开(公告)日：2014-03-25

申请号：US13785859

申请日：2013-03-05

Applicant: Apple Inc.

Inventor： Xiaosong Zhou ,  Hyeonkuk Jeong ,  Yan Yang ,  Dazhong Zhang ,  Hsi-Jung Wu

IPC: H03M13/00

CPC classification number: H03M13/05 ,  H03M13/1102 ,  H03M13/1515 ,  H03M13/152 ,  H03M13/27 ,  H03M13/29 ,  H03M13/2957 ,  H03M13/373 ,  H03M13/3746 ,  H04L1/005 ,  H04L1/0057 ,  H04L1/008

Abstract: Coded video data may be transmitted between an encoder and a decoder using multiple FEC codes and/or packets for error detection and correction. Only a subset of the FEC packets need be transmitted between the encoder and decoder. The FEC packets of each FEC group may take, as inputs, data packets of a current FEC group and also an untransmitted FEC packet of a preceding FEC group. Due to relationships among the FEC packets, when transmission errors arise and data packets are lost, there remain opportunities for a decoder to recover lost data packets from earlier-received FEC groups when later-received FEC groups are decoded. This opportunity to recover data packets from earlier FEC groups may be useful in video coding and other systems, in which later-received data often cannot be decoded unless earlier-received data is decoded properly.

Abstract translation: 可以在编码器和解码器之间使用多个用于错误检测和校正的FEC码和/或包进行编码的视频数据。 只有FEC数据包的一部分需要在编码器和解码器之间传输。 每个FEC组的FEC分组可以采用当前FEC组的数据分组和前一个FEC组的未发送FEC分组的输入。 由于FEC分组之间的关系，当传输错误出现并且数据分组丢失时，当稍后接收的FEC组被解码时，解码器仍然有机会恢复来自早先接收的FEC组的丢失的数据分组。 从先前的FEC组恢复数据分组的机会在视频编码和其他系统中可能是有用的，其中后期接收的数据通常不能被解码，除非先前接收到的数据被正确解码。

公开(公告)号：US12096044B2

公开(公告)日：2024-09-17

申请号：US18181261

申请日：2023-03-09

Applicant: Apple Inc.

Inventor： Xiaohua Yang ,  Alexandros Tourapis ,  Dazhong Zhang ,  Hang Yuan ,  Hsi-Jung Wu ,  Jae Hoon Kim ,  Jiefu Zhai ,  Ming Chen ,  Xiaosong Zhou

IPC: H04N19/90 ,  G06F3/01 ,  H04N19/52 ,  H04N19/597 ,  H04N21/2343

CPC classification number: H04N19/90 ,  G06F3/013 ,  H04N19/52 ,  H04N19/597 ,  H04N21/234345

Abstract: In communication applications, aggregate source image data at a transmitter exceeds the data that is needed to display a rendering of a viewport at a receiver. Improved streaming techniques that include estimating a location of a viewport at a future time. According to such techniques, the viewport may represent a portion of an image from a multi-directional video to be displayed at the future time, and tile(s) of the image may be identified in which the viewport is estimated to be located. In these techniques, the image data of tile(s) in which the viewport is estimated to be located may be requested at a first service tier, and the other tile in which the viewport is not estimated to be located may be requested at a second service tier, lower than the first service tier.

公开(公告)号：US20240305682A1

公开(公告)日：2024-09-12

申请号：US18600378

申请日：2024-03-08

Applicant: Apple Inc.

Inventor： Jay Mayur Khandhar ,  Borna Ghavam ,  Jinbo Qiu ,  Christopher M. Garrido ,  Karthick Santhanam ,  Patrick Miauton ,  Xiaosong Zhou ,  Dazhong Zhang ,  Kristian D. Pereira ,  Dan Miao

IPC: H04L65/75 ,  G06F3/01 ,  G06T13/40 ,  G06V10/25

CPC classification number: H04L65/762 ,  G06F3/013 ,  G06T13/40 ,  G06V10/25

Abstract: A technique for transmitting data in a copresence environment includes initiating a virtual communication session between a local device and remote devices in a shared copresence environment, where each of the plurality of sending devices are transmitting a sending quality data stream in the virtual communication session. A region of interest for the local device is determined that includes a portion of the copresence environment. The local device subscribes to a first quality data stream for the remote devices represented in the region of interest, and a second quality data stream for the remote devices not represented in the region of interest.

公开(公告)号：US20220394212A1

公开(公告)日：2022-12-08

申请号：US17661947

申请日：2022-05-04

Applicant: Apple Inc.

Inventor： Gurtej Singh G. Chandok ,  Christopher M. Garrido ,  Chieh Lu ,  Daniel B. Pollack ,  Karthick Santhanam ,  David L. Biderman ,  Jinbo Qui ,  Dazhong Zhang ,  Jose A. Lozano Hinojosa ,  Igor Kobzar

IPC: H04N7/15 ,  H04N19/40

Abstract: Participant systems in an audiovisual (AV) conferencing can, in one embodiment, use methods to ensure that all participants have a common platform to support AV conferencing, such as a common codec, and also attempt to provide higher quality AV conferencing (e.g., better than the common codec) based on available bandwidth and other criteria. The participant systems can use the common codec as a fallback platform when bandwidth or other criteria dictate a reduction in the quality of the AV conferencing. Other embodiments are also disclosed.

公开(公告)号：US20220329756A1

公开(公告)日：2022-10-13

申请号：US17846896

申请日：2022-06-22

Applicant: Apple Inc.

Inventor： Jae Hoon Kim ,  Chris Y. Chung ,  Dazhong Zhang ,  Hang Yuan ,  Hsi-Jung Wu ,  Xiaosong Zhou ,  Jiefu Zhai

IPC: H04N7/14 ,  H04N7/15 ,  G06F3/0488

Abstract: Embodiments of the present disclosure provide systems and methods for perspective shifting in a video conferencing session. In one exemplary method, a video stream may be generated. A foreground element may be identified in a frame of the video stream and distinguished from a background element of the frame. Data may be received representing a viewing condition at a terminal that will display the generated video stream. The frame of the video stream may be modified based on the received data to shift of the foreground element relative to the background element. The modified video stream may be displayed at the displaying terminal.

公开(公告)号：US11093752B2

公开(公告)日：2021-08-17

申请号：US15613130

申请日：2017-06-02

Applicant: Apple Inc.

Inventor： Jae Hoon Kim ,  Ming Chen ,  Hang Yuan ,  Jiefu Zhai ,  Dazhong Zhang ,  Xiaosong Zhou ,  Chris Chung ,  Hsi-Jung Wu

IPC: G06K9/00 ,  G06T7/292 ,  G06K9/32

Abstract: Techniques are disclosed for managing display of content from multi-view video data. According to these techniques, an object may be identified from content of the multi-view video. The object's location may be tracked across a sequence of multi-view video. The technique may extract a sub-set of video that is contained within a view window that is shifted in an image space of the multi-view video in correspondence to the tracked object's location. These techniques may be implemented either in an image source device or an image sink device.

公开(公告)号：US10999583B2

公开(公告)日：2021-05-04

申请号：US16132219

申请日：2018-09-14

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Dazhong Zhang ,  Hang Yuan ,  Hsi-Jung Wu ,  Jae Hoon Kim ,  Jiefu Zhai ,  Ming Chen ,  Xiaosong Zhou

IPC: H04N19/29 ,  H04N19/103 ,  G09G5/14 ,  H04N21/44

Abstract: Aspects of the present disclosure provide techniques for reducing latency and improving image quality of a viewport extracted from multi-directional video communications. According to such techniques, first streams of coded video data are received from a source. The first streams include coded data for each of a plurality of tiles representing a multi-directional video, where each tile corresponding to a predetermined spatial region of the multi-directional video, and at least one tile of the plurality of tiles in the first streams contains a current viewport location at a receiver. The techniques include decoding the first streams and displaying the tile containing the current viewport location. When the viewport location at the receiver changes to include a new tile of the plurality of tiles, retrieving and decoding first streams for the new tile, displaying the decoded content for the changed viewport location, and transmitting the changed viewport location to the source.