公开(公告)号：US20190005709A1

公开(公告)日：2019-01-03

申请号：US15638587

申请日：2017-06-30

Applicant: Apple Inc.

Inventor： Jae Hoon Kim ,  Dazhong Zhang ,  Hang Yuan ,  Hsi-Jung Wu ,  Jiefu Zhai ,  Ming Chen ,  Xiaosong Zhou

IPC: G06T15/20 ,  H04N13/02 ,  H04N5/232 ,  H04N19/117

Abstract: Techniques are disclosed for correcting artifacts in multi-view images that include a plurality of planar views. Image content the planar views may be projected from the planar representation to a spherical projection. Thereafter, a portion of the image content may be projected from the spherical projection to a planar representation. The image content of the planar representation may be used for display. Extensions are disclosed that correct artifacts that may arise during deblocking filtering of the multi-view images.

公开(公告)号：US20190004414A1

公开(公告)日：2019-01-03

申请号：US15638848

申请日：2017-06-30

Applicant: Apple Inc.

Inventor： Jae Hoon Kim ,  Ming Chen ,  Xiaosong Zhou ,  Hsi-Jung Wu ,  Dazhong Zhang ,  Hang Yuan ,  Jiefu Zhai ,  Chris Y. Chung

IPC: G03B37/04 ,  G06T3/40 ,  H04N5/232 ,  H04N13/02 ,  H04N19/172 ,  H04N19/159

Abstract: Techniques are described for implementing format configurations for multi-directional video and for switching between them. Source images may be assigned to formats that may change during a coding session. When a change occurs between formats, video coders and decoder may transform decoded reference frames from the first format to the second format. Thereafter, new frames in the second configuration may be coded or decoded predictively using transformed reference frame(s) as source(s) of prediction. In this manner, video coders and decoders may use intra-coding techniques and achieve high efficiency in coding.

公开(公告)号：US20180262714A1

公开(公告)日：2018-09-13

申请号：US15455890

申请日：2017-03-10

Applicant: Apple Inc.

Inventor： Jae Hoon Kim ,  Chris Y. Chung ,  Dazhong Zhang ,  Hang Yuan ,  Hsi-Jung Wu ,  Xiaosong Zhou ,  Jiefu Zhai

IPC: H04N7/14 ,  H04N7/15 ,  G06T7/194 ,  G06F3/0488

CPC classification number: H04N7/147 ,  G06F3/0488 ,  H04N7/15 ,  H04N13/239 ,  H04N2007/145 ,  H04N2013/0092

Abstract: Embodiments of the present disclosure provide systems and methods for perspective shifting in a video conferencing session. In one exemplary method, a video stream may be generated. A foreground element may be identified in a frame of the video stream and distinguished from a background element of the frame. Data may be received representing a viewing condition at a terminal that will display the generated video stream. The frame of the video stream may be modified based on the received data to shift of the foreground element relative to the background element. The modified video stream may be displayed at the displaying terminal.

公开(公告)号：US20180234700A1

公开(公告)日：2018-08-16

申请号：US15433505

申请日：2017-02-15

Applicant: Apple Inc.

Inventor： Jae Hoon Kim ,  Chris Y. Chung ,  Dazhong Zhang ,  Hang Yuan ,  Hsi-Jung Wu ,  Jiefu Zhai ,  Xiaosong Zhou

IPC: H04N19/597 ,  H04N19/61 ,  H04N19/105 ,  H04N19/513 ,  H04N19/159 ,  H04N19/124 ,  H04N19/13

Abstract: Multi-directional image data often contains distortions of image content that cause problems when processed by video coders that are designed to process traditional, “flat” image content. Embodiments of the present disclosure provide techniques for coding multi-directional image data using such coders. For each pixel block in a frame to be coded, an encoder may transform reference picture data within a search window about a location of the input pixel block based on displacement respectively between the location of the input pixel block and portions of the reference picture within the search window. The encoder may perform a prediction search among the transformed reference picture data to identify a match between the input pixel block and a portion of the transformed reference picture and, when a match is identified, the encoder may code the input pixel block differentially with respect to the matching portion of the transformed reference picture. The transform may counter-act distortions imposed on image content of the reference picture data by the multi-directional format, which aligns the content with image content of the input picture. The techniques apply both for intra-coding and inter-coding.

公开(公告)号：US09992450B1

公开(公告)日：2018-06-05

申请号：US15468919

申请日：2017-03-24

Applicant: Apple Inc.

Inventor： Hang Yuan ,  Chris Y. Chung ,  Dazhong Zhang ,  Hsi-Jung Wu ,  Xiaosong Zhou ,  Jae Hoon Kim ,  Jiefu Zhai

IPC: H04N7/14 ,  H04N7/15 ,  H04N5/262 ,  G06K9/00 ,  G06K9/46

CPC classification number: G06K9/4604 ,  G06K9/00711 ,  G06K2009/4666 ,  H04N5/262 ,  H04N7/147

Abstract: Embodiments of the present disclosure provide systems and methods for background concealment in a video conferencing session. In one exemplary method, a video stream may be captured and provided to a first terminal participating in a video chat session. A background element and a foreground element may be determined in the video stream. A border region may additionally be determined in the video stream. The border region may define a boundary between the foreground element and the background element. The background region may be modified based, at least in part, on video content of the border region. The modified video stream may be transmitted to a second terminal participating in the video conferencing session.

公开(公告)号：US20180091812A1

公开(公告)日：2018-03-29

申请号：US15275076

申请日：2016-09-23

Applicant: Apple Inc.

Inventor： Mei Guo ,  Jae Hoon Kim ,  Jun Xin ,  Feng Yi ,  Yeping Su ,  Dazhong Zhang ,  Chris Chung ,  Xiaosong Zhou ,  Hsi-Jung Wu

IPC: H04N19/117 ,  H04N19/86 ,  H04N19/14 ,  H04N19/15 ,  H04N19/61 ,  H04N19/124 ,  H04N19/13 ,  H04N19/159

CPC classification number: H04N19/117 ,  H04N19/124 ,  H04N19/13 ,  H04N19/134 ,  H04N19/136 ,  H04N19/14 ,  H04N19/15 ,  H04N19/159 ,  H04N19/174 ,  H04N19/176 ,  H04N19/182 ,  H04N19/184 ,  H04N19/186 ,  H04N19/61 ,  H04N19/82 ,  H04N19/86

Abstract: Techniques are disclosed for selecting deblocking filter parameters in a video decoding system. According to these techniques, a boundary strength parameter may be determined based, at least in part, on a bit depth of decoded video data. Activity of a pair of decoded pixel blocks may be classified based, at least in part, on the determined boundary strength parameter, and when a level of activity indicates that deblocking filtering is to be applied to the pair of pixel blocks, pixel block content at a boundary between the pair of pixel blocks may be filtered using filtering parameters derived at least in part based on the bit depth of the decoded video data. The filtering parameters may decrease strength with increasing bit depth of the decoded video data, which improves quality of the decoded video data.

公开(公告)号：US09769473B2

公开(公告)日：2017-09-19

申请号：US13755928

申请日：2013-01-31

Applicant: Apple Inc.

Inventor： Yao-Chung Lin ,  Xiaosong Zhou ,  Hsi-Jung Wu ,  Douglas Scott Price ,  Chris Y. Chung ,  Dazhong Zhang

IPC: H04N19/503 ,  H04N19/51

CPC classification number: H04N19/51 ,  H04N19/503

Abstract: Video coders may perform perspective transformation of reference frames during coding in a manner that conserves processing resources. When a new input frame is available for coding, a camera position for the input frame may be estimated. A video coder may search for reference pictures having similar camera positions as the position of the input frame and, for each reference picture identified, the video coder may perform a prediction search to identify a reference picture that is the best prediction match for the input frame. Once the video coder identifies a reference picture to serve as a prediction source for the input frame, the video coder may derive a transform to match the reference frame data to the input frame data and may transform the reference picture accordingly. The video coder may code the input frame using the transformed reference picture as a prediction reference and may transmit coded frame data and the camera position of the input frame to a decoder. Thus, the video coder may perform derivation and execution of transforms on a limited basis which conserves system resources.

公开(公告)号：US20160360234A1

公开(公告)日：2016-12-08

申请号：US15172064

申请日：2016-06-02

Applicant: Apple Inc.

Inventor： Alexandros Michael Tourapis ,  David William Singer ,  Haitao Guo ,  Hsi-Jung Wu ,  Sorin C. Cismas ,  Xiaohua Yang ,  Yeping Su ,  Dazhong Zhang

IPC: H04N19/593 ,  H04N19/182 ,  H04N19/176

CPC classification number: H04N19/593 ,  H04N19/117 ,  H04N19/156 ,  H04N19/174 ,  H04N19/176 ,  H04N19/182

Abstract: Methods are described for encoding and decoding blocks of image data using intra block copying (IBC). A source block for intra block copying is selected from a source region of a current image that is closer to the current block than a threshold, wherein the source region does not include a portion of the current image that is further from the current block than the threshold.

Abstract translation: 描述了使用块内复制（IBC）对图像数据块进行编码和解码的方法。 从当前图像的比当前块更靠近阈值的源区域中选择用于帧内块复制的源块，其中源区域不包括当前图像的比当前块更远的部分， 阈。

公开(公告)号：US09491487B2

公开(公告)日：2016-11-08

申请号：US13626730

申请日：2012-09-25

Applicant: Apple Inc.

Inventor： Dazhong Zhang ,  Xiaosong Zhou ,  Hsi-Jung Wu

IPC: H04N19/68 ,  H04N19/91 ,  H04N19/172 ,  H04N19/65 ,  H04N19/103 ,  H04N19/57 ,  H04N19/109 ,  H04N19/166 ,  H04N19/13 ,  H04N19/174 ,  H04N19/573 ,  H04N19/58

CPC classification number: H04N19/68 ,  H04N19/103 ,  H04N19/109 ,  H04N19/13 ,  H04N19/166 ,  H04N19/172 ,  H04N19/174 ,  H04N19/57 ,  H04N19/573 ,  H04N19/58 ,  H04N19/65 ,  H04N19/91

Abstract: Coding techniques for input video may include assigning picture identifiers to input frames in either long-form or short-form formats. If a network error has occurred that results in loss of previously-coded video data, a new input frame may be assigned a picture identifier that is coded in a long-form coding format. If no network error has occurred, the input frame may be assigned a picture identifier that is coded in a short-form coding format. Long-form coding may mitigate against loss of synchronization between an encoder and a decoder by picture identifiers.

Abstract translation: 用于输入视频的编码技术可以包括将图像标识符分配给长格式或短格式格式的输入帧。 如果发生导致先前编码的视频数据丢失的网络错误，则可以为新的输入帧分配以长格式编码格式编码的图像标识符。 如果没有发生网络错误，则可以为输入帧分配以短格式编码格式编码的图像标识符。 长格式编码可以通过图像标识符减轻编码器和解码器之间的同步丢失。

公开(公告)号：US20150350650A1

公开(公告)日：2015-12-03

申请号：US14726365

申请日：2015-05-29

Applicant: Apple Inc.

Inventor： Jae Hoon Kim ,  Chris Y. Chung ,  Hsi-Jung Wu ,  Dazhong Zhang ,  Yunfei Zheng ,  Xiaosong Zhou

IPC: H04N19/129 ,  H04N19/186 ,  H04N19/184 ,  H04N19/136

CPC classification number: H04N19/129 ,  H04N19/117 ,  H04N19/136 ,  H04N19/176 ,  H04N19/184 ,  H04N19/186 ,  H04N19/46 ,  H04N19/70 ,  H04N19/82 ,  H04N19/86

Abstract: Methods and systems provide efficient sample adaptive offset (SAO) signaling by reducing a number of bits consumed for signaling SAO compared with conventional methods. In an embodiment, a single flag is used if a coding unit to a first scanning direction with respect to a given coding unit is off. In an embodiment, further bits may be saved if some neighboring coding units are not present, i.e. the given coding unit is an edge. For example, a flag may be skipped, e.g., not signaled, if the given coding unit does not have a neighbor. In an embodiment, a syntax element, one or more flags may signal whether SAO filtering is performed in a coding unit. Based on the syntax element, a merge flag may be skipped to save bits. In an embodiment, SAO syntax may be signaled at a slice level.

Abstract translation: 方法和系统通过减少与常规方法相比信号SAO消耗的比特数来提供有效的采样自适应偏移（SAO）信令。 在一个实施例中，如果关于给定编码单元的第一扫描方向的编码单元关闭，则使用单个标志。 在一个实施例中，如果一些相邻编码单元不存在，即给定的编码单元是边缘，则可以节省进一步的比特。 例如，如果给定的编码单元不具有邻居，则可以跳过标志，例如，不发信号通知。 在一个实施例中，语法元素，一个或多个标志可以发信号通知是否在编码单元中执行SAO滤波。 基于语法元素，可以跳过合并标志来保存位。 在一个实施例中，可以在切片级别发信号通知SAO语法。