-
公开(公告)号:US11818394B2
公开(公告)日:2023-11-14
申请号:US17207267
申请日:2021-03-19
Applicant: Apple Inc.
Inventor: Jae Hoon Kim , Xiaosong Zhou , Dazhong Zhang , Hang Yuan , Jiefu Zhai , Chris Y. Chung , Hsi-Jung Wu
IPC: H04N19/176 , H04N19/105 , H04N19/597 , H04N19/547
CPC classification number: H04N19/597 , H04N19/105 , H04N19/176 , H04N19/547
Abstract: Techniques are disclosed for coding video data predictively based on predictions made from spherical-domain projections of input pictures to be coded and reference pictures that are prediction candidates. Spherical projection of an input picture and the candidate reference pictures may be generated. Thereafter, a search may be conducted for a match between the spherical-domain representation of a pixel block to be coded and a spherical-domain representation of the reference picture. On a match, an offset may be determined between the spherical-domain representation of the pixel block to a matching portion of the of the reference picture in the spherical-domain representation. The spherical-domain offset may be transformed to a motion vector in a source-domain representation of the input picture, and the pixel block may be coded predictively with reference to a source-domain representation of the matching portion of the reference picture.
-
公开(公告)号:US11627343B2
公开(公告)日:2023-04-11
申请号:US17188473
申请日:2021-03-01
Applicant: Apple Inc.
Inventor: Xiaohua Yang , Alexandros Tourapis , Dazhong Zhang , Hang Yuan , Hsi-Jung Wu , Jae Hoon Kim , Jiefu Zhai , Ming Chen , Xiaosong Zhou
IPC: H04N19/52 , H04N19/90 , H04N19/597 , H04N21/2343 , G06F3/01
Abstract: In communication applications, aggregate source image data at a transmitter exceeds the data that is needed to display a rendering of a viewport at a receiver. Improved streaming techniques that include estimating a location of a viewport at a future time. According to such techniques, the viewport may represent a portion of an image from a multi-directional video to be displayed at the future time, and tile(s) of the image may be identified in which the viewport is estimated to be located. In these techniques, the image data of tile(s) in which the viewport is estimated to be located may be requested at a first service tier, and the other tile in which the viewport is not estimated to be located may be requested at a second service tier, lower than the first service tier.
-
公开(公告)号:US20210227236A1
公开(公告)日:2021-07-22
申请号:US17221299
申请日:2021-04-02
Applicant: Apple Inc.
Inventor: Alexandros Tourapis , Dazhong Zhang , Hang Yuan , Hsi-Jung Wu , Jae Hoon Kim , Jiefu Zhai , Ming Chen , Xiaosong Zhou
IPC: H04N19/29 , H04N19/103 , G09G5/14 , H04N21/44
Abstract: Aspects of the present disclosure provide techniques for reducing latency and improving image quality of a viewport extracted from multi-directional video communications. According to such techniques, first streams of coded video data are received from a source. The first streams include coded data for each of a plurality of tiles representing a multi-directional video, where each tile corresponding to a predetermined spatial region of the multi-directional video, and at least one tile of the plurality of tiles in the first streams contains a current viewport location at a receiver. The techniques include decoding the first streams and displaying the tile containing the current viewport location. When the viewport location at the receiver changes to include a new tile of the plurality of tiles, retrieving and decoding first streams for the new tile, displaying the decoded content for the changed viewport location, and transmitting the changed viewport location to the source.
-
公开(公告)号:US10939139B2
公开(公告)日:2021-03-02
申请号:US16204792
申请日:2018-11-29
Applicant: Apple Inc.
Inventor: Xiaohua Yang , Alexandros Tourapis , Dazhong Zhang , Hang Yuan , Hsi-Jung Wu , Jae Hoon Kim , Jiefu Zhai , Ming Chen , Xiaosong Zhou
IPC: H04N19/52 , H04N19/90 , H04N19/597 , H04N21/2343 , G06F3/01
Abstract: In communication applications, aggregate source image data at a transmitter exceeds the data that is needed to display a rendering of a viewport at a receiver. Improved streaming techniques that include estimating a location of a viewport at a future time. According to such techniques, the viewport may represent a portion of an image from a multi-directional video to be displayed at the future time, and tile(s) of the image may be identified in which the viewport is estimated to be located. In these techniques, the image data of tile(s) in which the viewport is estimated to be located may be requested at a first service tier, and the other tile in which the viewport is not estimated to be located may be requested at a second service tier, lower than the first service tier.
-
公开(公告)号:US20200296426A1
公开(公告)日:2020-09-17
申请号:US16890245
申请日:2020-06-02
Applicant: Apple Inc.
Inventor: Jiefu Zhai , Dazhong Zhang , Xiaosong Zhou , Chris Y. Chung , Hsi-Jung Wu , Peikang Song , David R. Conrad , Jae Hoon Kim , Yunfei Zheng
IPC: H04N19/82 , H04N19/186
Abstract: Chroma deblock filtering of reconstructed video samples may be performed to remove blockiness artifacts and reduce color artifacts without over-smoothing. In a first method, chroma deblocking may be performed for boundary samples of a smallest transform size, regardless of partitions and coding modes. In a second method, chroma deblocking may be performed when a boundary strength is greater than 0. In a third method, chroma deblocking may be performed regardless of boundary strengths. In a fourth method, the type of chroma deblocking to be performed may be signaled in a slice header by a flag. Furthermore, luma deblock filtering techniques may be applied to chroma deblock filtering.
-
公开(公告)号:US10708623B2
公开(公告)日:2020-07-07
申请号:US16050744
申请日:2018-07-31
Applicant: Apple Inc.
Inventor: Jiefu Zhai , Dazhong Zhang , Xiaosong Zhou , Chris Y. Chung , Hsi-Jung Wu , Peikang Song , David R. Conrad , Jae Hoon Kim , Yunfei Zheng
IPC: H04N19/82 , H04N19/186
Abstract: Chroma deblock filtering of reconstructed video samples may be performed to remove blockiness artifacts and reduce color artifacts without over-smoothing. In a first method, chroma deblocking may be performed for boundary samples of a smallest transform size, regardless of partitions and coding modes. In a second method, chroma deblocking may be performed when a boundary strength is greater than 0. In a third method, chroma deblocking may be performed regardless of boundary strengths. In a fourth method, the type of chroma deblocking to be performed may be signaled in a slice header by a flag. Furthermore, luma deblock filtering techniques may be applied to chroma deblock filtering.
-
公开(公告)号:US20200092571A1
公开(公告)日:2020-03-19
申请号:US16132219
申请日:2018-09-14
Applicant: Apple Inc.
Inventor: Alexandros Tourapis , Dazhong Zhang , Hang Yuan , Hsi-Jung Wu , Jae Hoon Kim , Jiefu Zhai , Ming Chen , Xiaosong Zhou
IPC: H04N19/29 , H04N21/44 , G09G5/14 , H04N19/103
Abstract: Aspects of the present disclosure provide techniques for reducing latency and improving image quality of a viewport extracted from multi-directional video communications. According to such techniques, first streams of coded video data are received from a source. The first streams include coded data for each of a plurality of tiles representing a multi-directional video, where each tile corresponding to a predetermined spatial region of the multi-directional video, and at least one tile of the plurality of tiles in the first streams contains a current viewport location at a receiver. The techniques include decoding the first streams and displaying the tile containing the current viewport location. When the viewport location at the receiver changes to include a new tile of the plurality of tiles, retrieving and decoding first streams for the new tile, displaying the decoded content for the changed viewport location, and transmitting the changed viewport location to the source.
-
公开(公告)号:US20180349705A1
公开(公告)日:2018-12-06
申请号:US15613130
申请日:2017-06-02
Applicant: Apple Inc.
Inventor: Jae Hoon Kim , Ming Chen , Hang Yuan , Jiefu Zhai , Dazhong Zhang , Xiaosong Zhou , Chris Chung , Hsi-Jung Wu
Abstract: Techniques are disclosed for managing display of content from multi-view video data. According to these techniques, an object may be identified from content of the multi-view video. The object's location may be tracked across a sequence of multi-view video. The technique may extract a sub-set of video that is contained within a view window that is shifted in an image space of the multi-view video in correspondence to the tracked object's location. These techniques may be implemented either in an image source device or an image sink device.
-
公开(公告)号:US20180338161A1
公开(公告)日:2018-11-22
申请号:US16050744
申请日:2018-07-31
Applicant: Apple Inc.
Inventor: Jiefu Zhai , Dazhong Zhang , Xiaosong Zhou , Chris Y. Chung , Hsi-Jung Wu , Peikang Song , David R. Conrad , Jae Hoon Kim , Yunfei Zheng
IPC: H04N19/82 , H04N19/186
CPC classification number: H04N19/82 , H04N19/186
Abstract: Chroma deblock filtering of reconstructed video samples may be performed to remove blockiness artifacts and reduce color artifacts without over-smoothing. In a first method, chroma deblocking may be performed for boundary samples of a smallest transform size, regardless of partitions and coding modes. In a second method, chroma deblocking may be performed when a boundary strength is greater than 0. In a third method, chroma deblocking may be performed regardless of boundary strengths. In a fourth method, the type of chroma deblocking to be performed may be signaled in a slice header by a flag. Furthermore, luma deblock filtering techniques may be applied to chroma deblock filtering.
-
公开(公告)号:US20170359575A1
公开(公告)日:2017-12-14
申请号:US15613885
申请日:2017-06-05
Applicant: Apple Inc.
Inventor: Dazhong Zhang , Hang Yuan , Peikang Song , Jae Hoon Kim , Xing Wen , Sudeng Hu , Xiaosong Zhou , Chris Chung , Hsi-Jung Wu
IPC: H04N19/103 , H04N19/176 , H04N19/11 , H04N19/186 , H04N19/61 , H04N19/50 , G06T9/00 , H04N19/136 , H04N19/196
CPC classification number: H04N19/11 , H04N19/105 , H04N19/119 , H04N19/136 , H04N19/17 , H04N19/176 , H04N19/593
Abstract: A video coder defines multiple fidelity regions in different spatial areas of a video sequence, each of which may have different fidelity characteristics. The coder may code the different representations in a common video sequence. Where prediction data crosses boundaries between the regions, interpolation may be performed to create like kind representations between prediction data and video content being coded.
-
-
-
-
-
-
-
-
-