公开(公告)号：US10915986B2

公开(公告)日：2021-02-09

申请号：US15925674

申请日：2018-03-19

Applicant: QUALCOMM Incorporated

Inventor： Muhammed Coban ,  Geert Van Der Auwera ,  Marta Karczewicz

IPC: G06K9/46 ,  G06T3/00 ,  H04N19/172 ,  H04N19/174 ,  G06F17/17 ,  H04N19/597 ,  H04N19/85 ,  G06T17/00 ,  G06T15/20

Abstract: Methods and systems for processing video data are provided. In one example, a first video bitstream can be obtained, which can include video frames of a spherical representation of 360-degree video data. Two-dimensional pixel coordinates of a pixel location of a planar surface of a geometry can be determined. The planar surface can be part of a plurality of planar surfaces of the geometry. Two-dimensional normalized coordinates can be determined for the pixel location based on an adaptation parameter and the two-dimensional pixel coordinates. Three-dimensional coordinates of a sample point of the spherical representation of the 360-degree video data can be determined based on the two-dimensional normalized coordinates. A pixel value for the pixel location of the planar surface of the geometry can be determined based on the sample point, and a second video bitstream can be generated that includes pixel values determined for pixel locations of the plurality of planar surfaces of the geometry.

公开(公告)号：US20170280126A1

公开(公告)日：2017-09-28

申请号：US15253447

申请日：2016-08-31

Applicant: QUALCOMM Incorporated

Inventor： Geert Van der Auwera ,  Muhammed Coban ,  Marta Karczewicz

IPC: H04N13/00 ,  G06T3/40 ,  G06T19/00 ,  H04N13/02 ,  G06T3/00 ,  G06T15/00

CPC classification number: H04N13/161 ,  G06T3/0031 ,  G06T3/0093 ,  G06T3/4038 ,  G06T15/00 ,  G06T19/00 ,  G06T2207/10016 ,  G06T2207/20008 ,  G06T2207/20024 ,  H04N13/117 ,  H04N13/122 ,  H04N13/279 ,  H04N2213/006

Abstract: Techniques and systems are described for mapping 360-degree video data to a truncated square pyramid shape. A 360-degree video frame can include 360-degrees' worth of pixel data, and thus be spherical in shape. By mapping the spherical video data to the planes provided by a truncated square pyramid, the total size of the 360-degree video frame can be reduced. The planes of the truncated square pyramid can be oriented such that the base of the truncated square pyramid represents a front view and the top of the truncated square pyramid represents a back view. In this way, the front view can be captured at full resolution, the back view can be captured at reduced resolution, and the left, right, up, and bottom views can be captured at decreasing resolutions. Frame packing structures can also be defined for 360-degree video data that has been mapped to a truncated square pyramid shape.

公开(公告)号：US11798166B2

公开(公告)日：2023-10-24

申请号：US17172482

申请日：2021-02-10

Applicant: QUALCOMM Incorporated

Inventor： Geert Van Der Auwera ,  Muhammed Coban ,  Marta Karczewicz

IPC: G06T7/11 ,  G06T3/00 ,  G02B27/01 ,  H04N13/117 ,  G06T19/00 ,  H04N19/176 ,  H04N19/196 ,  H04N19/182 ,  H04N19/117 ,  H04N13/161 ,  H04N13/194 ,  H04N19/85 ,  H04N19/597 ,  H04N19/88 ,  H04N5/232 ,  H04N23/698

CPC classification number: G06T7/11 ,  G02B27/0172 ,  G06T3/005 ,  G06T3/0062 ,  G06T3/0093 ,  G06T19/006 ,  H04N13/117 ,  H04N13/161 ,  H04N13/194 ,  H04N19/117 ,  H04N19/176 ,  H04N19/182 ,  H04N19/197 ,  H04N19/597 ,  H04N19/85 ,  H04N19/88 ,  G02B2027/014 ,  G02B2027/0138 ,  H04N23/698

Abstract: Provided are systems and methods for processing 360-degree video data. In various implementations, a spherical representation of a 360-degree video frame can be segmented into a top region, a bottom region, and a middle region. The middle region can be mapped into one or more rectangular areas of an output video frame. The top region can be mapped into a first rectangular area of the output video frame using a mapping that converts a square to a circle, such that pixels in the circular top region are expanded to fill the first rectangular region. The bottom region can be mapped into a second rectangular area of the output video frame such that pixels in the circular bottom region are expanded to fill the second rectangular region.

公开(公告)号：US10313664B2

公开(公告)日：2019-06-04

申请号：US15862468

申请日：2018-01-04

Applicant: QUALCOMM Incorporated

Inventor： Geert Van Der Auwera ,  Muhammed Coban

IPC: H04N13/161 ,  H04N13/363 ,  H04N13/111 ,  G06T3/00 ,  H04N5/262

Abstract: Techniques and systems are described for encoding 360-degree video data using the planes of a truncated square pyramid to map the 360-degree data for different fields of view. 360-degree video data can include multiple frames, where each frame includes spherical video data. In various implementations, a video coding system can select a field of view for the video data, and determine an offset from the center of the spherical video data that corresponds to the field of view. Using the offset, the system can determine a projection of the spherical video data onto the planes of the truncated square pyramid, where the base plane represents a front view and the top plane represents a back view. The system can then map the video data according to the projection such that each plane of the truncated square pyramid includes a portion of the spherical video data.

公开(公告)号：US10957044B2

公开(公告)日：2021-03-23

申请号：US15926957

申请日：2018-03-20

Applicant: QUALCOMM Incorporated

Inventor： Geert Van Der Auwera ,  Muhammed Coban ,  Marta Karczewicz

IPC: G06T7/11 ,  G06T3/00 ,  G02B27/01 ,  H04N13/117 ,  G06T19/00 ,  H04N19/176 ,  H04N19/196 ,  H04N19/182 ,  H04N19/117 ,  H04N13/161 ,  H04N13/194 ,  H04N19/85 ,  H04N19/597 ,  H04N19/88 ,  H04N5/232

Abstract: Provided are systems and methods for processing 360-degree video data. In various implementations, a spherical representation of a 360-degree video frame can be segmented into a top region, a bottom region, and a middle region. The middle region can be mapped into one or more rectangular areas of an output video frame. The top region can be mapped into a first rectangular area of the output video frame using a mapping that converts a square to a circle, such that pixels in the circular top region are expanded to fill the first rectangular region. The bottom region can be mapped into a second rectangular area of the output video frame such that pixels in the circular bottom region are expanded to fill the second rectangular region.

公开(公告)号：US10319071B2

公开(公告)日：2019-06-11

申请号：US15253447

申请日：2016-08-31

Applicant: QUALCOMM Incorporated

Inventor： Geert Van der Auwera ,  Muhammed Coban ,  Marta Karczewicz

IPC: G06T3/00 ,  G06T3/40 ,  G06T15/00 ,  G06T19/00 ,  H04N13/117 ,  H04N13/122 ,  H04N13/161 ,  H04N13/279

Abstract: Techniques and systems are described for mapping 360-degree video data to a truncated square pyramid shape. A 360-degree video frame can include 360-degrees' worth of pixel data, and thus be spherical in shape. By mapping the spherical video data to the planes provided by a truncated square pyramid, the total size of the 360-degree video frame can be reduced. The planes of the truncated square pyramid can be oriented such that the base of the truncated square pyramid represents a front view and the top of the truncated square pyramid represents a back view. In this way, the front view can be captured at full resolution, the back view can be captured at reduced resolution, and the left, right, up, and bottom views can be captured at decreasing resolutions. Frame packing structures can also be defined for 360-degree video data that has been mapped to a truncated square pyramid shape.

公开(公告)号：US11032545B2

公开(公告)日：2021-06-08

申请号：US16020596

申请日：2018-06-27

Applicant: Qualcomm Incorporated

Inventor： Geert Van Der Auwera ,  Muhammed Coban ,  Marta Karczewicz

IPC: H04N11/02 ,  H04N19/124 ,  G06T9/00 ,  H04N19/55 ,  H04N19/597 ,  H04N19/119 ,  G06T3/00 ,  G06T9/40 ,  H04L1/00 ,  H04N19/122 ,  H04N19/13 ,  H04N19/159 ,  H04N19/172 ,  H04N19/176 ,  H04N19/82 ,  G06T17/10

Abstract: Provided are systems and methods for processing 360-degree video data by obtaining at least one 360-degree rectangular formatted projected picture; detecting a projection boundary in the at least one 360-degree rectangular formatted projected picture; disabling at least one of an in-loop filtering, an intra-prediction, or an inter-prediction, based on detecting the at least one 360-degree rectangular formatted projected picture comprises the projection boundary; and generating an encoded video bitstream.

公开(公告)号：US10904531B2

公开(公告)日：2021-01-26

申请号：US15922723

申请日：2018-03-15

Applicant: QUALCOMM Incorporated

Inventor： Hendry ,  Muhammed Coban ,  Geert Van Der Auwera ,  Marta Karczewicz

IPC: H04N19/126 ,  H04N19/597 ,  H04N19/19 ,  H04N19/167 ,  H04N19/124 ,  H04N19/103 ,  H04N19/176 ,  H04N19/182 ,  H04N19/147

Abstract: Techniques and systems are provided for processing 360-degree video data. For example, a picture of the 360-degree video data can be obtained. The picture can include samples projected from a three-dimensional format to a two-dimensional format. A weight value can be determined for at least one sample of the picture. The weight value can be determined based at least on a position of the at least one sample in the picture. At least one adaptive parameter can be determined for the at least one sample using the determined weight value. The at least one adaptive parameter can include one or more of an adaptive weighted distortion, an adaptive weighted quantization parameter value, or an adaptive weighted lambda value. A cost associated with coding the at least one sample using one or more coding modes can be determined using the at least one adaptive parameter of the at least one sample.

公开(公告)号：US10764582B2

公开(公告)日：2020-09-01

申请号：US16020526

申请日：2018-06-27

Applicant: Qualcomm Incorporated

Inventor： Geert Van Der Auwera ,  Muhammed Coban ,  Marta Karczewicz

IPC: H04N19/124 ,  G06T9/00 ,  H04N19/55 ,  H04N19/597 ,  H04N19/119 ,  G06T3/00 ,  G06T9/40 ,  H04L1/00 ,  H04N19/122 ,  H04N19/13 ,  H04N19/159 ,  H04N19/172 ,  H04N19/176 ,  H04N19/82 ,  G06T17/10

Abstract: Provided are systems and methods for processing 360-degree video data by obtaining a 360-degree rectangular formatted projected picture, the 360-degree rectangular formatted projected picture including a first region with a region boundary and a first region area; identifying coding tree units (CTUs) within the first region area; selectively identifying a first coding unit (CU) and a second CU from within the CTUs; determining an initial QP value for the first CU; determining an initial QP value for the second CU; identifying the first CU as a region boundary CU; identifying the second CU as a non-region boundary CU; reducing the initial QP value for the first CU to a final first QP value in response to identifying the first CU as a region boundary CU, and generating an encoded video bitstream comprising: the final QP value for the first CU, and the initial QP value for the second CU.

公开(公告)号：US10699389B2

公开(公告)日：2020-06-30

申请号：US15495709

申请日：2017-04-24

Applicant: QUALCOMM Incorporated

Inventor： Geert Van der Auwera ,  Muhammed Coban ,  Marta Karczewicz

IPC: G06T5/00 ,  H04N5/232 ,  G06T3/00

Abstract: In various implementations, computing systems and computer-implemented methods can be used for correcting the distortion present in a fisheye image, and rendering the image for display as 360-degree video. In various implementations, a computing device can receive 2-dimensional video data captured by an omnidirectional camera. The computing device can map an image from each video frame to a 3-dimensional hemispherical representation. In various implementations, this mapping can be executed using a polynomial model. The 3-dimensional hemispherical representation can then be used in a 360-degree video presentation, to provide a virtual reality experience.