公开(公告)号：US10972730B2

公开(公告)日：2021-04-06

申请号：US16386356

申请日：2019-04-17

Applicant: MEDIATEK INC.

Inventor： Hung-Chih Lin ,  Jian-Liang Lin ,  Chia-Ying Li ,  Chao-Chih Huang ,  Shen-Kai Chang

IPC: H04N19/00 ,  H04N19/117 ,  H04N5/232 ,  H04N19/597 ,  H04N19/46 ,  H04N5/225 ,  H04N19/167 ,  H04N19/172 ,  H04N19/196 ,  H04N19/463 ,  H04N19/70 ,  H04N19/82

Abstract: Methods and apparatus of processing cube face images are disclosed. According to embodiments of the present invention, one or more discontinuous boundaries within each assembled cubic frame are determined and used for selective filtering, where the filtering process is skipped at said one or more discontinuous boundaries within each assembled cubic frame when the filtering process is enabled. Furthermore, the filtering process is applied to one or more continuous areas in each assembled cubic frame.

公开(公告)号：US10825229B2

公开(公告)日：2020-11-03

申请号：US16816273

申请日：2020-03-12

Applicant: MEDIATEK INC.

Inventor： Jian-Liang Lin ,  Hung-Chih Lin ,  Chia-Ying Li ,  Shen-Kai Chang ,  Chi-Cheng Ju ,  Chao-Chih Huang ,  Hui Ouyang

IPC: G06T15/04 ,  G06T3/00 ,  H04N13/00 ,  G06T15/08

Abstract: A projection-based frame is generated according to an omnidirectional video frame and a triangle-based projection layout. The projection-based frame has a 360-degree image content represented by triangular projection faces assembled in the triangle-based projection layout. A 360-degree image content of a viewing sphere is mapped onto the triangular projection faces via a triangle-based projection of the viewing sphere. One side of a first triangular projection face has contact with one side of a second triangular projection face, one side of a third triangular projection face has contact with another side of the second triangular projection face. One image content continuity boundary exists between one side of the first triangular projection face and one side of the second triangular projection face, and another image content continuity boundary exists between one side of the third triangular projection face and another side of the second triangular projection face.

公开(公告)号：US20200226711A1

公开(公告)日：2020-07-16

申请号：US16830288

申请日：2020-03-26

Applicant: MEDIATEK INC.

Inventor： Hung-Chih Lin ,  Chao-Chih Huang ,  Chia-Ying Li ,  Hui Ou Yang ,  Jian-Liang Lin ,  Shen-Kai Chang

IPC: G06T3/00 ,  G06T19/00 ,  G06T1/00 ,  G02B27/01

Abstract: A video processing method includes receiving a bitstream, and decoding, by a video decoder, the bitstream to generate a decoded frame. The decoded frame is a projection-based frame that has a 360-degree image/video content represented by triangular projection faces packed in a triangle-based projection layout. An omnidirectional image/video content of a viewing sphere is mapped onto the triangular projection faces via a triangle-based projection of the viewing sphere. An equator of the viewing sphere is not mapped along any side of each of the triangular projection faces.

公开(公告)号：US20200211258A1

公开(公告)日：2020-07-02

申请号：US16816273

申请日：2020-03-12

Applicant: MEDIATEK INC.

Inventor： Jian-Liang Lin ,  Hung-Chih Lin ,  Chia-Ying Li ,  Shen-Kai Chang ,  Chi-Cheng Ju ,  Chao-Chih Huang ,  Hui Ouyang

IPC: G06T15/04 ,  G06T15/08 ,  G06T3/00 ,  H04N13/00

Abstract: A projection-based frame is generated according to an omnidirectional video frame and a triangle-based projection layout. The projection-based frame has a 360-degree image content represented by triangular projection faces assembled in the triangle-based projection layout. A 360-degree image content of a viewing sphere is mapped onto the triangular projection faces via a triangle-based projection of the viewing sphere. One side of a first triangular projection face has contact with one side of a second triangular projection face, one side of a third triangular projection face has contact with another side of the second triangular projection face. One image content continuity boundary exists between one side of the first triangular projection face and one side of the second triangular projection face, and another image content continuity boundary exists between one side of the third triangular projection face and another side of the second triangular projection face.

公开(公告)号：US10679324B2

公开(公告)日：2020-06-09

申请号：US16460958

申请日：2019-07-02

Applicant: MEDIATEK INC.

Inventor： Hung-Chih Lin ,  Chao-Chih Huang ,  Chia-Ying Li ,  Hui Ou Yang ,  Jian-Liang Lin ,  Shen-Kai Chang

IPC: G06T3/00 ,  G06T1/00 ,  G06T3/60 ,  G06T19/00 ,  G02B27/01

Abstract: A video processing method includes receiving a bitstream, and decoding, by a video decoder, the bitstream to generate a decoded frame. The decoded frame is a projection-based frame that has a 360-degree image/video content represented by triangular projection faces packed in an octahedron projection layout. An omnidirectional image/video content of a viewing sphere is mapped onto the triangular projection faces via an octahedron projection of the viewing sphere. An equator of the viewing sphere is not mapped along any side of each of the triangular projection faces.

公开(公告)号：US10652516B2

公开(公告)日：2020-05-12

申请号：US15860671

申请日：2018-01-03

Applicant: MEDIATEK INC.

Inventor： Jian-Liang Lin ,  Peng Wang ,  Hung-Chih Lin ,  Shen-Kai Chang

IPC: H04N13/161 ,  G06T3/00 ,  H04N13/139 ,  H04N19/597 ,  H04N19/59 ,  H04N19/00

Abstract: A video processing method includes receiving an omnidirectional content corresponding to a sphere, generating a projection-based frame according to the omnidirectional content and a pyramid projection layout, and encoding, by a video encoder, the projection-based frame to generate a part of a bitstream. The projection-based frame has a 360-degree content represented by a base projection face and a plurality of lateral projection faces packed in the pyramid projection layout. The base projection face and the lateral projection faces are obtained according to at least projection relationship between a pyramid and the sphere.

公开(公告)号：US10368067B2

公开(公告)日：2019-07-30

申请号：US15618216

申请日：2017-06-09

Applicant: MEDIATEK INC.

Inventor： Hung-Chih Lin ,  Jian-Liang Lin ,  Chia-Ying Li ,  Chao-Chih Huang ,  Shen-Kai Chang

IPC: H04N19/00 ,  H04N19/117 ,  H04N19/167 ,  H04N19/172 ,  H04N19/196 ,  H04N19/463 ,  H04N19/70 ,  H04N19/82 ,  H04N5/232 ,  H04N19/597 ,  H04N19/46 ,  H04N5/225

Abstract: Methods and apparatus of processing cube face images are disclosed. According to embodiments of the present invention, one or more discontinuous boundaries within each assembled cubic frame are determined and used for selective filtering, where the filtering process is skipped at said one or more discontinuous boundaries within each assembled cubic frame when the filtering process is enabled. Furthermore, the filtering process is applied to one or more continuous areas in each assembled cubic frame.

公开(公告)号：US20180359459A1

公开(公告)日：2018-12-13

申请号：US15766829

申请日：2018-04-03

Applicant: MEDIATEK INC.

Inventor： Ya-Hsuan Lee ,  Peng Wang ,  Jian-Liang Lin ,  Shen-Kai Chang

IPC: H04N13/161 ,  H04N13/111

CPC classification number: H04N13/161 ,  G06T3/005 ,  H04N13/111

Abstract: A video processing method includes obtaining projection face(s) from an omnidirectional content of a sphere, and obtaining a re-sampled projection face by re-sampling at least a portion of a projection face of the projection face(s) through non-uniform mapping. The omnidirectional content of the sphere is mapped onto the projection face(s) via a 360-degree Virtual Reality (360 VR) projection. The projection face has a first source region and a second source region. The re-sampled projection face has a first re-sampled region and a second re-sampled region. The first re-sampled region is derived from re-sampling the first source region with a first sampling density. The second re-sampled region is derived from re-sampling the second source region with a second sampling density that is different from the first sampling density.

公开(公告)号：US20180332305A1

公开(公告)日：2018-11-15

申请号：US15772818

申请日：2017-09-30

Applicant: MEDIATEK INC.

Inventor： Jian-Liang Lin ,  Hung-Chih Lin ,  Chia-Ying Li ,  Shen-Kai Chang ,  Chi-Cheng Ju

IPC: H04N19/597 ,  H04N19/70 ,  H04N19/184 ,  H04N19/91

CPC classification number: H04N19/597 ,  G06K9/36 ,  H04N19/184 ,  H04N19/70 ,  H04N19/91

Abstract: A video encoding method includes: setting a 360-degree Virtual Reality (360 VR) projection layout of projection faces, wherein the projection faces have a plurality of triangular projection faces located at a plurality of positions in the 360 VR projection layout, respectively; encoding a frame having a 360-degree image content represented by the projection faces arranged in the 360 VR projection layout to generate a bitstream; and for each position included in at least a portion of the positions, signaling at least one syntax element via the bitstream, wherein the at least one syntax element is set to indicate at least one of an index of a triangular projection view filled into a corresponding triangular projection face located at the position and a rotation angle of content rotation applied to the triangular projection view filled into the corresponding triangular projection face located at the position.

公开(公告)号：US20180262774A1

公开(公告)日：2018-09-13

申请号：US15911185

申请日：2018-03-05

Applicant: MEDIATEK INC.

Inventor： Hung-Chih Lin ,  Jian-Liang Lin ,  Shen-Kai Chang

IPC: H04N19/597 ,  G06T3/60 ,  H04N19/172

CPC classification number: H04N19/597 ,  G06T3/60 ,  G06T2200/04 ,  H04N19/172 ,  H04N19/577

Abstract: A video processing method includes: receiving a first input frame with a 360-degree Virtual Reality (360 VR) projection format; applying first content-oriented rotation to the first input frame to generate a first content-rotated frame; encoding the first content-rotated frame to generate a first part of a bitstream, including generating a first reconstructed frame and storing a reference frame derived from the first reconstructed frame; receiving a second input frame with the 360 VR projection format; applying second content-oriented rotation to the second input frame to generate a second content-rotated frame; configuring content re-rotation according to the first content-oriented rotation and the second content-oriented rotation; applying the content re-rotation to the reference frame to generate a re-rotated reference frame; and encoding, by a video encoder, the second content-rotated frame to generate a second part of the bitstream, including using the re-rotated reference frame for predictive coding of the second content-rotated frame.