公开(公告)号：US20180199044A1

公开(公告)日：2018-07-12

申请号：US15865916

申请日：2018-01-09

Applicant: MEDIATEK INC.

Inventor： Xin Wang ,  Wang Lin Lai ,  Lulin Chen ,  Shan Liu

IPC: H04N19/169 ,  H04N19/167 ,  H04N19/70 ,  H04N19/136

Abstract: Aspects of the disclosure provide a method and an apparatus for deriving composite tracks. The disclosed apparatus includes a processing circuitry. The processing circuitry is configured to generate a file that includes elementary track boxes respectively for elementary tracks. The elementary track box indexes a sequence of media samples in a time order that forms an elementary track. The processing circuitry is configured to construct a composite track box for a composite track. The composite track box identifies one or more elementary tracks, and a composite operation to form the composite track based on the one or more elementary tracks. The processing circuitry is further configured to generate a media presentation based on the composite track.

公开(公告)号：US20240236393A1

公开(公告)日：2024-07-11

申请号：US18407566

申请日：2024-01-09

Applicant: MEDIATEK INC.

Inventor： Xin Wang ,  Lulin Chen

IPC: H04N21/262 ,  H04N21/236 ,  H04N21/239 ,  H04N21/438 ,  H04N21/84 ,  H04N21/845

CPC classification number: H04N21/26258 ,  H04N21/236 ,  H04N21/2393 ,  H04N21/438 ,  H04N21/84 ,  H04N21/8456

Abstract: In certain aspects of the disclosure, methods, and systems of preselections for media processing, streaming and playback are provided. The method includes generating a unified manifest containing a media presentation description for a media content and preparing a media presentation of the media content accordingly, wherein the unified manifest lists all media components and tracks in ISO Base Media File Format (ISOBMFF) files related to the media content and supports preselections in Dynamic Adaptive Streaming over HTTP; and transmitting the unified manifest to a streaming and playback client.

公开(公告)号：US20180199042A1

公开(公告)日：2018-07-12

申请号：US15861503

申请日：2018-01-03

Applicant: MediaTek Inc.

Inventor： Xin Wang ,  Wang Lin Lai ,  Lulin Chen ,  Shan Liu

IPC: H04N19/167 ,  H04N19/172

Abstract: The techniques described herein relate to methods, apparatus, and computer readable media configured to encode or decode a region of interest associated with video data. A spherical region structure is associated with the video data that specifies the region of interest on a sphere, the spherical region structure including a reference point of the region of interest on the sphere, and data indicative of a set of side points, comprising a side point for each side of the region of interest on the sphere. The region of interest in the video data is determined based on the reference point and the set of side points. The video data can be composite video data. The spherical region structure, and/or metadata based on the spherical region structure, can be implicitly or explicitly associated with the video data.

公开(公告)号：US11197040B2

公开(公告)日：2021-12-07

申请号：US15730851

申请日：2017-10-12

Applicant: MediaTek Inc.

Inventor： Xin Wang ,  Wang Lin Lai ,  Lulin Chen ,  Shan Liu

IPC: H04N21/4728 ,  H04N21/235 ,  H04N19/40 ,  G06T19/00 ,  H04N19/184 ,  H04N13/388 ,  H04N21/845 ,  H04N21/854 ,  H04N21/2343 ,  H04N21/2365

Abstract: A method or system for supporting dynamic construction of a user selected sub-region (e.g., viewport or region of interest) from other sub-regions of a reference media presentation encodes reference media presentation as component tracks. A streaming decoder receives a streaming media file of the reference media presentation and displays an arbitrarily selected sub-region of the reference media presentation. The streaming media file has a derived track that (i) references one or more of the plurality of component tracks and (ii) specifies a set of operations for constructing media samples based on the media samples of the referenced component tracks. The streaming decoder provides media samples for the selected sub-region by retrieving the referenced component tracks and performing the set of operations specified by the derived track.

公开(公告)号：US11049323B2

公开(公告)日：2021-06-29

申请号：US16496954

申请日：2018-03-23

Applicant: MEDIATEK INC.

Inventor： Xin Wang ,  Lulin Chen ,  Wang Lin Lai

IPC: G06F3/01 ,  H04N19/17 ,  G06T19/00 ,  H04N19/172 ,  H04N19/167 ,  H04N21/4728 ,  G02B27/01 ,  G06K9/00 ,  G06T7/70 ,  H04N19/513

Abstract: A video processing method includes receiving a virtual reality (VR) content, obtaining a picture from the VR content, encoding the picture to generate a part of a coded bitstream, and encapsulating the part of the coded bitstream into ISO Base Media File Format (ISOBMFF) file(s). In one exemplary implementation, the ISOBMFF file(s) may include a transform property item that is set to enable at least one of a projection transformation, a packing transformation, a VR viewport selection, and a VR region of interest (ROI) selection in track derivation. In another exemplary implementation, the ISOBMFF file(s) may include a first parameter, a second parameter, and a third parameter associated with orientation of a viewport, with the first, second and third parameters indicating a yaw angle, a pitch angle and a roll angle of a center of the viewport, respectively. Further, an associated video processing apparatus is provided.

公开(公告)号：US10951874B2

公开(公告)日：2021-03-16

申请号：US16328382

申请日：2017-09-01

Applicant: MEDIATEK INC.

Inventor： Lulin Chen ,  Shan Liu ,  Xin Wang ,  Wang-Lin Lai

IPC: H04N13/161 ,  H04N19/33 ,  H04N19/593 ,  H04N13/178 ,  H04N13/139

Abstract: A media content delivery apparatus that encodes media content as multiple spatial objects is provided. The media content delivery apparatus encodes a first spatial object according to a first set of parameters. The media content delivery apparatus also encodes a second spatial object according to a second set of parameters. The first and second spatial objects are encoded independently. The media content delivery apparatus also generates a metadata based on the first set of parameters, the second set of parameters, and a relationship between the first and second spatial objects. The media content delivery apparatus then transmits or stores the encoded first spatial object, the encoded second spatial object, and the generated metadata.

公开(公告)号：US20240129561A1

公开(公告)日：2024-04-18

申请号：US18371507

申请日：2023-09-22

Applicant: MEDIATEK INC.

Inventor： Xin Wang ,  Lulin Chen

IPC: H04N21/2343 ,  G06F3/01 ,  H04N21/2187 ,  H04N21/238 ,  H04N21/239 ,  H04N21/81

CPC classification number: H04N21/234363 ,  G06F3/013 ,  H04N21/2187 ,  H04N21/238 ,  H04N21/2393 ,  H04N21/816

Abstract: In certain aspects of the disclosure, a method, a computer-readable medium, and a system for foveated rendering of omnidirectional media content are provided. The method includes receiving a request to access a stream of media data associated with the omnidirectional media content at a point in time the client is accessing the stream of media data for foveated rendering of the omnidirectional media content; determining an initial portion of media data, starting from the point in time the client requests to access, for foveated rendering of the omnidirectional media content for delivery to a client device; and transmitting, in response to the request, the initial portion of media data. The initial portion of media data comprises a portion of the omnidirectional media content for a viewport that is foveated rendered or to be displayed using foveated rendering on the client device according to the request.

公开(公告)号：US11139000B2

公开(公告)日：2021-10-05

申请号：US15913738

申请日：2018-03-06

Applicant: MEDIATEK INC.

Inventor： Xin Wang ,  Lulin Chen ,  Wang Lin Lai ,  Shan Liu

IPC: G11B27/32 ,  H04N21/854 ,  H04N21/4728 ,  H04N21/81 ,  G11B27/10 ,  G11B27/34

Abstract: Aspects of the disclosure provide an apparatus that includes interface circuitry and processing circuitry. The interface circuitry is configured to receive signals carrying metadata that associates a region of interest in a first visual view provided by a first visual track with the first visual track and a second visual track that provides a second visual view that is a part of the first visual view. The processing circuitry is configured to parse the metadata, determine, when the region of interest is selected, the second visual track to provide visual data, and generate images for the region of interest based on the visual data from the second visual track.

公开(公告)号：US10742999B2

公开(公告)日：2020-08-11

申请号：US15861503

申请日：2018-01-03

Applicant: MediaTek Inc.

Inventor： Xin Wang ,  Wang Lin Lai ,  Lulin Chen ,  Shan Liu

IPC: H04N19/167 ,  H04N19/172 ,  H04N21/81 ,  H04N21/44 ,  H04N21/6587 ,  H04N21/4728 ,  H04N19/597 ,  H04N19/48

Abstract: The techniques described herein relate to methods, apparatus, and computer readable media configured to encode or decode a region of interest associated with video data. A spherical region structure is associated with the video data that specifies the region of interest on a sphere, the spherical region structure including a reference point of the region of interest on the sphere, and data indicative of a set of side points, comprising a side point for each side of the region of interest on the sphere. The region of interest in the video data is determined based on the reference point and the set of side points. The video data can be composite video data. The spherical region structure, and/or metadata based on the spherical region structure, can be implicitly or explicitly associated with the video data.

公开(公告)号：US20180109817A1

公开(公告)日：2018-04-19

申请号：US15730851

申请日：2017-10-12

Applicant: MediaTek Inc.

Inventor： Xin Wang ,  Wang Lin Lai ,  Lulin Chen ,  Shan Liu

IPC: H04N21/235 ,  H04N19/40 ,  H04N19/184 ,  G06T19/00 ,  H04N13/04

CPC classification number: H04N21/2353 ,  G06T19/006 ,  H04N13/388 ,  H04N19/184 ,  H04N19/40 ,  H04N21/234318 ,  H04N21/2365 ,  H04N21/8456 ,  H04N21/854 ,  H04N21/85406

Abstract: A method or system for supporting dynamic construction of a user selected sub-region (e.g., viewport or region of interest) from other sub-regions of a reference media presentation is presented. The components of the reference media presentation are encoded as component tracks. A streaming decoder receives a streaming media file of the reference media presentation and displays an arbitrarily selected sub-region of the reference media presentation. The streaming media file has a derived track that (i) references one or more of the plurality of component tracks and (ii) specifies a set of operations for constructing media samples based on the media samples of the referenced component tracks. The streaming decoder provides media samples for the selected sub-region by retrieving the referenced component tracks and performing the set of operations specified by the derived track.