Optimizing 360-degree video streaming with video content analysis

    公开(公告)号:US11574457B2

    公开(公告)日:2023-02-07

    申请号:US17232776

    申请日:2021-04-16

    Abstract: Aspects of the subject disclosure may include, for example, a method performed by a processing system of determining a present orientation of a display region presented at a first time on a display of a video viewer, predicting a future orientation of the display region occurring at a second time based on data collected, to obtain a predicted orientation of the display region to be presented at the second time on the display of the video viewer, identifying, based on the predicted orientation of the display region, a first group of tiles from a video frame of a panoramic video being displayed by the video viewer, wherein the first group of tiles covers the display region in the video frame at the predicted orientation, and a plurality of objects moving in the video frame from the first time to the second time, wherein each object of the plurality of objects is located in a separate spatial region of the video frame at the second time, wherein a second group of tiles collectively covers the separate spatial regions, wherein tiles in the first group of tiles and tiles in the second group of tiles are different, and facilitating wireless transmission of the first group of tiles and a second tile from the second group of tiles, for presentation at the video viewer at the second time. Other embodiments are disclosed.

    METHOD OF DETERMINING OCCLUSION BASED VISIBILITY FOR VOLUMETRIC VIDEO STREAMING

    公开(公告)号:US20220408072A1

    公开(公告)日:2022-12-22

    申请号:US17895668

    申请日:2022-08-25

    Abstract: Aspects of the subject disclosure may include, for example, a device, that includes a processing system including a processor and a memory that stores executable instructions that, when executed by the processing system, facilitate performance of operations including receiving a manifest for a point cloud, wherein the point cloud is partitioned into a plurality of cells; determining an occlusion level for a cell of the plurality of cells with respect to a predicted viewport; reducing a point density for the cell provided in the manifest based on the occlusion level, thereby determining a reduced point density; and requesting delivery of points in the cell, based on the reduced point density. Other embodiments are disclosed.

    SYSTEM AND METHOD FOR STREAMING VISIBLE PORTIONS OF VOLUMETRIC VIDEO

    公开(公告)号:US20220377308A1

    公开(公告)日:2022-11-24

    申请号:US17879235

    申请日:2022-08-02

    Abstract: Aspects of the subject disclosure may include, for example, a device having a processing system including a processor; and a memory that stores executable instructions that, when executed by the processing system, facilitate performance of operations, the operations comprising predicting a viewpoint within a volumetric video based on a movement input provided by a viewer, resulting in a predicted viewpoint at a future time, retrieving a cell occupancy bitmap for a point cloud of the volumetric video for the future time, determining visible cells based on the cell occupancy bitmap and the predicted viewpoint, where the visible cells are not obscured by points in other cells, and retrieving points of the point cloud that are within the visible cells prior to the future time.

    Collaborative and edge-enhanced augmented reality systems

    公开(公告)号:US11196842B2

    公开(公告)日:2021-12-07

    申请号:US16584814

    申请日:2019-09-26

    Abstract: In one example, a processing system of a mobile computing device including at least one processor may capture visual information of a first location, transmit a recognition request to a first server, the recognition request comprising the visual information, obtain a first recognition result from the first server comprising first annotation content associated with a first item in the visual information of the first location, the first recognition result further comprising visual information of the first item, present at least a portion of first annotation content via the mobile computing device, store the first annotation content and the visual information of the first item in a local cache, detect a first additional mobile computing device via a non-cellular wireless communication modality, and share the first annotation content and the visual information of the first item with the first additional mobile computing device via the non-cellular wireless communication modality.

    METHOD OF DETERMINING OCCLUSION BASED VISIBILITY FOR VOLUMETRIC VIDEO STREAMING

    公开(公告)号:US20210235057A1

    公开(公告)日:2021-07-29

    申请号:US16825645

    申请日:2020-03-20

    Abstract: Aspects of the subject disclosure may include, for example, a device, that includes a processing system including a processor and a memory that stores executable instructions that, when executed by the processing system, facilitate performance of operations including receiving a manifest for a point cloud, wherein the point cloud is partitioned into a plurality of cells; determining an occlusion level for a cell of the plurality of cells with respect to a predicted viewport; reducing a point density for the cell provided in the manifest based on the occlusion level, thereby determining a reduced point density; and requesting delivery of points in the cell, based on the reduced point density. Other embodiments are disclosed.

    OPTIMIZING 360-DEGREE VIDEO STREAMING WITH VIDEO CONTENT ANALYSIS

    公开(公告)号:US20210232849A1

    公开(公告)日:2021-07-29

    申请号:US17232776

    申请日:2021-04-16

    Abstract: Aspects of the subject disclosure may include, for example, a method performed by a processing system of determining a present orientation of a display region presented at a first time on a display of a video viewer, predicting a future orientation of the display region occurring at a second time based on data collected, to obtain a predicted orientation of the display region to be presented at the second time on the display of the video viewer, identifying, based on the predicted orientation of the display region, a first group of tiles from a video frame of a panoramic video being displayed by the video viewer, wherein the first group of tiles covers the display region in the video frame at the predicted orientation, and a plurality of objects moving in the video frame from the first time to the second time, wherein each object of the plurality of objects is located in a separate spatial region of the video frame at the second time, wherein a second group of tiles collectively covers the separate spatial regions, wherein tiles in the first group of tiles and tiles in the second group of tiles are different, and facilitating wireless transmission of the first group of tiles and a second tile from the second group of tiles, for presentation at the video viewer at the second time. Other embodiments are disclosed.

    Optimizing 360-degree video streaming with video content analysis

    公开(公告)号:US11010632B2

    公开(公告)日:2021-05-18

    申请号:US16877696

    申请日:2020-05-19

    Abstract: Aspects of the subject disclosure may include, for example, a method performed by a processing system of determining a present orientation of a display region presented at a first time on a display of a video viewer, predicting a future orientation of the display region occurring at a second time based on data collected, to obtain a predicted orientation of the display region to be presented at the second time on the display of the video viewer, identifying, based on the predicted orientation of the display region, a first group of tiles from a video frame of a panoramic video being displayed by the video viewer, wherein the first group of tiles covers the display region in the video frame at the predicted orientation, and a plurality of objects moving in the video frame from the first time to the second time, wherein each object of the plurality of objects is located in a separate spatial region of the video frame at the second time, wherein a second group of tiles collectively covers the separate spatial regions, wherein tiles in the first group of tiles and tiles in the second group of tiles are different, and facilitating wireless transmission of the first group of tiles and a second tile from the second group of tiles, for presentation at the video viewer at the second time. Other embodiments are disclosed.

    SYSTEM AND METHOD FOR STREAMING VISIBLE PORTIONS OF VOLUMETRIC VIDEO

    公开(公告)号:US20210051308A1

    公开(公告)日:2021-02-18

    申请号:US16540511

    申请日:2019-08-14

    Abstract: Aspects of the subject disclosure may include, for example, a device having a processing system including a processor; and a memory that stores executable instructions that, when executed by the processing system, facilitate performance of operations, the operations comprising: predicting a viewpoint within a volumetric video based on movement input by a viewer, resulting in a predicted viewpoint, wherein a point cloud of the volumetric video is segmented into cells, and wherein at least some of the cells are visible to the viewer at a future time of playback based on the predicted viewpoint; retrieving a cell occupancy bitmap for the point cloud for the future time of playback; determining visible cells based on the cell occupancy bitmap and the predicted viewpoint; receiving the visible cells for the future time of playback; and rendering and displaying the point cloud within the visible cells during playback at the future time. Other embodiments are disclosed.

Patent Agency Ranking