VR video transmission with layered video by re-using existing network infrastructures

    公开(公告)号:US11184461B2

    公开(公告)日:2021-11-23

    申请号:US16167792

    申请日:2018-10-23

    Abstract: Aspects of the subject disclosure may include, for example, a method comprising obtaining media content; receiving a request from equipment of a user to view the media content; identifying a predicted field of view of the user; sending a base layer of the media content to the equipment of the user using a first stream; and sending a first enhancement layer of the predicted field of view to the equipment of the user using a second stream. The first stream and the second stream may utilize different protocols, different servers, different buffer sizes, and/or a combination thereof. While the first stream may include an entire 360 degrees of the base layer of the media content, the second stream may be limited to the first enhancement layer of the predicted field of view of the media content.

    SYSTEM AND METHOD OF ENABLING ADAPTIVE BITRATE STREAMING FOR VOLUMETRIC VIDEOS

    公开(公告)号:US20210289207A1

    公开(公告)日:2021-09-16

    申请号:US16820080

    申请日:2020-03-16

    Abstract: Aspects of the subject disclosure may include, for example, a device that has a processing system including a processor; and a memory that stores executable instructions that, when executed by the processing system, facilitate performance of operations including selecting a downsampling technique for removing points from a point cloud in a volumetric video; selecting a data reduction percentage for a target bitrate for streaming the volumetric video; downsampling the point cloud in each frame of the volumetric video for the target bitrate using the downsampling technique and data reduction percentage selected, thereby creating a downsampled volumetric video; and compressing and encoding the downsampled volumetric video, thereby creating an encoded volumetric video. Other embodiments are disclosed.

    TRANSPORT PROTOCOL FOR LATENCY SENSITIVE APPLICATIONS

    公开(公告)号:US20210258821A1

    公开(公告)日:2021-08-19

    申请号:US16795033

    申请日:2020-02-19

    Abstract: The described technology is generally directed towards a transport protocol for latency sensitive applications. The disclosed transport protocol is “semi-reliable” in that it allows for specification of an importance of data being transmitted, thereby allowing important data to be sent reliably, while other data can be dropped if necessary, e.g., under bad network conditions. A deadline can be specified for such other data, and if the other data cannot be sent prior to the deadline, it can be dropped. Furthermore, the disclosed transport protocol can allow for early discovery of network jitter. A client device can send regular acknowledgments which identify most recently received data packets as well as a number of “heartbeat transmissions” received at the client device. A server device can use the acknowledgments to discover and respond to jitter.

    METHODS, DEVICES, AND SYSTEMS FOR EMBEDDING VISUAL ADVERTISEMENTS IN VIDEO CONTENT

    公开(公告)号:US20210250646A1

    公开(公告)日:2021-08-12

    申请号:US17241323

    申请日:2021-04-27

    Abstract: Aspects of the subject disclosure may include, for example, embodiments include obtaining video content, the video content comprises a plurality of frames, monitoring, by an image sensor, a facial feature of a user to determine a visual focus of the user in relation to the video content, and detecting from a group of frames of the plurality of frames at least a reduction in movements of objects in the group of frames. Further embodiments include determining, according to the monitoring and the detecting, a measure of attention of the user within a region of the group of frames, determining that the measure of attention of the user within the region of the group of frames satisfies a threshold, and embedding in at least a portion of subsequent frames of the plurality of frames a visual advertisement in the region via a communication device. Other embodiments are disclosed.

    SYSTEM AND METHOD FOR STREAMING VISIBLE PORTIONS OF VOLUMETRIC VIDEO

    公开(公告)号:US20210195165A1

    公开(公告)日:2021-06-24

    申请号:US17197276

    申请日:2021-03-10

    Abstract: Aspects of the subject disclosure may include, for example, a device having a processing system including a processor; and a memory that stores executable instructions that, when executed by the processing system, facilitate performance of operations, the operations comprising predicting a viewpoint within a volumetric video based on a movement input provided by a viewer, resulting in a predicted viewpoint at a future time, retrieving a cell occupancy bitmap for a point cloud of the volumetric video for the future time, determining visible cells based on the cell occupancy bitmap and the predicted viewpoint, where the visible cells are not obscured by points in other cells, and retrieving points of the point cloud that are within the visible cells prior to the future time.

    METHOD FOR SCALABLE VOLUMETRIC VIDEO CODING

    公开(公告)号:US20210183113A1

    公开(公告)日:2021-06-17

    申请号:US17188752

    申请日:2021-03-01

    Abstract: Aspects of the subject disclosure may include, for example, encoding a point cloud in a first frame of volumetric video in an octree format and identifying a first group of points of the point cloud, resulting in a first base layer including a base layer, a first enhancement layer and a second enhancement layer. Each layer includes different points from the point cloud, with the second enhancement layer including all points in each octet of leaf nodes in the octree format of the point cloud that are not in the base layer and the first enhancement layer. The first base layer of the point cloud is provided over a communication network to a media device and the first enhancement layer is also provided responsive to a determination of sufficient available bandwidth in the communication network. Other embodiments are disclosed.

    Methods, devices, and systems for embedding visual advertisements in video content

    公开(公告)号:US11032607B2

    公开(公告)日:2021-06-08

    申请号:US16213585

    申请日:2018-12-07

    Abstract: Aspects of the subject disclosure may include, for example, embodiments include obtaining video content, the video content comprises a plurality of frames, monitoring, by an image sensor, a facial feature of a user to determine a visual focus of the user in relation to the video content, and detecting from a group of frames of the plurality of frames at least a reduction in movements of objects in the group of frames. Further embodiments include determining, according to the monitoring and the detecting, a measure of attention of the user within a region of the group of frames, determining that the measure of attention of the user within the region of the group of frames satisfies a threshold, and embedding in at least a portion of subsequent frames of the plurality of frames a visual advertisement in the region via a communication device. Other embodiments are disclosed.

    METHOD AND APPARATUS FOR PROVISIONING SECONDARY CONTENT BASED ON PRIMARY CONTENT

    公开(公告)号:US20210168412A1

    公开(公告)日:2021-06-03

    申请号:US17175722

    申请日:2021-02-15

    Abstract: Aspects of the subject disclosure may include, for example, identifying a region of interest included in a plurality of candidate regions of interest associated with a presentation of a first content item on a user equipment, wherein the first content item includes a panoramic video, comparing first metadata associated with the region of interest to a plurality of metadata associated with a plurality of secondary content items, responsive to the comparing, identifying a second content item included in the plurality of secondary content items, wherein the identifying of the second content item is based on a distance between the first metadata and second metadata associated with the second content item being less than a threshold, and transmitting the second content item to the user equipment responsive to the identifying of the second content item. Other embodiments are disclosed.

    System and method for streaming visible portions of volumetric video

    公开(公告)号:US10979692B2

    公开(公告)日:2021-04-13

    申请号:US16540511

    申请日:2019-08-14

    Abstract: Aspects of the subject disclosure may include, for example, a device having a processing system including a processor; and a memory that stores executable instructions that, when executed by the processing system, facilitate performance of operations, the operations comprising: predicting a viewpoint within a volumetric video based on movement input by a viewer, resulting in a predicted viewpoint, wherein a point cloud of the volumetric video is segmented into cells, and wherein at least some of the cells are visible to the viewer at a future time of playback based on the predicted viewpoint; retrieving a cell occupancy bitmap for the point cloud for the future time of playback; determining visible cells based on the cell occupancy bitmap and the predicted viewpoint; receiving the visible cells for the future time of playback; and rendering and displaying the point cloud within the visible cells during playback at the future time. Other embodiments are disclosed.

    COLLABORATIVE AND EDGE-ENHANCED AUGMENTED REALITY SYSTEMS

    公开(公告)号:US20210099547A1

    公开(公告)日:2021-04-01

    申请号:US16584814

    申请日:2019-09-26

    Abstract: In one example, a processing system of a mobile computing device including at least one processor may capture visual information of a first location, transmit a recognition request to a first server, the recognition request comprising the visual information, obtain a first recognition result from the first server comprising first annotation content associated with a first item in the visual information of the first location, the first recognition result further comprising visual information of the first item, present at least a portion of first annotation content via the mobile computing device, store the first annotation content and the visual information of the first item in a local cache, detect a first additional mobile computing device via a non-cellular wireless communication modality, and share the first annotation content and the visual information of the first item with the first additional mobile computing device via the non-cellular wireless communication modality.

Patent Agency Ranking