Abstract:
This disclosure provides systems, devices, apparatus, and methods, including computer programs encoded on storage media, for a mesh GPU codec for real-time streaming. A graphics processor may obtain an indication of a compressed representation of a topology associated with at least one generalized triangle strip associated with a subset of triangles in a set of triangles. The graphics processor may obtain an intermediate representation of the topology associated with the at least one generalized triangle strip by a decompression of the compressed representation. The graphics processor may obtain a sequence of indices based on the intermediate representation of the topology associated with the at least one generalized triangle strip. The graphics processor may compute at least one set of offsets based on the intermediate representation. The graphics processor may reconstruct the set of triangles based on the sequence of indices and the at least one set of offsets.
Abstract:
Extended reality (XR) management systems and techniques are described. In some examples, an XR management system receives sensor data from an XR interface device having at least one sensor. The XR management system generates, based on the receipt of the sensor data from the XR interface device, processing instructions for an XR processing device to process the sensor data to generate XR content. The XR management system sends the sensor data and the processing instructions to the XR processing device. The XR management system receives the XR content from the XR processing device. The XR management system generates layer content. The XR management system sends the XR content and the layer content to the XR interface device to cause the XR interface device to output the XR content and the layer content in a layered arrangement.
Abstract:
Various aspects of the present disclosure generally relate to wireless communication. In some aspects, a wireless communication device may predict user behavior in an extended reality (XR) application on a user equipment (UE) based at least in part on current content presented by the XR application. The wireless communication device may predict channel information for a communication link of the UE based at least in part on the predicted user behavior. The wireless communication device may adjust one or more parameters of the communication link based at least in part on the predicted channel information. Numerous other aspects are described.
Abstract:
This disclosure provides systems, devices, apparatus, and methods, including computer programs encoded on storage media, for PVS over UDP for split rendering. A graphics processor may obtain, a PVS and a set of video packets. The graphics processor may determine, if a data loss associated with the PVS or the set of video packets is detected, one or more first visible primitives in the set of visible primitives that are currently affected by the data loss associated with the PVS or the set of video packets. The graphics processor may identify concealment information for the one or more first visible primitives in the set of visible primitives based on the one or more first visible primitives in a previous frame. The graphics processor may update information associated with the one or more first visible primitives based on the concealment information for the one or more first visible primitives.
Abstract:
For a scene comprising real-world objects and generated (CG) objects, the scene characterized by a scene geometry of a first time, one or more processors can generate, based on the scene geometry, shadow information for each of one or more shadows cast by a CG object of the scene on one or more real-world objects of the scene. The one or more processors can rendering and display a frame of the scene as a function of the shadow information and a scene geometry at a time of the rendering later than the first time. In some examples, the shadow information includes shadow factors and identifiers. Each shadow factor can describe a light attenuation effect of a cast shadow on a real world object surface and can be incorporated into a shading atlas of the scene. Each identifier identifies a real-world object surface of the scene affected by a shadow factor.
Abstract:
A method of building a database for an object recognition system includes acquiring several multi-view images of a target object and then extracting a first set of features from the images. One of these extracted features is then selected and a second set of features is determined based on which of the first set of features include both, descriptors that match and keypoint locations that are proximate to the selected feature. If a repeatability of the selected feature is greater than a repeatability threshold and if a discriminability is greater than a discriminability threshold, then at least one derived feature is stored to the database, where the derived single feature is representative of the second set of features.
Abstract:
In one example, a method for exiting an object detection pipeline includes determining, while in the object detection pipeline, a number of features within a first tile of an image, wherein the image consists of a plurality of tiles, performing a matching procedure using at least a subset of the features within the first tile if the number of features within the first tile meets a threshold value, exiting the object detection pipeline if a result of the matching procedure indicates an object is recognized in the image, and presenting the result of the matching procedure.