GENERATING TILE-BASED REGION OF INTEREST REPRESENTATION OF VIDEO FRAMES FOR VIDEO ENCODING

    公开(公告)号:US20240223780A1

    公开(公告)日:2024-07-04

    申请号:US18150103

    申请日:2023-01-04

    CPC classification number: H04N19/167 G06T7/11 H04N19/176

    Abstract: One embodiment of the present invention sets forth a technique for generation region-based user interest levels for use during video encoding. The technique includes identifying a plurality of view events associated with a frame of a video content, wherein each view event comprises field of view information indicating a region in the frame at which an interest of a given user was directed when the frame was being rendered, processing the field of view information included in at least a subset of the plurality of view events to generate per-pixel interest levels for a plurality of pixels in the frame, determining a plurality of regions in the frame including the plurality of pixels, generating per-region interest levels for the plurality of regions based on the per-pixel interest levels, and transmitting the per-region interest levels to one or more encoders for encoding the video content in a manner that accounts for the plurality of view events.

    DSP BASED COMPUTE ENGINE FOR EXECUTING MATRIX OPERATIONS

    公开(公告)号:US20240220574A1

    公开(公告)日:2024-07-04

    申请号:US18525466

    申请日:2023-11-30

    CPC classification number: G06F17/16

    Abstract: A method implemented by a digital signal processor (DSP) including application-specific processing engines is provided. The method includes accessing, by the application-specific processing engines a configurable microcode. The configurable microcode includes a set of instructions configured to cause the application-specific processing engines to execute a matrix-based arithmetic algorithm. The method includes executing, by the application-specific processing engines, and based on the configurable microcode, the matrix-based arithmetic algorithm. Executing the matrix-based arithmetic algorithm includes receiving, by the application-specific processing engines, one or more input matrices, performing, by the application-specific processing engines, a plurality of computations based on the one or more input matrices by iteratively executing one or more of a predetermined set of arithmetic operations until the execution of the matrix-based arithmetic algorithm is completed, and generating, by the application-specific processing engines, an output corresponding to the completed execution of the matrix-based arithmetic algorithm.

    LOCATION DETERMINATION USING A PLURALITY OF GEO-LOCATION TECHNIQUES

    公开(公告)号:US20240219583A1

    公开(公告)日:2024-07-04

    申请号:US18390856

    申请日:2023-12-20

    CPC classification number: G01S19/485 G01S19/49

    Abstract: According to examples, a system for determining a location using a plurality of geo-location techniques is described. The system may include a processor and a memory storing instructions. The processor, when executing the instructions, may cause the system to receive sensor data associated with the location, receive image information associated with the location, analyze the image information associated with the location, and provide a localization and mapping analysis for the location. The processor, when executing the instructions, may then determine an analyzed list of features and a primary landmark associated with the location, and determine location information for the location based on the analyzed list of features and the primary landmark.

    Systems And Methods For Providing Spatial Awareness In Virtual Reality

    公开(公告)号:US20240212298A1

    公开(公告)日:2024-06-27

    申请号:US18601317

    申请日:2024-03-11

    Inventor: Eugene LEE

    CPC classification number: G06T19/006 G02B27/0093 G02B27/017 G06F3/04815

    Abstract: In one embodiment, a method includes rendering, for a VR display device and based on a field of view of a user in a real-world environment, a first output image of a VR environment comprising a virtual boundary corresponding to a real-world environment; determining a pose of one or more real-world objects in the real-world environment relative to the user; and rendering, for the VR display device, a second output image comprising the VR environment comprising one or more outline rendered views of the one or more real-world objects, wherein a pose of the one or more outline rendered views of the one or more real-world objects relative to the user corresponds to the pose of the one or more real-world objects.

    3D Conversations in an Artificial Reality Environment

    公开(公告)号:US20240212262A1

    公开(公告)日:2024-06-27

    申请号:US18601661

    申请日:2024-03-11

    CPC classification number: G06T15/20 G06F3/165 H04N7/157

    Abstract: A 3D conversation system can facilitate 3D conversations in an augmented reality environment, allowing conversation participants to appear as if they are face-to-face. The 3D conversation system can accomplish this with a pipeline of data processing stages, which can include calibrate, capture, tag and filter, compress, decompress, reconstruct, render, and display stages. Generally, the pipeline can capture images of the sending user, create intermediate representations, transform the representations to convert from the orientation the images were taken from to a viewpoint of the receiving user, and output images of the sending user, from the viewpoint of the receiving user, in synchronization with audio captured from the sending user. Such a 3D conversation can take place between two or more sender/receiving systems and, in some implementations can be mediated by one or more server systems. In various configurations, stages of the pipeline can be customized based on a conversation context.

Patent Agency Ranking