公开(公告)号：US11954789B2

公开(公告)日：2024-04-09

申请号：US17622676

申请日：2020-07-02

Applicant: InterDigital VC Holdings, Inc.

Inventor： Tatu V. J. Harviainen ,  Marko Palviainen

IPC: G06T15/06 ,  G06T17/20 ,  G06T19/20

CPC classification number: G06T15/06 ,  G06T17/20 ,  G06T19/20 ,  G06T2200/16 ,  G06T2210/56 ,  G06T2219/2012

Abstract: Systems and methods are described for rendering a 3D synthetic scene. A display client receives point cloud samples of the scene, where the point cloud samples include a point location, one or more viewing directions, and color information for each of the viewing directions. The point cloud samples may be generated by a server using ray tracing. The display client combines information from the point cloud samples with a locally generated rendering of at least a portion of the scene to generate a combined rendering of the scene, and the client displays the combined rendering. The number of point cloud samples may be adjusted adaptively based on performance metrics at the client.

公开(公告)号：US11711504B2

公开(公告)日：2023-07-25

申请号：US17532404

申请日：2021-11-22

Applicant: InterDigital VC Holdings, Inc.

Inventor： Tatu V. J. Harviainen ,  Patrick Thomas Igoe

IPC: H04N13/128 ,  H04N21/218 ,  H04N21/2662 ,  H04N21/81 ,  H04N13/194 ,  H04N13/344 ,  H04N13/366 ,  H04N21/6587 ,  H04N21/2343 ,  H04N21/2387

CPC classification number: H04N13/128 ,  H04N13/194 ,  H04N13/344 ,  H04N13/366 ,  H04N21/21805 ,  H04N21/234327 ,  H04N21/2662 ,  H04N21/6587 ,  H04N21/816 ,  H04N21/2387

Abstract: Systems and methods are described for simulating motion parallax in 360-degree video. In an exemplary embodiment for producing video content, a method includes obtaining a source video, based on information received from a client device, determining a selected number of depth layers, producing, from the source video, a plurality of depth layer videos corresponding to the selected number of depth layers, wherein each depth layer video is associated with at least one respective depth value, and wherein each depth layer video includes regions of the source video having depth values corresponding to the respective associated depth value, and sending the plurality of depth layer videos to the client device.

公开(公告)号：US11961264B2

公开(公告)日：2024-04-16

申请号：US17298379

申请日：2019-12-11

Applicant: InterDigital VC Holdings, Inc.

Inventor： Tatu V. J. Harviainen ,  Louis Kerofsky ,  Ralph Neff

IPC: G06T9/00 ,  G06T17/00

CPC classification number: G06T9/001 ,  G06T9/002 ,  G06T17/00

Abstract: Systems and methods are described for compressing color information in point cloud data. In some embodiments, point cloud data includes point position information and point color information for each of a plurality of points. The point position information is provided to a neural network, and the neural network generates predicted color information (e.g. predicted luma and chroma values) for respective points in the point cloud. A prediction residual is generated to represent the difference between the predicted color information and the input point color position. The point position information (which may be in compressed form) and the prediction residual are encoded in a bitstream. In some embodiments, color hint data is encoded to improve color prediction.

公开(公告)号：US11900532B2

公开(公告)日：2024-02-13

申请号：US17619183

申请日：2020-06-29

Applicant: InterDigital VC Holdings, Inc.

Inventor： Tatu V. J. Harviainen

IPC: G06T15/50 ,  G06T5/50 ,  H04L67/12

CPC classification number: G06T5/50 ,  G06T2200/16 ,  G06T2210/61 ,  H04L67/12

Abstract: Systems and methods are described for providing spatial content using a hybrid format. In some embodiments, a client device receives, from a server, surface light field representations of a plurality of scene elements in a 3D scene, including a first scene element. The client device provides to the server an indication of a dynamic behavior of a second scene element different from the first scene element. Further, in response to the indication, the client device receives from the server information defining the first scene element in a 3D asset format. The client device then renders at least the first scene element in the 3D asset format.

公开(公告)号：US11893148B2

公开(公告)日：2024-02-06

申请号：US16890439

申请日：2020-06-02

Applicant: InterDigital VC Holdings, Inc.

Inventor： Tatu V. J. Harviainen ,  Raimo J. Launonen

IPC: G06F3/01 ,  G06F3/0488 ,  G06F3/04815 ,  G06F3/04845

CPC classification number: G06F3/011 ,  G06F3/016 ,  G06F3/0488 ,  G06F3/04815 ,  G06F3/04845

Abstract: Described herein are various embodiments for enabling realistic haptic feedback for virtual three-dimensional (3D) objects. A real proxy surface is provided for a virtual object, where the proxy surface may be a relief surface, such as a depth-compressed model of the virtual object. In an exemplary method, when a user touches a proxy surface, a position of the touch point on the surface is detected. The touch point is mapped to a corresponding point on the virtual object. A position of the virtual object is determined such that the touch point is in alignment with the corresponding point on the virtual object, and the virtual object is displayed at the first determined position on an augmented reality display. As a result, a user touching the proxy surface may have the sensation of touching a solid version of the virtual 3D object instead of the proxy surface.

公开(公告)号：US11722718B2

公开(公告)日：2023-08-08

申请号：US17423787

申请日：2020-01-17

Applicant: InterDigital VC Holdings, Inc.

Inventor： Tatu V. J. Harviainen

IPC: H04N21/2662 ,  H04L65/80 ,  H04N21/24 ,  H04L65/612

CPC classification number: H04N21/2662 ,  H04L65/612 ,  H04L65/80 ,  H04N21/2402

Abstract: Some embodiments of an example method may include: receiving a manifest file for streaming content, the manifest file identifying one or more degrees of freedom representations of content; tracking bandwidth available; selecting a selected representation from the one or more degrees of freedom representations based on the bandwidth available; retrieving the selected representation; and rendering the selected representation. Some embodiments of the example method may include determining estimated download latency of the one or more degrees of freedom representations. Some embodiments of the example method may include tracking client capabilities. For some embodiments of the example method, selecting the selected representation may be based on the estimated download latency and/or the client capabilities.

公开(公告)号：US20230119930A1

公开(公告)日：2023-04-20

申请号：US18082331

申请日：2022-12-15

Applicant: InterDigital VC Holdings, Inc.

Inventor： Tatu V. J. Harviainen

IPC: G06F3/147 ,  G02B27/01 ,  G06F3/01 ,  H04N13/156 ,  H04N13/344 ,  H04N13/361 ,  H04N13/363 ,  H04N13/332

Abstract: Systems and methods are described for capturing, using a forward-facing camera associated with a head-mounted augmented reality (AR) head-mounted display (HMD), images of portions of first and second display devices in an environment, the first and second display devices displaying first and second portions of content related to an AR presentation, and displaying a third portion of content related to the AR presentation on the AR HMD, the third portion determined based upon the images of portions of the first and second display devices captured using the forward-facing camera. Moreover, the first and second display devices may be active stereo display, and the AR HMD may simultaneously function as shutter glasses.