公开(公告)号：US20240386651A1

公开(公告)日：2024-11-21

申请号：US18317818

申请日：2023-05-15

Applicant: Lemon Inc.

Inventor： Celong Liu ,  Xing Mei

IPC: G06T15/08

Abstract: Examples of memory-efficient volume data structures for novel view rendering are provided. In one aspect, a computing device for rendering a model volume data structure is provided. The computing device comprises a processor coupled to a storage medium that stores instructions, which, upon execution by the processor, cause the processor to store the model volume data structure, wherein the model volume data structure comprises a B+ tree graph, determine a camera view in which to render the model volume data structure, determine a plurality of rays in three-dimensional space based on the camera view, for each ray in the plurality of rays, perform a ray-marching process using the model volume data structure to determine a plurality of color features, and render the model volume data structure using the pluralities of color features.

公开(公告)号：US20230401815A1

公开(公告)日：2023-12-14

申请号：US17806410

申请日：2022-06-10

Applicant: Lemon Inc.

Inventor： Celong Liu ,  Lelin Zhang ,  Qingyu Chen ,  Yunzhu Li ,  Haoze Li ,  Xing Mei

IPC: G06V10/40 ,  G06V10/82 ,  G06V10/56

CPC classification number: G06V10/513 ,  G06V10/82 ,  G06V10/56

Abstract: A computer-implemented method for transforming a neural radiance field model is described. A plurality of inputs are provided to a neural radiance field (NeRF) model that represents a 3-dimensional space having a subject, wherein each input of the plurality of inputs includes a location and a view direction and corresponds to respective colors of voxels that represent the 3-dimensional space. A spectral analysis is performed on a plurality of outputs of the NeRF model based on the plurality of inputs, wherein the plurality of outputs include the respective colors of the voxels. Frequency components of the spectral analysis that represent colors for at least some of the voxels are extracted. A sparse volume data structure that represents the 3-dimensional space and the respective colors for the at least some of the voxels is generated.

公开(公告)号：US12190558B2

公开(公告)日：2025-01-07

申请号：US17806410

申请日：2022-06-10

Applicant: Lemon Inc.

Inventor： Celong Liu ,  Lelin Zhang ,  Qingyu Chen ,  Yunzhu Li ,  Haoze Li ,  Xing Mei

IPC: G06V10/40 ,  G06V10/56 ,  G06V10/82

Abstract: A computer-implemented method for transforming a neural radiance field model is described. A plurality of inputs are provided to a neural radiance field (NeRF) model that represents a 3-dimensional space having a subject, wherein each input of the plurality of inputs includes a location and a view direction and corresponds to respective colors of voxels that represent the 3-dimensional space. A spectral analysis is performed on a plurality of outputs of the NeRF model based on the plurality of inputs, wherein the plurality of outputs include the respective colors of the voxels. Frequency components of the spectral analysis that represent colors for at least some of the voxels are extracted. A sparse volume data structure that represents the 3-dimensional space and the respective colors for the at least some of the voxels is generated.