公开(公告)号：US20250148736A1

公开(公告)日：2025-05-08

申请号：US18924258

申请日：2024-10-23

Applicant: NEC Laboratories America, Inc.

Inventor： Bingbing Zhuang ,  Ziyu Jiang ,  Manmohan Chandraker ,  Shanlin Sun

IPC: G06T19/20 ,  G06T1/20 ,  G06T7/246 ,  G06T7/90 ,  G06T15/00 ,  G06T15/06 ,  G06T15/20 ,  G06T15/50

Abstract: A computer-implemented method for synthesizing an image includes extracting agent neural radiance fields (NeRFs) from driving video logs and storing agent NeRFs in a database. For a driving video log to be edited, a scene NeRF and agent NeRFs are extracted from the driving video log to be edited. One or more agent NeRFs are selected from the database to insert into or replace existing agents in a traffic scene of the driving video log based on photorealism criteria. The traffic scene is edited by inserting a selected agent NeRF into the traffic scene, replacing existing agents in the traffic scene with the selected agent NeRF, or removing one or more existing agents from the traffic scene. An image of the edited traffic scene is synthesized by composing edited agent NeRFs with the scene NeRF and performing volume rendering.

公开(公告)号：US20250118009A1

公开(公告)日：2025-04-10

申请号：US18903348

申请日：2024-10-01

Applicant: NEC Laboratories America, Inc.

Inventor： Bingbing Zhuang ,  Ziyu Jiang ,  Buyu Liu ,  Manmohan Chandraker ,  Shanlin Sun

IPC: G06T15/08 ,  G01S17/89 ,  G06V10/774 ,  G06V20/52

Abstract: A computer-implemented method for synthesizing an image includes capturing data from a scene and fusing grid-based representations of the scene from different encodings to inherit beneficial properties of the different encodings, The encodings include Lidar encoding and a high definition map encoding. Rays are rendered from fused grid-based representations. A density and color are determined for points in the rays. A volume rendering is employed for the rays with the density and color. An image is synthesized from the volume rendered rays with the density and the color.