公开(公告)号：US20240362856A1

公开(公告)日：2024-10-31

申请号：US18767076

申请日：2024-07-09

申请人： Magic Leap, Inc.

发明人： Vaibhav Mathur ,  David Manly ,  Jahja I. Trisnadi ,  Clinton Carlisle ,  Lionel Ernest Edwin ,  Michael Anthony Klug

IPC分类号： G06T15/50 ,  G02B27/01 ,  G06F3/01 ,  G06T15/80

CPC分类号： G06T15/506 ,  G02B27/0172 ,  G06F3/013 ,  G06T15/80 ,  G02B2027/0118 ,  G02B2027/0178 ,  G06T2215/16

摘要： Techniques are described for operating an optical system. In some embodiments, light associated with a world object is received at the optical system. Virtual image light is projected onto an eyepiece of the optical system. A portion of a system field of view of the optical system to be at least partially dimmed is determined based on information detected by the optical system. A plurality of spatially-resolved dimming values for the portion of the system field of view may be determined based on the detected information. The detected information may include light information, gaze information, and/or image information. A dimmer of the optical system may be adjusted to reduce an intensity of light associated with the world object in the portion of the system field of view according to the plurality of dimming values.

公开(公告)号：US12131419B2

公开(公告)日：2024-10-29

申请号：US16917636

申请日：2020-06-30

申请人： Lucasfilm Entertainment Company Ltd.

发明人： Nicholas Walker ,  David Weitzberg ,  André Mazzone

IPC分类号： G06T15/06 ,  G06T3/08 ,  G06T15/20 ,  G06T15/50

CPC分类号： G06T15/06 ,  G06T3/08 ,  G06T15/20 ,  G06T15/50

摘要： A method of rendering an image includes receiving information of a virtual camera, including a camera position and a camera orientation defining a virtual screen; receiving information of a target screen, including a target screen position and a target screen orientation defining a plurality of pixels, each respective pixel corresponding to a respective UV coordinate on the target screen; for each respective pixel of the target screen: determining a respective XY coordinate of a corresponding point on the virtual screen based on the camera position, the camera orientation, the target screen position, the target screen orientation, and the respective UV coordinate; tracing one or more rays from the virtual camera through the corresponding point on the virtual screen toward a virtual scene; and estimating a respective color value for the respective pixel based on incoming light from virtual objects in the virtual scene that intersect the one or more rays.

公开(公告)号：US20240355038A1

公开(公告)日：2024-10-24

申请号：US18758162

申请日：2024-06-28

申请人： Intel Corporation

发明人： Alexey M. Supikov ,  Ronald Tadao Azuma

IPC分类号： G06T15/06 ,  G06T7/557 ,  G06T15/50

CPC分类号： G06T15/06 ,  G06T7/557 ,  G06T15/503 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2210/56

摘要： Example apparatus disclosed herein query a neural network for an optical density at a sample point along a training ray, the training ray associated with training the neural network to provide a neural representation of a video frame. Disclosed example apparatus also generate an occupancy grid for the video frame based on the optical density at the sample point along the training ray, the occupancy grid including voxels to indicate whether respective portions of a three-dimensional (3D) volume associated with the neural representation are occupied with geometry.

公开(公告)号：US12125134B2

公开(公告)日：2024-10-22

申请号：US18130448

申请日：2023-04-04

申请人： Stratasys Ltd.

发明人： Blake Zachary Courter ,  Stephen Demai

IPC分类号： G06T15/08 ,  B29C64/386 ,  B29C64/393 ,  B33Y50/02 ,  G03G15/22 ,  G06F30/00 ,  G06T1/20 ,  G06T15/00 ,  G06T15/50

CPC分类号： G06T15/08 ,  B29C64/393 ,  B33Y50/02 ,  G06F30/00 ,  G06T1/20 ,  G06T15/005 ,  G06T15/503 ,  B29C64/386 ,  G03G15/224

摘要： A system for generating slice data for additive manufacturing, comprises a graphics processing unit (GPU) that receives a digital model of an object in a three-dimensional build space defined over a plurality of slices, computes a three-dimensional signed distance field over voxels in the build space, assigns a building material to each voxel based on a respective distance field value, and generates slice data output pertaining to the building material assignments for each slice. The slice data output can be used for printing the object in layers corresponding to the slices. The distance field comprises one or more vector having a vertical component with respect to the slices.

公开(公告)号：US20240346748A1

公开(公告)日：2024-10-17

申请号：US18752598

申请日：2024-06-24

申请人： Outward, Inc.

发明人： Clarence Chui ,  Manu Parmar ,  Marc Mignard ,  Avinash Venkata Uppuluri ,  John Le ,  Andrew Pang

IPC分类号： G06T15/50 ,  G06T7/10 ,  G06T7/50 ,  G06T7/70 ,  G06T15/04 ,  G06T15/60 ,  G06T17/20 ,  G06T19/00 ,  G06T19/20 ,  G06V10/70 ,  G06V20/00 ,  G06V20/20 ,  H04N5/222 ,  H04N13/156 ,  H04N13/239 ,  H04N13/254 ,  H04N13/296 ,  H04N23/56 ,  H04N23/60 ,  H04N23/61 ,  H04N23/62 ,  H04N23/69 ,  H04N23/695 ,  H04N23/74

CPC分类号： G06T15/506 ,  G06T7/10 ,  G06T7/50 ,  G06T7/70 ,  G06T15/04 ,  G06T15/50 ,  G06T15/60 ,  G06T17/20 ,  G06T19/006 ,  G06T19/20 ,  G06V10/70 ,  G06V20/20 ,  G06V20/36 ,  H04N5/222 ,  H04N13/156 ,  H04N13/239 ,  H04N13/254 ,  H04N13/296 ,  H04N23/56 ,  H04N23/61 ,  H04N23/62 ,  H04N23/64 ,  H04N23/69 ,  H04N23/695 ,  H04N23/74 ,  G06T2200/08 ,  G06T2200/24 ,  G06T2207/10028 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/20212 ,  G06T2207/30244 ,  G06T2210/04 ,  G06T2210/56 ,  G06T2219/2004 ,  G06T2219/2016

摘要： A content generation platform is generally described herein. More specifically, interactive image generation and techniques and features thereof are disclosed herein. One or more sets of images of a scene are captured in an imaging studio. The captured one or more sets of images of the scene are processed using one or more machine learning based networks to generate an interactive image of the scene comprising a plurality of interactive features. One or more of the plurality of interactive features of the generated interactive image may be modified or edited according to user preferences.

公开(公告)号：US20240338890A1

公开(公告)日：2024-10-10

申请号：US18746174

申请日：2024-06-18

申请人： Yamaha Corporation

发明人： Akihiko Suyama

IPC分类号： G06T15/50 ,  G06F3/16 ,  G06T15/20 ,  H05B47/105

CPC分类号： G06T15/506 ,  G06F3/165 ,  G06T15/20 ,  H05B47/105

摘要： An image display system includes an image information acquisition unit and a display control unit. The image information acquisition unit is configured to acquire image information. The display control unit is configured to display a virtual space in which a target image corresponding to the image information is displayed, and to control light to be emitted by a virtual lighting device provided in the virtual space based on state information indicating a state of a target space indicated in the target image.

公开(公告)号：US20240338885A1

公开(公告)日：2024-10-10

申请号：US18623988

申请日：2024-04-01

申请人： Epica International, Inc.

发明人： Elena Denisova ,  Leonardo Bocchi

IPC分类号： G06T15/08 ,  G06T15/00 ,  G06T15/04 ,  G06T15/06 ,  G06T15/20 ,  G06T15/50

CPC分类号： G06T15/08 ,  G06T15/005 ,  G06T15/04 ,  G06T15/06 ,  G06T15/205 ,  G06T15/506 ,  G06T2210/21 ,  G06T2210/41 ,  G06T2210/62

摘要： Rendering three-dimensional (3D) volumes from scan data acquired by computed tomography (CT). A transfer function is applied to a 3D grid of voxels generated from the scan data, each voxel having an associated intensity value, to determine a density value associated with each voxel. A 3D grid of super voxels is generated, each super voxel being formed from a number of adjacent voxels of the 3D grid of voxels, each super voxel having an associated density value. An optimization is performed using the 3D grid of super voxels, based at least in part on a defined super voxel size. A 3D volume is drawn based at least in part on the 3D grid of super voxels and the determined density associated with each super voxel. The super voxel size may be determined based at least in part on a 3D fractal dimension of a 3D volume being rendered.

公开(公告)号：US20240331269A1

公开(公告)日：2024-10-03

申请号：US18604831

申请日：2024-03-14

申请人： Siemens Healthineers AG

发明人： Sandra Sudarsky

IPC分类号： G06T15/08 ,  G06T15/30 ,  G06T15/50

CPC分类号： G06T15/08 ,  G06T15/30 ,  G06T15/50

摘要： A hidden structure of a volumetric data set is rendered in a medical image based on a volumetric data set received from a medical scanner. Reference information indicative of a parameter for a clip plane is received for rendering the hidden structure within the medical image. A differentiable rendering, DR, algorithm is applied on the received volumetric data set, which comprises determining a light accumulation along a viewing ray. The clip plane is approximated by including a smooth approximation to a Dirac delta distribution, which depends on the parameter comprised in the received reference information, in the determining of the light accumulation along the viewing ray. The parameter for the clip plane is optimized by optimizing an objective function. The medical image with the hidden structure visible is output for final rendering, and/or for display.

公开(公告)号：US12106430B2

公开(公告)日：2024-10-01

申请号：US18009721

申请日：2021-06-14

申请人： DEPIX TECHNOLOGIES INC.

发明人： Marc-Andre Gardner ,  Jean-François Lalonde ,  Christian Gagne

IPC分类号： G06T15/50 ,  G06V10/60 ,  G06V10/77 ,  G06V10/774 ,  G06V10/82

CPC分类号： G06T15/506 ,  G06V10/60 ,  G06V10/7715 ,  G06V10/82 ,  G06T2215/12 ,  G06V10/774

摘要： An automated and dynamic method and system are provided for estimating lighting conditions of a scene captured from a plurality of digital images. The method comprises generating 3D-source-specific-lighting parameters of the scene using a lighting-estimation neural network configured for: extracting from the plurality of images a corresponding number of latent feature vectors; transforming the latent feature vectors into common-coordinates latent feature vectors; merging the plurality of common-coordinates latent feature vectors into a single latent feature vector; and extracting, from the single latent feature vector, 3D-source-specific-lighting parameters of the scene.

公开(公告)号：US20240312123A1

公开(公告)日：2024-09-19

申请号：US18592025

申请日：2024-02-29

申请人： NVIDIA Corporation

发明人： Malik Aqeel Anwar ,  Tae Eun Choe ,  Zian Wang ,  Sanja Fidler ,  Minwoo Park

IPC分类号： G06T15/50 ,  G06T15/60 ,  G06T19/20 ,  G06V10/774 ,  H04N23/698

CPC分类号： G06T15/506 ,  G06T15/60 ,  G06T19/20 ,  H04N23/698 ,  G06T2219/2004 ,  G06V10/774

摘要： In various examples, systems and methods are disclosed that relate to data augmentation for training/updating perception models in autonomous or semi-autonomous systems and applications. For example, a system may receive data associated with a set of frames that are captured using a plurality of cameras positioned in fixed relation relative to the machine; generate a panoramic view based at least on the set of frames; provide data associated with the panoramic view to a model to cause the model to generate a high dynamic range (HDR) panoramic view; determine lighting information associated with a light distribution map based at least on the HDR panoramic view; determine a virtual scene; and render an asset and a shadow on at least one of the frames, based at least on the virtual scene and the light distribution map, the shadow being a shadow corresponding to the asset.