-
公开(公告)号：US20240096035A1
公开(公告)日：2024-03-21
申请号：US18371402
申请日：2023-09-21
发明人： Nicholas Rasmussen , Lutz Latta
CPC分类号： G06T19/006 , G06T1/20 , G06T7/20
摘要： A method of content production may include receiving tracking information for a camera with a frustum configured to capture images of a subject in an immersive environment. a first image of a virtual environment corresponding to the frustum may be rendered using a first rendering process based on the tracking information to be perspective-correct when displayed on the displays and viewed through the camera. A second image of the virtual environment may also be rendered using a second rendering process for a specific display. The first image and the second image may be rendered in parallel. The second image and a portion of the first image may be composited together to generate a composite image, where the portion of the first image may correspond to a portion of the display captured by the frustum.
-
2.发明公开公开(公告)号：US20230316587A1
公开(公告)日：2023-10-05
申请号：US17707782
申请日：2022-03-29
发明人： Sirak Ghebremusse , Stéphane Grabli , Jacek Krzysztof Naruniec , Romann Matthew Weber , Christopher Richard Schroers
CPC分类号： G06T9/002 , G06V40/168 , G06T11/00 , G06T7/70 , G06T2207/30201 , G06T2207/20081 , G06T2200/24 , G06T2207/20092 , G06T2207/10016 , G06T2207/20084
摘要： A computer-implemented method of changing a face within an output image or video frame that includes: receiving an input image that includes a face presenting a facial expression in a pose; processing the image with a neural network encoder to generate a latent space point that is an encoded representation of the image; decoding the latent space point to generate an initial output image in accordance with a desired facial identity but with the facial expression and pose of the face in the input image; identifying a feature of the facial expression in the initial output image to edit; applying an adjustment vector to a latent space point corresponding to the initial output image to generate an adjusted latent space point; and decoding the adjusted latent space point to generate an adjusted output image in accordance with the desired facial identity but with the facial expression and pose of the face in the input image altered in accordance with the adjustment vector
-
公开(公告)号：US11762481B2
公开(公告)日：2023-09-19
申请号：US17716474
申请日：2022-04-08
发明人： Michael Jutan , David Hirschfield , Robert Derry , Gary Martinez
IPC分类号： G06F3/03 , G06F3/01 , G06F3/04847 , G06F3/0482 , G06F3/04815
CPC分类号： G06F3/0304 , G06F3/011 , G06F3/0482 , G06F3/04815 , G06F3/04847
摘要： In some implementations, an apparatus may include a housing enclosing a circuitry may include a processor and a memory, the housing forming a handgrip. In addition, the apparatus may include a plurality of light sensors arranged in a particular configuration, each of the plurality of light sensors coupled to an exterior the housing via a sensor arm. Also, the apparatus may include one or more controls mounted on the exterior of the housing and electrically coupled to the circuitry. The apparatus can include one or more antenna mounted on an exterior of the housing; and a transmitter connected to the circuitry and electrically connected to the one or more antenna to send data from the apparatus via a wireless protocol. The apparatus can include an electronic device for mounting an electronic device to the housing, the electronic device configured to execute an application for an immersive content generation system.
-
公开(公告)号：US11514653B1
公开(公告)日：2022-11-29
申请号：US17494890
申请日：2021-10-06
发明人： Roger Cordes , David Brickhill
IPC分类号： G06K9/00 , G06T19/00 , G06T13/40 , A63F13/213 , A63F13/65 , G06F3/01 , G06T7/593 , G06T7/246 , G06T7/73 , G06T15/08 , G06T19/20 , A63F13/35 , A63F13/60 , G02B27/01 , G06V40/20 , H04L65/611 , G06V40/10
摘要： An immersive content presentation system can capture the motion or position of a performer in a real-world environment. A game engine can be modified to receive the position or motion of the performer and identify predetermined gestures or positions that can be used to trigger actions in a 3-D virtual environment, such as generating a digital effect, transitioning virtual assets through an animation graph, adding new objects, and so forth. The use of the 3-D environment can be rendered and composited views can be generated. Information for constructing the composited views can be streamed to numerous display devices in many different physical locations using a customized communication protocol. Multiple real-world performers can interact with virtual objects through the game engine in a shared mixed-reality experience.
-
公开(公告)号：US20220345234A1
公开(公告)日：2022-10-27
申请号：US17236817
申请日：2021-04-21
发明人： Stephen Morris , Scott Levine , Nicolas Tsingos
摘要： Some implementations of the disclosure relate to using a model trained on mixing console data of sound mixes to automate the process of sound mix creation. In one implementation, a non-transitory computer-readable medium has executable instructions stored thereon that, when executed by a processor, causes the processor to perform operations comprising: obtaining a first version of a sound mix; extracting first audio features from the first version of the sound mix obtaining mixing metadata; automatically calculating with a trained model, using at least the mixing metadata and the first audio features, mixing console features; and deriving a second version of the sound mix using at least the mixing console features calculated by the trained model.
-
公开(公告)号：US20210407174A1
公开(公告)日：2021-12-30
申请号：US16917636
申请日：2020-06-30
发明人： Nicholas Walker , David Weitzberg , André Mazzone
摘要： A method of rendering an image includes receiving information of a virtual camera, including a camera position and a camera orientation defining a virtual screen; receiving information of a target screen, including a target screen position and a target screen orientation defining a plurality of pixels, each respective pixel corresponding to a respective UV coordinate on the target screen; for each respective pixel of the target screen: determining a respective XY coordinate of a corresponding point on the virtual screen based on the camera position, the camera orientation, the target screen position, the target screen orientation, and the respective UV coordinate; tracing one or more rays from the virtual camera through the corresponding point on the virtual screen toward a virtual scene; and estimating a respective color value for the respective pixel based on incoming light from virtual objects in the virtual scene that intersect the one or more rays.
-
公开(公告)号：US11200752B1
公开(公告)日：2021-12-14
申请号：US16999893
申请日：2020-08-21
发明人： Roger Cordes , Lutz Latta
摘要： In at least one embodiment, an immersive content generation system may receive a first user input that defines a three-dimensional (3D) volume within a performance area. In at least one embodiment, the system may capture a plurality of images of an object in the performance area using a camera, wherein the object is at least partially surrounded by one or more displays presenting images of a virtual environment. In at least one embodiment, the system may receive a second user input to adjust a color value of a virtual image of the object as displayed in the images in the virtual environment. In at least one embodiment, the system may perform a color correction pass for the displayed images of the virtual environment. In at least one embodiment, the system may generate content based on the plurality of captured images that are corrected via the color correction pass.
-
公开(公告)号：US10825225B1
公开(公告)日：2020-11-03
申请号：US16359732
申请日：2019-03-20
发明人： Ronald Radeztsky , Michael Koperwas
摘要： Some implementations of the disclosure are directed to a pipeline that enables real time engines such as gaming engines to leverage high quality simulations generated offline via film grade simulation systems. In one implementation, a method includes: obtaining simulation data and skeletal mesh data of a character, the simulation data and skeletal mesh data including the character in the same rest pose; importing the skeletal mesh data into a real-time rendering engine; and using at least the simulation data and the imported skeletal mesh data to derive from the simulation data a transformed simulation vertex cache that is usable by the real-time rendering engine during runtime to be skinned in place of the rest pose.
-
公开(公告)号：US10762599B2
公开(公告)日：2020-09-01
申请号：US14194253
申请日：2014-02-28
发明人： Steve Sullivan
IPC分类号： G06T3/20 , G06F3/0481 , G06T19/00
摘要： A method is described that includes receiving, from a first device, input used to select a first object in a computer-generated environment. The first device has at least two degrees of freedom with which to control the selection of the first object. The method also includes removing, in response to the selection of the first object, at least two degrees of freedom previously available to a second device used to manipulating a second object in the computer-generated environment. The removed degrees of freedom correspond to the at least two degrees of freedom of the first device and specify an orientation of the second object relative to the selected first object. Additionally, the method includes receiving, from the second device, input including movements within the reduced degrees of freedom used to manipulate a position of the second object while maintaining the specified orientation relative to the selected first object.
-
公开(公告)号：US10732797B1
公开(公告)日：2020-08-04
申请号：US15730469
申请日：2017-10-11
发明人： Jose Perez, III , Peter Dollar , Barak Moshe
IPC分类号： G06F9/48 , G06F3/0482 , G06T19/20 , G06F3/0484 , G02B27/01 , G06F3/01 , G06F3/0481
摘要： Views of a virtual environment can be displayed on mobile devices in a real-world environment simultaneously for multiple users. The users can operate selections devices in the real-world environment that interact with objects in the virtual environment. Virtual characters and objects can be moved and manipulated using selection shapes. A graphical interface can be instantiated and rendered as part of the virtual environment. Virtual cameras and screens can also be instantiated to created storyboards, backdrops, and animated sequences of the virtual environment. These immersive experiences with the virtual environment can be used to generate content for users and for feature films.
-
-
-
-
-
-
-
-
-
搜索结果
273 条记录 (耗时 0.024 秒)
