-
公开(公告)号:US20250087244A1
公开(公告)日:2025-03-13
申请号:US18954868
申请日:2024-11-21
Applicant: Fyusion, Inc.
Inventor: Stefan Johannes Josef Holzer , Radu Bogdan Rusu , Vladimir Roumenov Glavtchev , Alexander Jay Bruen Trevor
IPC: G11B27/32 , G06F16/68 , G11B27/10 , H04N13/349
Abstract: According to particular embodiments, one process includes retrieving a multi-view interactive digital media representation that includes numerous images fused together into content and context models. The process next includes retrieving and processing audio data to be integrated into the multi-view interactive digital media representation. A first segment of audio data may be associated with a first position in the multi-view interactive digital media representation. In other examples, a first segment of audio data may be associated with a visual position or the location of a camera in the multi-view interactive digital media representation. The audio data may be played in coordination with the multi-view interactive digital media representation based on a user's navigation through the multi-view interactive digital media representation, where the first segment is played when the first position or first visual position is reached.
-
公开(公告)号:US20250078403A1
公开(公告)日:2025-03-06
申请号:US18462186
申请日:2023-09-06
Applicant: Fyusion, Inc.
Inventor: Stefan Johannes Josef Holzer , Rodrigo Ortiz-Cayon , Tanvir Parhar , Matteo Munaro , Martin Saelzle
Abstract: A plurality of images of an object and a background may be captured. Three-dimensional representations of the background and the object may be generated based on the captured images. A synthetic image of the object and the background may be rendered. The synthetic image may depict a two-dimensional view of the object having a novel viewpoint different from the viewpoints of the captured images. A corrected synthetic image may be generated. The corrected synthetic image may be stored on a storage medium.
-
公开(公告)号:US20240267481A1
公开(公告)日:2024-08-08
申请号:US18634975
申请日:2024-04-14
Applicant: Fyusion, Inc.
Inventor: Stefan Johannes Josef HOLZER , Matteo MUNARO , Abhishek KAR , Alexander Jay Bruen TREVOR , Krunal Ketan CHANDE , Michelle Jung-Ah HO , Radu Bogdan RUSU
CPC classification number: H04N5/2621 , G06V10/22 , G06V20/10 , G06V20/40 , H04N23/611 , H04N23/62 , H04N23/683
Abstract: Provided are mechanisms and processes for scene-aware selection of filters and effects for visual digital media content. In one example, a digital media item is analyzed with a processor to identify one or more characteristics associated with the digital media item, where the characteristics include a physical object represented in the digital media item. Based on the identified characteristics, a digital media modification is selected from a plurality of digital media modifications for application to the digital media item. The digital media modification may then be provided for presentation in a user interface for selection by a user.
-
公开(公告)号:US20240257445A1
公开(公告)日:2024-08-01
申请号:US18633446
申请日:2024-04-11
Applicant: Fyusion, Inc.
Inventor: Stefan Johannes Josef HOLZER , Abhishek KAR , Matteo MUNARO , Pavel HANCHAR , Radu Bogdan RUSU , Santi ARANO
IPC: G06T15/20 , G01C21/32 , G06F9/451 , G06F16/29 , G06F17/18 , G06F30/15 , G06N3/02 , G06Q30/02 , G06T7/00 , G06T7/593 , G06T7/70 , G06T15/10 , G06T17/00 , G06T19/00 , H04N13/00 , H04N13/243 , H04N13/271 , H04N23/63
CPC classification number: G06T15/205 , G01C21/32 , G06F9/453 , G06F16/29 , G06F17/18 , G06F30/15 , G06N3/02 , G06Q30/0278 , G06T7/0002 , G06T7/0004 , G06T7/593 , G06T7/70 , G06T15/10 , G06T17/00 , G06T19/003 , G06T19/006 , H04N13/243 , H04N13/271 , H04N23/633 , G06T2200/08 , G06T2200/24 , G06T2207/10016 , G06T2207/10028 , G06T2207/20076 , G06T2207/20081 , G06T2207/20084 , G06T2207/20224 , G06T2207/30108 , G06T2207/30244 , G06T2207/30248 , H04N2013/0081
Abstract: A plurality of images may be analyzed to determine an object model. The object model may have a plurality of components, and each of the images may correspond with one or more of the components. Component condition information may be determined for one or more of the components based on the images. The component condition information may indicate damage incurred by the object portion corresponding with the component.
-
公开(公告)号:US20240211511A1
公开(公告)日:2024-06-27
申请号:US18601914
申请日:2024-03-11
Applicant: Fyusion, Inc.
Inventor: Stefan Johannes Josef Holzer , Abhishek Kar , Alexander Jay Bruen Trevor , Pantelis Kalogiros , Ioannis Spanos , Radu Bogdan Rusu
IPC: G06F16/583 , G06V10/10 , G06V20/20 , G06V20/64
CPC classification number: G06F16/5838 , G06V10/17 , G06V20/20 , G06V20/64
Abstract: Provided are mechanisms and processes for performing visual search using multi-view digital media representations, such as surround views. In one example, a process includes receiving a visual search query that includes a surround view of an object to be searched, where the surround view includes spatial information, scale information, and different viewpoint images of the object. The surround view is compared to stored surround views by comparing spatial information and scale information of the surround view to spatial information and scale information of the stored surround views. A correspondence measure is then generated indicating the degree of similarity between the surround view and a possible match. At least one search result is then transmitted with a corresponding image in response to the visual search query.
-
公开(公告)号:US11972556B2
公开(公告)日:2024-04-30
申请号:US18068454
申请日:2022-12-19
Applicant: Fyusion, Inc.
Inventor: Stefan Johannes Josef Holzer , Abhishek Kar , Matteo Munaro , Pavel Hanchar , Radu Bogdan Rusu
CPC classification number: G06T7/001 , G06T3/4038 , G06T5/50 , G06T7/0004 , G06V10/44 , G06V10/454 , G06V10/803 , G06V20/20 , G06V20/647 , H04N23/45
Abstract: A background scenery portion may be identified in each of a plurality of image sets of an object, where each image set includes images captured simultaneously from different cameras. A correspondence between the image sets may determined, where the correspondence tracks control points associated with the object and present in multiple images. A multi-view interactive digital media representation of the object that is navigable in one or more dimensions and that includes the image sets may be generated and stored.
-
公开(公告)号:US20240098233A1
公开(公告)日:2024-03-21
申请号:US18520442
申请日:2023-11-27
Applicant: Fyusion, Inc.
Inventor: Alexander Jay Bruen Trevor , Chris Beall , Vladimir Glavtchev , Stefan Johannes Josef Holzer , Radu Bogdan Rusu
IPC: H04N13/117 , G01B11/24 , G01B21/22 , G06T7/00 , H04N13/398 , H04N23/62 , H04N23/698 , H04N23/90 , H04N25/40
CPC classification number: H04N13/117 , G01B11/24 , G01B21/22 , G06T7/00 , H04N13/398 , H04N23/62 , H04N23/698 , H04N23/90 , H04N25/41
Abstract: Various embodiments of the present invention relate generally to systems and methods for analyzing and manipulating images and video. In particular, a multi-view interactive digital media representation can be generated from live images captured from a camera. The live images can include an object. An angular view of the object captured in the live images can be estimated using sensor data from an inertial measurement unit. The determined angular views can be used to select from among the live images. The multi-view interactive digital media representation can include a plurality of images where each of the plurality of images includes the object from a different camera view. When the plurality of images is output to a display, the object can appear to undergo a 3-D rotation through the determined angular view where the 3-D rotation of the object is generated without a 3-D polygon model of the object.
-
公开(公告)号:US11887256B2
公开(公告)日:2024-01-30
申请号:US17516136
申请日:2021-11-01
Applicant: Fyusion, Inc.
Inventor: Tobias Bertel , Yusuke Tomoto , Srinivas Rao , Krunal Ketan Chande , Rodrigo Ortiz-Cayon , Stefan Johannes Josef Holzer , Christian Richardt
CPC classification number: G06T17/20 , G06F18/217 , G06N3/045 , G06T15/04 , G06V10/751
Abstract: Novel images may be generated using an image generator implemented on a processor. The image generator may receive as input neural features selected from a neural texture atlas. The image generator may also receive as input one or more position guides identifying position information for a plurality of input image pixels. The novel images may be evaluated using an image discriminator to determine a plurality of optimization values by comparing each of the plurality of novel images with a respective one of a corresponding plurality of input images. Each of the novel images may be generated from a respective camera pose relative to an object identical to that of the respective one of the corresponding plurality of input images. The image generator and the neural features may be updated based on the optimization values and stored on a storage device.
-
公开(公告)号:US11876948B2
公开(公告)日:2024-01-16
申请号:US17814820
申请日:2022-07-25
Applicant: Fyusion, Inc.
Inventor: Alexander Jay Bruen Trevor , Chris Beall , Vladimir Glavtchev , Stefan Johannes Josef Holzer , Radu Bogdan Rusu
IPC: H04N13/117 , G01B21/22 , H04N13/398 , G01B11/24 , H04N23/62 , H04N23/90 , H04N23/698 , H04N25/40 , G06T7/00
CPC classification number: H04N13/117 , G01B11/24 , G01B21/22 , G06T7/00 , H04N13/398 , H04N23/62 , H04N23/698 , H04N23/90 , H04N25/41
Abstract: Various embodiments of the present invention relate generally to systems and methods for analyzing and manipulating images and video. In particular, a multi-view interactive digital media representation can be generated from live images captured from a camera. The live images can include an object. An angular view of the object captured in the live images can be estimated using sensor data from an inertial measurement unit. The determined angular views can be used to select from among the live images. The multi-view interactive digital media representation can include a plurality of images where each of the plurality of images includes the object from a different camera view. When the plurality of images is output to a display, the object can appear to undergo a 3-D rotation through the determined angular view where the 3-D rotation of the object is generated without a 3-D polygon model of the object.
-
公开(公告)号:US11783443B2
公开(公告)日:2023-10-10
申请号:US16518558
申请日:2019-07-22
Applicant: Fyusion, Inc.
Inventor: Stefan Johannes Josef Holzer , Matteo Munaro , Martin Markus Hubert Wawro , Abhishek Kar , Pavel Hanchar , Krunal Ketan Chande , Radu Bogdan Rusu
CPC classification number: G06T3/0037 , G06T7/70 , G06T2207/20044 , G06T2207/30244 , G06T2207/30248
Abstract: According to various embodiments, component information may be identified for each input image of an object. The component information may indicate a portion of the input image in which a particular component of the object is depicted. A viewpoint may be determined for each input image that indicates a camera pose for the input image relative to the object. A three-dimensional skeleton of the object may be determined based on the viewpoints and the component information. A multi-view panel corresponding to the designated component of the object that is navigable in three dimensions and that the portions of the input images in which the designated component of the object is depicted may be stored on a storage device.
-
-
-
-
-
-
-
-
-