-
公开(公告)号：US20210407178A1
公开(公告)日：2021-12-30
申请号：US17342851
申请日：2021-06-09
Applicant: Snap Inc.
Inventor： Kai Zhou , Qi Qi , Jeroen Hol
Abstract: Systems and methods of generating ground truth datasets for producing virtual reality (VR) experiences, for testing simulated sensor configurations, and for training machine-learning algorithms. In one example, a recording device with one or more cameras and one or more inertial measurement units captures images and motion data along a real path through a physical environment. A SLAM application uses the captured data to calculate the trajectory of the recording device. A polynomial interpolation module uses Chebyshev polynomials to generate a continuous time trajectory (CTT) function. The method includes identifying a virtual environment and assembling a simulated sensor configuration, such as a VR headset. Using the CTT function, the method includes generating a ground truth output dataset that represents the simulated sensor configuration in motion along a virtual path through the virtual environment. The virtual path is closely correlated with the motion along the real path as captured by the recording device. Accordingly, the output dataset produces a realistic and life-like VR experience. In addition, the methods described can be used to generate multiple output datasets, at various sample rates, which are useful for training the machine-learning algorithms which are part of many VR systems.
-
公开(公告)号：US20250029340A1
公开(公告)日：2025-01-23
申请号：US18353555
申请日：2023-07-17
Applicant: Snap Inc.
Inventor： Kai Zhou , Yubin Xi , Tianyi Sun , Su Hyun Lee
Abstract: Described is a system for emphasizing XR content based on user intent by gathering interaction data from use of one or more interaction functions by a user, accessing a camera feed of a camera system from the XR device, analyzing a combination of data corresponding to the interaction data and the camera feed using a first machine learning model to identify a priority for individual media content items, and determining that a first subset of media content items are of a higher priority than a second subset of media content items. Then the system displays the media content items on the XR device of the user, the first subset of the media content items displayed differently than the second subset of the media content items based on the identified priority.
-
公开(公告)号：US20240314461A1
公开(公告)日：2024-09-19
申请号：US18677296
申请日：2024-05-29
Applicant: Snap Inc.
Inventor： Matthias Kalkgruber , Erick Mendez Mendez , Daniel Wagner , Daniel Wolf , Kai Zhou
IPC: H04N25/531 , G02B27/01 , H04N23/51
CPC classification number: H04N25/531 , G02B27/0172 , H04N23/51 , G02B2027/0138 , G02B2027/014 , G02B2027/0178
Abstract: Visual-inertial tracking of an eyewear device using a rolling shutter camera(s). The device includes a position determining system. Visual-inertial tracking is implemented by sensing motion of the device. An initial pose is obtained for a rolling shutter camera and an image of an environment is captured. The image includes feature points captured at a particular capture time. A number of poses for the rolling shutter camera is computed based on the initial pose and sensed movement of the device. The number of computed poses is responsive to the sensed movement of the mobile device. A computed pose is selected for each feature point in the image by matching the particular capture time for the feature point to the particular computed time for the computed pose. The position of the mobile device is determined within the environment using the feature points and the selected computed poses for the feature points.
-
公开(公告)号：US20240290043A1
公开(公告)日：2024-08-29
申请号：US18135599
申请日：2023-04-17
Applicant: Snap Inc.
Inventor： Kai Zhou , Laura Rosalia Luidolt , Himmy Tam , Riza Alp Guler , Iason Kokkinos , Avihay Assouline
CPC classification number: G06T19/006 , G06T13/40 , G06T2210/16
Abstract: Methods and systems are disclosed for transferring garments from a real-world object to a virtual object. The system receives, by a client device, an image that includes a depiction of a real-world object having a fashion item in a real-world environment. The system accesses a three-dimensional (3D) avatar model of a human and generates a graphic item corresponding to the fashion item being worn by the real-world object depicted in the image. The system modifies the 3D avatar model of the human based on the graphic item and presents the 3D avatar model that has been modified based on the graphic item within a view of the real-world environment on the client device.
-
公开(公告)号：US11915354B2
公开(公告)日：2024-02-27
申请号：US17555762
申请日：2021-12-20
Applicant: Snap Inc.
Inventor： Kai Zhou , Kenneth Au
CPC classification number: G06T13/40 , G06F16/90335 , G06F18/21 , G06T19/006 , G06V20/30 , H04L67/535
Abstract: A system and a method for generating an automated GIF file generation system is described. In one aspect, the method includes accessing an animated GIF file, identifying a plurality of elements displayed in the animated GIF file, applying a variation of one or more elements to the animated GIF file, and generating a variant animated GIF file by applying the variation of the one or more elements to the animated GIF file. The system measures a trending metric of the variant animated GIF file based on a number of times the variant animated GIF file is shared on the communication platform and uses the trending metric as a feedback to generating the variant animated GIF file.
-
Patent Agency Ranking
公开(公告)号：US20230360267A1
公开(公告)日：2023-11-09
申请号：US18198414
申请日：2023-05-17
Applicant: Snap Inc.
Inventor： Clemens Birklbauer , Georg Halmetschlager-Funek , Matthias Kalkgruber , Kai Zhou
CPC classification number: G06T7/80 , G06V10/443 , H04N17/002 , H04N23/61 , H04N23/651 , H04N23/6812
Abstract: A method for adjusting camera intrinsic parameters of a multi-camera visual tracking device is described. In one aspect, a method for calibrating the multi-camera visual tracking system includes disabling a first camera of the multi-camera visual tracking system while a second camera of the multi-camera visual tracking system is enabled, detecting a first set of features in a first image generated by the first camera after detecting that the temperature of the first camera is within the threshold of the factory calibration temperature of the first camera, and accessing and correcting intrinsic parameters of the second camera based on the projection of the first set of features in the second image and a second set of features in the second image.
-
公开(公告)号：US20230154044A1
公开(公告)日：2023-05-18
申请号：US17528911
申请日：2021-11-17
Applicant: Snap Inc.
Inventor： Kai Zhou
CPC classification number: G06T7/80 , G06T7/73 , G06T2200/24 , G06T2200/04
Abstract: A method for adjusting camera intrinsic parameters of a single camera visual tracking device is described. In one aspect, a method includes accessing a temperature of a camera of the visual tracking system, detecting that the temperature of the camera exceeds a threshold, in response identifying one or more feature points that are located in a central region of an initial image, generating a graphical user interface element that instructs a user of the visual tracking system to move the visual tracking system towards a border region of the initial image, and determining intrinsic parameters of the camera based on matching pairs of the one or more detected feature points in the border region and one or more projected feature points in the border region.
-
公开(公告)号：US20220375128A1
公开(公告)日：2022-11-24
申请号：US17448655
申请日：2021-09-23
Applicant: Snap Inc.
Inventor： Clemens Birklbauer , Georg Halmetschlager-Funek , Matthias Kalkgruber , Kai Zhou
Abstract: A method for adjusting camera intrinsic parameters of a multi-camera visual tracking device is described. In one aspect, a method for calibrating the multi-camera visual tracking system includes disabling a first camera of the multi-camera visual tracking system while a second camera of the multi-camera visual tracking system is enabled, detecting a first set of features in a first image generated by the first camera after detecting that the temperature of the first camera is within the threshold of the factory calibration temperature of the first camera, and accessing and correcting intrinsic parameters of the second camera based on the projection of the first set of features in the second image and a second set of features in the second image.
-
公开(公告)号：US20250095282A1
公开(公告)日：2025-03-20
申请号：US18968137
申请日：2024-12-04
Applicant: Snap Inc.
Inventor： Kai Zhou , Qi Qi , Jeroen Hol
Abstract: Systems and methods of generating ground truth datasets for producing virtual reality (VR) experiences, for testing simulated sensor configurations, and for training machine-learning algorithms. In one example, a recording device with one or more cameras and one or more inertial measurement units captures images and motion data along a real path through a physical environment. A SLAM application uses the captured data to calculate the trajectory of the recording device. A polynomial interpolation module uses Chebyshev polynomials to generate a continuous time trajectory (CTT) function. The method includes identifying a virtual environment and assembling a simulated sensor configuration, such as a VR headset. Using the CTT function, the method includes generating a ground truth output dataset that represents the simulated sensor configuration in motion along a virtual path through the virtual environment. The virtual path is closely correlated with the motion along the real path as captured by the recording device. Accordingly, the output dataset produces a realistic and life-like VR experience. In addition, the methods described can be used to generate multiple output datasets, at various sample rates, which are useful for training the machine-learning algorithms which are part of many VR systems.
-
公开(公告)号：US20250068228A1
公开(公告)日：2025-02-27
申请号：US18478853
申请日：2023-09-29
Applicant: Snap Inc.
Inventor： Evangelos Chatzikalymnios , Thomas Faeulhammer , Daniel Wolf , Kai Zhou
IPC: G06F1/3287 , G06V40/10
Abstract: Examples describe a method performed by an extended reality (XR) device that implements a multi-camera object tracking system. The XR device accesses object tracking data associated with an object in a real-world environment. Based on the object tracking data, the XR device activates a low-power mode of the multi-camera object tracking system. In the low-power mode, a state of the object in the real-world environment is determined by using the multi-camera object tracking system.
-
-
-
-
-
-
-
-
-
Search Results
38
records
(took 0.02 seconds)
