-
公开(公告)号：US20250061658A1
公开(公告)日：2025-02-20
申请号：US18234737
申请日：2023-08-16
Applicant: Snap Inc.
Inventor： Laura Rosalia Luidolt , Kai Zhou , Adrian Schoisengeier
Abstract: An augmented reality (AR) device generates hand annotations for an image depicting a user's hand. The device includes a display, a processor, and a memory storing instructions for performing operations. The device performs a calibration operation to generate a 3-D model of the user's hand based on measurements. The calibration operation prompts the user to mimic the hand gesture presented by the animated virtual representation of a hand to obtain optimal images of the hand for hand pose estimation. A 3-D virtual representation of a hand in a hand pose corresponding with a hand gesture is generated based on the 3-D model. The device presents the 3-D virtual representation of the hand in AR via the display. During presentation, the device detects an input and captures an image of the user's hand positioned to correspond with the 3-D virtual representation. The captured image is stored with corresponding hand annotations based on the 3-D model.
-
公开(公告)号：US20240212287A1
公开(公告)日：2024-06-27
申请号：US18069779
申请日：2022-12-21
Applicant: Snap Inc.
CPC classification number: G06T19/006 , G06V40/103 , G06V40/20
Abstract: An ergonomics evaluation system for AR applications of an AR device is described. In one aspect, a method includes accessing user interface elements of an augmented reality application, accessing a plurality of user models and corresponding simulated augmented reality device sensor data for the plurality of user models, identifying simulated user interactions, from the plurality of user models, with a simulated augmented reality device operating the augmented reality application, based on the plurality of user models and corresponding simulated augmented reality device sensor data for the plurality of user models, applying a computer vision algorithm to the simulated user interactions, identifying user postures and user motions based on the simulated user interactions, and generating a first ergonomic feedback based on the user postures and the user motions.
-
公开(公告)号：US12014523B2
公开(公告)日：2024-06-18
申请号：US18198414
申请日：2023-05-17
Applicant: Snap Inc.
Inventor： Clemens Birklbauer , Georg Halmetschlager-Funek , Matthias Kalkgruber , Kai Zhou
CPC classification number: G06T7/80 , G06V10/443 , H04N17/002 , H04N23/61 , H04N23/651 , H04N23/6812
Abstract: A method for adjusting camera intrinsic parameters of a multi-camera visual tracking device is described. In one aspect, a method for calibrating the multi-camera visual tracking system includes disabling a first camera of the multi-camera visual tracking system while a second camera of the multi-camera visual tracking system is enabled, detecting a first set of features in a first image generated by the first camera after detecting that the temperature of the first camera is within the threshold of the factory calibration temperature of the first camera, and accessing and correcting intrinsic parameters of the second camera based on the projection of the first set of features in the second image and a second set of features in the second image.
-
Patent Agency Ranking
公开(公告)号：US11983897B2
公开(公告)日：2024-05-14
申请号：US17528911
申请日：2021-11-17
Applicant: Snap Inc.
Inventor： Kai Zhou
CPC classification number: G06T7/80 , G06T7/73 , G06T2200/04 , G06T2200/24
Abstract: A method for adjusting camera intrinsic parameters of a single camera visual tracking device is described. In one aspect, a method includes accessing a temperature of a camera of the visual tracking system, detecting that the temperature of the camera exceeds a threshold, in response identifying one or more feature points that are located in a central region of an initial image, generating a graphical user interface element that instructs a user of the visual tracking system to move the visual tracking system towards a border region of the initial image, and determining intrinsic parameters of the camera based on matching pairs of the one or more detected feature points in the border region and one or more projected feature points in the border region.
-
公开(公告)号：US20230421717A1
公开(公告)日：2023-12-28
申请号：US17851448
申请日：2022-06-28
Applicant: Snap Inc.
Inventor： Kai Zhou , Branislav Micusik
CPC classification number: H04N5/265 , H04N5/23222 , G06T7/50 , G06T7/11 , G06T7/194 , G06T7/70 , H04N5/232935 , G06T3/4007 , G06T2200/24 , G06T2207/30201 , G06T2207/30244
Abstract: A method for generating a virtual selfie stick image is described. In one aspect, the method includes generating, at a device, an original self-portrait image with an optical sensor of the device, the optical sensor directed at a face of a user of the device, the device being held at an arm length from the face of the user, displaying, on a display of the device, an instruction guiding the user to move the device at the arm length about the face of the user within a limited range at a plurality of poses, accessing, at the device, image data generated by the optical sensor at the plurality of poses, and generating a virtual selfie stick self-portrait image based on the original self-portrait image and the image data.
-
公开(公告)号：US20230419615A1
公开(公告)日：2023-12-28
申请号：US17846930
申请日：2022-06-22
Applicant: Snap Inc.
Inventor： Kai Zhou , Adrian Schoisengeier
CPC classification number: G06T19/006 , G06V20/64 , G06F3/017 , G06T17/00 , G06T19/20 , G06F3/012 , B25J13/08 , G06T2200/08 , G06T2210/56 , G06T2219/2016
Abstract: A method for programming a robotic system by demonstration is described. In one aspect, the method includes displaying a first virtual object in a display of an augmented reality (AR) device, the first virtual object corresponding to a first physical object in a physical environment of the AR device, tracking, using the AR device, a manipulation of the first virtual object by a user of the AR device, identifying an initial state and a final state of the first virtual object based on the tracking, the initial state corresponding to an initial pose of the first virtual object, the final state corresponding to a final pose of the first virtual object, and programming by demonstration a robotic system using the tracking of the manipulation of the first virtual object, the first initial state of the first virtual object, and the final state of the first virtual object.
-
公开(公告)号：US11663738B2
公开(公告)日：2023-05-30
申请号：US17518817
申请日：2021-11-04
Applicant: Snap Inc.
Inventor： Kai Zhou
CPC classification number: G06T7/74 , G06T11/60 , G06V20/20 , G06V40/25 , G06T2207/30241 , G06T2207/30244
Abstract: A method for transferring a gait pattern of a first user to a second user to simulate augmented reality content in a virtual simulation environment is described. In one aspect, the method includes identifying a gait pattern of a first user operating a first visual tracking system in a first physical environment, identifying a trajectory from a second visual tracking system operated by a second user in a second physical environment, the trajectory based on poses of the second visual tracking system over time, modifying the trajectory from the second visual tracking system based on the gait pattern of the first user, applying the modified trajectory in a plurality of virtual environments, and generating simulated ground truth data based on the modified trajectory in the plurality of virtual environments.
-
公开(公告)号：US20220375121A1
公开(公告)日：2022-11-24
申请号：US17518817
申请日：2021-11-04
Applicant: Snap Inc.
Inventor： Kai Zhou
Abstract: A method for transferring a gait pattern of a first user to a second user to simulate augmented reality content in a virtual simulation environment is described. In one aspect, the method includes identifying a gait pattern of a first user operating a first visual tracking system in a first physical environment, identifying a trajectory from a second visual tracking system operated by a second user in a second physical environment, the trajectory based on poses of the second visual tracking system over time, modifying the trajectory from the second visual tracking system based on the gait pattern of the first user, applying the modified trajectory in a plurality of virtual environments, and generating simulated ground truth data based on the modified trajectory in the plurality of virtual environments.
-
-
-
-
-
-
-
Search Results
38
records
(took 0.035 seconds)
