-
公开(公告)号:US12273308B2
公开(公告)日:2025-04-08
申请号:US18091105
申请日:2022-12-29
Applicant: Snap Inc.
Inventor: Newar Husam Al Majid , Timothy Jordan Garcia , Matthew Colin Grantham , Christie Marie Heikkinen , Denise Marcela Martinez , David Whyte
IPC: H04L51/10 , G06F40/169 , G06F40/295 , G06F40/30 , G06N3/006 , G06N3/045 , G06N5/022 , G06T13/20 , G06T13/40 , H04L51/52
Abstract: Systems and methods are provided for performing operations including: receiving, by a messaging application, input that selects an option to generate a message using an avatar with a caption; presenting, by the messaging application, the avatar and a caption entry region proximate to the avatar; populating, by the messaging application, the caption entry region with a text string comprising one or more words; determining, by the messaging application, context based on the one or more words in the text string; and modifying, by the messaging application, an expression of the avatar based on the determined context.
-
公开(公告)号:US12271586B2
公开(公告)日:2025-04-08
申请号:US18314704
申请日:2023-05-09
Applicant: Snap Inc.
Inventor: Celia Nicole Mourkogiannis
IPC: G06F3/04883 , G06F3/04817 , G06F3/0482 , G06F3/04845 , G06F3/0488 , G06V20/20 , H04L51/046 , H04N5/272 , H04N23/63
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for displaying augmented reality content. The program and method provide for displaying, within a messaging application running on a device, a first user interface for viewing a media content item; receiving user input via the first user interface, the user input corresponding to a predefined touch gesture; and in response to receiving the user input, switching, within the messaging application, from the first user interface to a second user interface in which a camera of the device is activated to capture an image, and displaying, via the second user interface, a resized version of the media content item with the image.
-
公开(公告)号:US12271517B1
公开(公告)日:2025-04-08
申请号:US18478352
申请日:2023-09-29
Applicant: Snap Inc.
Inventor: Thomas Faeulhammer , Matthias Kalkgruber , Thomas Muttenthaler , Tiago Miguel Pereira Torres , Daniel Wolf
Abstract: Bending data is used to facilitate tracking operations of an extended reality (XR) device, such as hand tracking or other object tracking operations. The XR device obtains bending data indicative of bending of the XR device to accommodate a body part of a user wearing the XR device. The XR device determines, based on the bending data, whether to use previously identified biometric data in a tracking operation. A mode of the XR device is selected responsive to determining whether to use the previously identified biometric data. The selected mode is used to initialize the tracking operation. The selected mode may be a first mode in which the previously identified biometric data is used in the tracking operation or a second mode in which the previously identified biometric data is not used in the tracking operation.
-
公开(公告)号:US20250112477A1
公开(公告)日:2025-04-03
申请号:US18978737
申请日:2024-12-12
Applicant: Snap Inc.
Inventor: Yu Jiang Tham , Nicholas Larson , Peter Brook , Russell Douglas Patton , Miran Alhaideri , Zhihao Hong
IPC: H02J7/00 , G02C1/00 , G02C5/14 , G02C11/00 , H01L27/02 , H01R13/62 , H02J7/04 , H02J7/34 , H03K19/0185 , H04B3/54 , H04B3/56
Abstract: Methods and devices for wired charging and communication with a wearable device are described. In one embodiment, a symmetrical contact interface comprises a first contact pad and a second contact pad, and particular wired circuitry is coupled to the first and second contact pads to enable charging as well as receive and transmit communications via the contact pads as part of various device states.
-
公开(公告)号:US20250110573A1
公开(公告)日:2025-04-03
申请号:US18978713
申请日:2024-12-12
Applicant: Snap Inc.
Inventor: Alex Feinman , Ashwani Arya
Abstract: A method for a low-power hand-tracking system is described. In one aspect, a method includes polling a proximity sensor of a wearable device to detect a proximity event, the wearable device includes a low-power processor and a high-power processor, in response to detecting the proximity event, operating a low-power hand-tracking application on the low-power processor based on proximity data from the proximity sensor, and ending an operation of the low-power hand-tracking application in response to at least one of: detecting and recognizing a gesture based on the proximity data, detecting without recognizing the gesture based on the proximity data, or detecting a lack of activity from the proximity sensor within a timeout period based on the proximity data.
-
公开(公告)号:US12267585B2
公开(公告)日:2025-04-01
申请号:US17485761
申请日:2021-09-27
Applicant: Snap Inc.
Inventor: Bo Ding , Chintan Doshi , Alexander Kane , Anton Kondratenko , Gerald Nilles , John James Robertson , Dmitry Ryuma , Matthias Kalkgruber
Abstract: An eyewear device having an image processor operable in a camera pipeline for computer vision (CV) and in augmented reality (AR) systems. The image processor is configured to selectively control a plurality of cameras to provide images having a first resolution in the high power AR mode, and to provide the images having a second resolution in the low power CV mode. The first resolution is higher than the second resolution, and the plurality of cameras consume less power in the CV mode than the AR mode. The image processor controls the camera pipeline to process the first resolution high IQ images from the plurality of cameras to operate in the AR mode, and controls the camera pipeline to process the second resolution lower IQ images from the plurality of cameras to operate in the CV mode. Substantial power is saved by reducing the resolution of the images using downscaling in the cameras themselves in the CV mode.
-
公开(公告)号:US12265222B2
公开(公告)日:2025-04-01
申请号:US18368288
申请日:2023-09-14
Applicant: Snap Inc.
Inventor: Olha Borys , Georg Halmetschlager-Funek , Matthias Kalkgruber , Daniel Wolf , Jakob Zillner
IPC: G02B27/01 , G06F1/16 , G06F1/3206 , G06T7/00 , G06T7/50
Abstract: Visual-inertial tracking of an eyewear device using sensors. The eyewear device monitors the sensors of a visual inertial odometry system (VIOS) that provide input for determining a position of the device within its environment. The eyewear device determines the status of the VIOS based information from the sensors and adjusts the plurality of sensors (e.g., by turning on/off sensors, changing the sampling rate, of a combination thereof) based on the determined status. The eyewear device then determines the position of the eyewear device within the environment using the adjusted plurality of sensors.
-
公开(公告)号:US20250104248A1
公开(公告)日:2025-03-27
申请号:US18977691
申请日:2024-12-11
Applicant: Snap Inc.
Inventor: Gal Dudovitch , Peleg Harel , Chia-Hao Hsieh , Sergei Korolev , Ma'ayan Mishin Shuvi
Abstract: Methods and systems are disclosed for performing operations comprising: receiving a monocular image that includes a depiction of a whole body of a user; generating a segmentation of the whole body of the user based on the monocular image; accessing a video feed comprising a plurality of monocular images received prior to the monocular image; smoothing, using the video feed, the segmentation of the whole body generated based on the monocular image to provide a smoothed segmentation; and applying one or more visual effects to the monocular image based on the smoothed segmentation.
-
公开(公告)号:US12260588B2
公开(公告)日:2025-03-25
申请号:US18373554
申请日:2023-09-27
Applicant: Snap Inc.
Inventor: Sagi Katz , Matthias Kalkgruber
IPC: G06T7/33 , G06T7/593 , G06T7/73 , G06T19/00 , H04N13/239
Abstract: A method for correcting a bending of a flexible device is described. In one aspect, the method includes accessing feature data of a first stereo frame that is generated by stereo optical sensors of the flexible device, the feature data generated based on a visual-inertial odometry (VIO) system of the flexible device, accessing depth map data of the first stereo frame, the depth map data generated based on a depth map system of the flexible device, estimating a pitch-roll bias and a yaw bias based on the features data and the depth map data of the first stereo frame, and generating a second stereo frame after the first stereo frame, the second stereo frame based on the pitch-roll bias and the yaw bias of the first stereo frame.
-
公开(公告)号:US12260567B2
公开(公告)日:2025-03-25
申请号:US17973167
申请日:2022-10-25
Applicant: Snap Inc.
Inventor: Branislav Micusik , Georgios Evangelidis , Daniel Wolf
Abstract: A method for carving a 3D space using hands tracking is described. In one aspect, a method includes accessing a first frame from a camera of a display device, tracking, using a hand tracking algorithm operating at the display device, hand pixels corresponding to one or more user hands depicted in the first frame, detecting, using a sensor of the display device, depths of the hand pixels, identifying a 3D region based on the depths of the hand pixels, and applying a 3D reconstruction engine to the 3D region.
-
-
-
-
-
-
-
-
-