Combining first user interface content into second user interface

    公开(公告)号:US12271586B2

    公开(公告)日:2025-04-08

    申请号:US18314704

    申请日:2023-05-09

    Applicant: Snap Inc.

    Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for displaying augmented reality content. The program and method provide for displaying, within a messaging application running on a device, a first user interface for viewing a media content item; receiving user input via the first user interface, the user input corresponding to a predefined touch gesture; and in response to receiving the user input, switching, within the messaging application, from the first user interface to a second user interface in which a camera of the device is activated to capture an image, and displaying, via the second user interface, a resized version of the media content item with the image.

    Bending-assisted calibration for extended reality tracking

    公开(公告)号:US12271517B1

    公开(公告)日:2025-04-08

    申请号:US18478352

    申请日:2023-09-29

    Applicant: Snap Inc.

    Abstract: Bending data is used to facilitate tracking operations of an extended reality (XR) device, such as hand tracking or other object tracking operations. The XR device obtains bending data indicative of bending of the XR device to accommodate a body part of a user wearing the XR device. The XR device determines, based on the bending data, whether to use previously identified biometric data in a tracking operation. A mode of the XR device is selected responsive to determining whether to use the previously identified biometric data. The selected mode is used to initialize the tracking operation. The selected mode may be a first mode in which the previously identified biometric data is used in the tracking operation or a second mode in which the previously identified biometric data is not used in the tracking operation.

    LOW-POWER HAND-TRACKING SYSTEM FOR WEARABLE DEVICE

    公开(公告)号:US20250110573A1

    公开(公告)日:2025-04-03

    申请号:US18978713

    申请日:2024-12-12

    Applicant: Snap Inc.

    Abstract: A method for a low-power hand-tracking system is described. In one aspect, a method includes polling a proximity sensor of a wearable device to detect a proximity event, the wearable device includes a low-power processor and a high-power processor, in response to detecting the proximity event, operating a low-power hand-tracking application on the low-power processor based on proximity data from the proximity sensor, and ending an operation of the low-power hand-tracking application in response to at least one of: detecting and recognizing a gesture based on the proximity data, detecting without recognizing the gesture based on the proximity data, or detecting a lack of activity from the proximity sensor within a timeout period based on the proximity data.

    Ultra low power camera pipeline for CV in AR systems

    公开(公告)号:US12267585B2

    公开(公告)日:2025-04-01

    申请号:US17485761

    申请日:2021-09-27

    Applicant: Snap Inc.

    Abstract: An eyewear device having an image processor operable in a camera pipeline for computer vision (CV) and in augmented reality (AR) systems. The image processor is configured to selectively control a plurality of cameras to provide images having a first resolution in the high power AR mode, and to provide the images having a second resolution in the low power CV mode. The first resolution is higher than the second resolution, and the plurality of cameras consume less power in the CV mode than the AR mode. The image processor controls the camera pipeline to process the first resolution high IQ images from the plurality of cameras to operate in the AR mode, and controls the camera pipeline to process the second resolution lower IQ images from the plurality of cameras to operate in the CV mode. Substantial power is saved by reducing the resolution of the images using downscaling in the cameras themselves in the CV mode.

    WHOLE BODY SEGMENTATION
    28.
    发明申请

    公开(公告)号:US20250104248A1

    公开(公告)日:2025-03-27

    申请号:US18977691

    申请日:2024-12-11

    Applicant: Snap Inc.

    Abstract: Methods and systems are disclosed for performing operations comprising: receiving a monocular image that includes a depiction of a whole body of a user; generating a segmentation of the whole body of the user based on the monocular image; accessing a video feed comprising a plurality of monocular images received prior to the monocular image; smoothing, using the video feed, the segmentation of the whole body generated based on the monocular image to provide a smoothed segmentation; and applying one or more visual effects to the monocular image based on the smoothed segmentation.

    Depth-from-stereo bending correction using visual inertial odometry features

    公开(公告)号:US12260588B2

    公开(公告)日:2025-03-25

    申请号:US18373554

    申请日:2023-09-27

    Applicant: Snap Inc.

    Abstract: A method for correcting a bending of a flexible device is described. In one aspect, the method includes accessing feature data of a first stereo frame that is generated by stereo optical sensors of the flexible device, the feature data generated based on a visual-inertial odometry (VIO) system of the flexible device, accessing depth map data of the first stereo frame, the depth map data generated based on a depth map system of the flexible device, estimating a pitch-roll bias and a yaw bias based on the features data and the depth map data of the first stereo frame, and generating a second stereo frame after the first stereo frame, the second stereo frame based on the pitch-roll bias and the yaw bias of the first stereo frame.

    3D space carving using hands for object capture

    公开(公告)号:US12260567B2

    公开(公告)日:2025-03-25

    申请号:US17973167

    申请日:2022-10-25

    Applicant: Snap Inc.

    Abstract: A method for carving a 3D space using hands tracking is described. In one aspect, a method includes accessing a first frame from a camera of a display device, tracking, using a hand tracking algorithm operating at the display device, hand pixels corresponding to one or more user hands depicted in the first frame, detecting, using a sensor of the display device, depths of the hand pixels, identifying a 3D region based on the depths of the hand pixels, and applying a 3D reconstruction engine to the 3D region.

Patent Agency Ranking