VARIED DEPTH DETERMINATION USING STEREO VISION AND PHASE DETECTION AUTO FOCUS (PDAF)

    公开(公告)号:US20230239423A1

    公开(公告)日:2023-07-27

    申请号:US18129009

    申请日:2023-03-30

    申请人: Snap Inc.

    IPC分类号: H04N5/222 H04N23/45 H04N23/67

    摘要: Disclosed are systems, methods, and non-transitory computer-readable media for varied depth determination using, stereo vision and phase detection auto focus (PDAF). Computer stereo vision (stereo vision) is used to extract three-dimensional information from digital images. To utilize stereo vison, two optical sensors are displaced horizontally from one another and used to capture images depicting two differing views of a real-world environment from two different vantage points. The relative depth of the objects captured in the images is determined using triangulation by comparing the relative positions of the objects in the two images. For example, the relative positions of matching objects (e.g., features) identified in the captured images are used along with the known orientation of the optical sensors (e.g., distance between the optical sensors, vantage points the optical sensors) to estimate the depth of the objects.

    Input parameter based image waves

    公开(公告)号:US11671572B2

    公开(公告)日:2023-06-06

    申请号:US17526136

    申请日:2021-11-15

    申请人: Snap Inc.

    摘要: A virtual wave creation system comprises an eyewear device that includes a frame, a temple connected to a lateral side of the frame, and a depth-capturing camera. Execution of programming by a processor configures the virtual wave creation system to generate, for each of multiple initial depth images, a respective wave image by applying a transformation function that is responsive to a selected input parameter to the initial three-dimensional coordinates. The virtual wave creation system creates a warped wave video including a sequence of the generated warped wave images. The virtual wave creation system presents, via an image display, the warped wave video.

    Personalized fonts
    5.
    发明授权

    公开(公告)号:US11520970B2

    公开(公告)日:2022-12-06

    申请号:US17000847

    申请日:2020-08-24

    申请人: SNAP INC.

    发明人: Sagi Katz Ilya Levin

    摘要: Methods and system for creating and managing personalized fonts. Personalized fonts are created by applying personalization parameters to a base font using a style application method or module such as a neural style transformation. The personalized fonts may be transferred to recipients of textual communications to enable the recipient to read messages from a sender in the personalized font of the sender.

    AUGMENTED REALITY GUIDED DEPTH ESTIMATION

    公开(公告)号:US20220375110A1

    公开(公告)日:2022-11-24

    申请号:US17529527

    申请日:2021-11-18

    申请人: Snap Inc.

    摘要: A method for AR-guided depth estimation is described. The method includes identifying a virtual object rendered in a first frame that is generated based on a first pose of an augmented reality (AR) device, determining a second pose of the AR device, the second pose following the first pose, identifying an augmentation area in the second frame based on the virtual object rendered in the first frame, and the second pose, determining depth information for the augmentation area in the second frame, and rendering the virtual object in the second frame based on the depth information.

    DEPTH-FROM-STEREO BENDING CORRECTION USING VISUAL INERTIAL ODOMETRY FEATURES

    公开(公告)号:US20220366600A1

    公开(公告)日:2022-11-17

    申请号:US17480405

    申请日:2021-09-21

    申请人: Snap Inc.

    摘要: A method for correcting a bending of a flexible device is described. In one aspect, the method includes accessing feature data of a first stereo frame that is generated by stereo optical sensors of the flexible device, the feature data generated based on a visual-inertial odometry (VIO) system of the flexible device, accessing depth map data of the first stereo frame, the depth map data generated based on a depth map system of the flexible device, estimating a pitch-roll bias and a yaw bias based on the features data and the depth map data of the first stereo frame, and generating a second stereo frame after the first stereo frame, the second stereo frame based on the pitch-roll bias and the yaw bias of the first stereo frame.

    DEPTH-FROM-STEREO BENDING CORRECTION USING VISUAL INERTIAL ODOMETRY FEATURES

    公开(公告)号:US20240029302A1

    公开(公告)日:2024-01-25

    申请号:US18373554

    申请日:2023-09-27

    申请人: Snap Inc.

    摘要: A method for correcting a bending of a flexible device is described. In one aspect, the method includes accessing feature data of a first stereo frame that is generated by stereo optical sensors of the flexible device, the feature data generated based on a visual-inertial odometry (VIO) system of the flexible device, accessing depth map data of the first stereo frame, the depth map data generated based on a depth map system of the flexible device, estimating a pitch-roll bias and a yaw bias based on the features data and the depth map data of the first stereo frame, and generating a second stereo frame after the first stereo frame, the second stereo frame based on the pitch-roll bias and the yaw bias of the first stereo frame.

    ARTISTIC EFFECTS FOR IMAGES AND VIDEOS
    10.
    发明公开

    公开(公告)号:US20230412779A1

    公开(公告)日:2023-12-21

    申请号:US18229535

    申请日:2023-08-02

    申请人: Snap Inc.

    发明人: Sagi Katz

    IPC分类号: H04N9/31 G02B27/01 G06F1/16

    摘要: A photo filter (e.g., artistic) light field effect system comprises an eyewear device that includes a frame, a temple connected to a lateral side of the frame, and a depth-capturing camera. Execution of programming by a processor configures the photo filter light field effect system to apply a photo filter selection to: (i) a left raw image or a left processed image to create a left photo filter image, and (ii) a right raw image or a right processed image to create a right photo filter image. The photo filter light field effect system generates, a photo filter light field effect image with an appearance of a spatial rotation or movement, by blending together the left photo filter image and the right photo filter image based on a left image disparity map and a right image disparity map.