PROVIDING 3D DATA FOR MESSAGES IN A MESSAGING SYSTEM

    公开(公告)号:US20230281930A1

    公开(公告)日:2023-09-07

    申请号:US18144058

    申请日:2023-05-05

    Applicant: Snap Inc.

    Abstract: The subject technology generates depth data using a machine learning model based at least in part on captured image data from at least one camera of a client device. The subject technology applies, to the captured image data and the generated depth data, a 3D effect based at least in part on an augmented reality content generator. The subject technology generates a depth map using at least the depth data. The subject technology generates a packed depth map based at least in part on the depth map, the generating the packed depth map. The subject technology converts a single channel floating point texture to a raw depth map. The subject technology generates multiple channels based at least in part on the raw depth map. The subject technology generates a segmentation mask based at least on the captured image data. The subject technology performs background inpainting and blurring of the captured image data using at least the segmentation mask to generate background inpainted image data.

    AUGMENTED REALITY CONTENT GENERATORS INCLUDING 3D DATA IN A MESSAGING SYSTEM

    公开(公告)号:US20230073310A1

    公开(公告)日:2023-03-09

    申请号:US18056099

    申请日:2022-11-16

    Applicant: Snap Inc.

    Abstract: The subject technology selects a set of augmented reality content generators from available augmented reality content generators, the selected set of augmented reality content generators comprising at least one augmented reality content generator for applying a three-dimensional (3D) effect. The subject technology causes display of a carousel interface including selectable graphical items, each selectable graphical item corresponding to a respective augmented reality content generator. The subject technology receives a selection of a first selectable graphical item from the selectable graphical items, the first selectable graphical item including a first augmented reality content generator for applying a first 3D effect. The subject technology applies, to first image data and first depth data, the first augmented reality content generator corresponding to the selected first selectable graphical item. The subject technology generates a message including the applied first augmented reality content generator to the first image data and the first depth data.

    BEAUTIFICATION TECHNIQUES FOR 3D DATA IN A MESSAGING SYSTEM

    公开(公告)号:US20230005233A1

    公开(公告)日:2023-01-05

    申请号:US17878635

    申请日:2022-08-01

    Applicant: Snap Inc.

    Abstract: The subject technology receives a selection of a selectable graphical item from a plurality of selectable graphical items, the selectable graphical item comprising an augmented reality content generator for applying a 3D effect, the 3D effect including at least one beautification operation. The subject technology captures image data and depth data using a camera. The subject technology applies, to the image data and the depth data, the 3D effect including the at least one beautification operation based at least in part on the augmented reality content generator, the beautification operation being performed as part of applying the 3D effect. The subject technology generates a 3D message based at least in part on the applied 3D effect including the at least one beautification operation. The subject technology renders a view of the 3D message based at least in part on the applied 3D effect including the at least one beautification operation.

    AUGMENTED REALITY CONTENT GENERATORS INCLUDING 3D DATA IN A MESSAGING SYSTEM

    公开(公告)号:US20210319625A1

    公开(公告)日:2021-10-14

    申请号:US17301735

    申请日:2021-04-13

    Applicant: Snap Inc.

    Abstract: The subject technology selects a set of augmented reality content generators from available augmented reality content generators, the selected set of augmented reality content generators comprising at least one augmented reality content generator for applying a three-dimensional (3D) effect. The subject technology causes display of a carousel interface including selectable graphical items, each selectable graphical item corresponding to a respective augmented reality content generator. The subject technology receives a selection of a first selectable graphical item from the selectable graphical items, the first selectable graphical item including a first augmented reality content generator for applying a first 3D effect. The subject technology applies, to first image data and first depth data, the first augmented reality content generator corresponding to the selected first selectable graphical item. The subject technology generates a message including the applied first augmented reality content generator to the first image data and the first depth data.

    3D paint effects in a messaging system

    公开(公告)号:US11107279B1

    公开(公告)日:2021-08-31

    申请号:US16832992

    申请日:2020-03-27

    Applicant: Snap Inc.

    Abstract: Systems and methods are provided for determining a location of a selection in a space viewable in a camera view on a display of a computing device, detecting movement of the computing device, and generating a path based on the location of the selection and the movement of the computing device. The systems and methods further provide for generating a three-dimensional (3D) mesh along the path, populating the 3D mesh with selected options to generate a 3D paint object, and causing the generated 3D paint object to be displayed. The systems and methods further provide for receiving a request to send a message comprising an image or video overlaid by the 3D paint object, capturing the image or video overlaid by the displayed 3D paint object, generating the message comprising the image or video overlaid by the 3D paint object, and sending the message to another computing device.

    DIY EFFECTS IMAGE MODIFICATION
    79.
    发明申请

    公开(公告)号:US20210258511A1

    公开(公告)日:2021-08-19

    申请号:US15929484

    申请日:2020-05-05

    Applicant: Snap Inc.

    Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and method for performing operations comprising: receiving, by a messaging application, an image from a camera of a user device; receiving input that selects a user-customizable effects option for activating a user-customizable effects mode; in response to receiving the input, displaying an array of a plurality of effect options together with the image proximate to the user-customizable effects option; and applying a first effect associated with a first effect option of the plurality of effect options to the image.

    CONTEXT-BASED VIRTUAL OBJECT RENDERING

    公开(公告)号:US20210074074A1

    公开(公告)日:2021-03-11

    申请号:US16747318

    申请日:2020-01-20

    Applicant: Snap Inc.

    Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and a method for rendering a virtual object in a real-world environment depicted in image content based on contextual information. A virtual object template is selected. One or more stylizations for the virtual object template are determined based on contextual information associated with a computing device. A virtual object is generated by applying the one or more stylizations to the virtual object template. The virtual object is rendered within a 3D space captured within a camera feed of the computing device.

Patent Agency Ranking