-
公开(公告)号:US11830209B2
公开(公告)日:2023-11-28
申请号:US17651524
申请日:2022-02-17
Applicant: Snap Inc.
Inventor: Travis Chen , Samuel Edward Hare , Yuncheng Li , Tony Mathew , Jonathan Solichin , Jianchao Yang , Ning Zhang
IPC: G06T7/50 , G06T19/20 , G06T7/20 , G06T19/00 , G06T7/73 , G06V10/20 , G06V20/20 , G06V20/40 , G06V10/764 , G06V20/64
CPC classification number: G06T7/50 , G06T7/20 , G06T7/73 , G06T19/006 , G06T19/20 , G06V10/255 , G06V10/764 , G06V20/20 , G06V20/40 , G06V20/64 , G06T2207/10016 , G06T2207/20084 , G06T2210/12 , G06T2219/2016
Abstract: Systems, devices, media, and methods are presented for object detection and inserting graphical elements into an image stream in response to detecting the object. The systems and methods detect an object of interest in received frames of a video stream. The systems and methods identify a bounding box for the object of interest and estimate a three-dimensional position of the object of interest based on a scale of the object of interest. The systems and methods generate one or more graphical elements having a size based on the scale of the object of interest and a position based on the three-dimensional position estimated for the object of interest. The one or more graphical elements are generated within the video stream to form a modified video stream. The systems and methods cause presentation of the modified video stream including the object of interest and the one or more graphical elements.
-
公开(公告)号:US20230368472A1
公开(公告)日:2023-11-16
申请号:US17740598
申请日:2022-05-10
Applicant: Snap Inc.
Inventor: Jonathan Solichin
CPC classification number: G06T19/006 , G06F3/04842 , G06F3/011 , G10L15/22 , G10L15/08 , G06F3/167 , G10L2015/088
Abstract: Systems and methods describe an augmented reality (AR) system for generating AR experiences in real-time. The AR experience system receives a selection of an AR experience from an application running on a computer device, displays a first set of textual cues associated with the AR experience on the computer device, receives a first set of image data corresponding to the first set of textual cues, generates a first AR object associated with the AR experience, displays the first AR object on the computer device and a second set of textual cues associated with the AR experience, receives a second set of image data corresponding to the second set of textual cues, and generates a second AR object associated with the AR experience.
-
公开(公告)号:US11288879B2
公开(公告)日:2022-03-29
申请号:US15929374
申请日:2020-04-29
Applicant: Snap Inc.
Inventor: Travis Chen , Samuel Edward Hare , Yuncheng Li , Tony Mathew , Jonathan Solichin , Jianchao Yang , Ning Zhang
Abstract: Systems, devices, media, and methods are presented for object detection and inserting graphical elements into an image stream in response to detecting the object. The systems and methods detect an object of interest in received frames of a video stream. The systems and methods identify a bounding box for the object of interest and estimate a three-dimensional position of the object of interest based on a scale of the object of interest. The systems and methods generate one or more graphical elements having a size based on the scale of the object of interest and a position based on the three-dimensional position estimated for the object of interest. The one or more graphical elements are generated within the video stream to form a modified video stream. The systems and methods cause presentation of the modified video stream including the object of interest and the one or more graphical elements.
-
公开(公告)号:US20210390311A1
公开(公告)日:2021-12-16
申请号:US17155715
申请日:2021-01-22
Applicant: Snap Inc.
Inventor: Christine Barron , Virginia Drummond , Jean Luo , Alek Matthiessen , Celia Nicole Mourkogiannis , Jonathan Solichin , Olesia Voronova
IPC: G06K9/00 , G06F16/732 , G06Q30/06 , G06K7/10 , G06T19/00
Abstract: Systems, methods, and computer-readable media for adding beauty products to tutorials are presented. Methods include accessing video data comprising images of a presenter creating a tutorial, the tutorial depicting the presenter applying a beauty product to a body part of the presenter. Methods further include processing the video data to identify changes to the body part of the presenter from an application of the beauty product, and responding to identifying changes to the body part of the presenter from the application of the beauty product by processing the video data to identify the beauty product. Methods further include retrieving information regarding the beauty product and causing presentation of information regarding the beauty product on a display device.
-
公开(公告)号:US12165244B2
公开(公告)日:2024-12-10
申请号:US17974400
申请日:2022-10-26
Applicant: Snap Inc.
Inventor: Olha Rykhliuk , Jonathan Solichin , Aleksei Stoliar
Abstract: Systems and methods herein describe receiving an image via an image capture device, using a machine learning model, generating an image augmentation decision, accessing an augmented reality content item, associating the generated image augmentation decision with the augmented reality content item, modifying the received image using the augmented reality content item and the associated image augmentation decision, and causing presentation of the modified image on a graphical user interface of a computing device.
-
公开(公告)号:US20240331379A1
公开(公告)日:2024-10-03
申请号:US18741962
申请日:2024-06-13
Applicant: Snap Inc.
Inventor: Christine Barron , Virginia Drummond , Jean Luo , Alek Matthiessen , Celia Nicole Mourkogiannis , Jonathan Solichin , Olesia Voronova
IPC: G06V20/40 , A61Q1/00 , G06F16/732 , G06K7/10 , G06Q30/0601 , G06T19/00
CPC classification number: G06V20/41 , G06F16/7335 , G06K7/10118 , G06Q30/0627 , G06T19/006 , G06V20/46 , A61Q1/00
Abstract: Systems, methods, and computer-readable media for adding beauty products to tutorials are presented. Methods include accessing video data comprising images of a presenter creating a tutorial, the tutorial depicting the presenter applying a beauty product to a body part of the presenter. Methods further include processing the video data to identify changes to the body part of the presenter from an application of the beauty product, and responding to identifying changes to the body part of the presenter from the application of the beauty product by processing the video data to identify the beauty product. Methods further include retrieving information regarding the beauty product and causing presentation of information regarding the beauty product on a display device.
-
公开(公告)号:US20240331333A1
公开(公告)日:2024-10-03
申请号:US18740713
申请日:2024-06-12
Applicant: Snap Inc.
Inventor: Christine Barron , Virginia Drummond , Jean Luo , Alek Matthiessen , Celia Nicole Mourkogiannis , Jonathan Solichin , Olesia Voronova
CPC classification number: G06T19/20 , G06T7/20 , G06T7/90 , G06T19/006 , G06T2207/30201 , G06T2219/2012 , G06T2219/2016
Abstract: Systems, methods, and computer readable media for augmented reality beauty product tutorials. Methods disclose determining from live images of an augmented reality (AR) tutorial effects, the effects indicating changes to the live images of a presenter of the AR tutorial from a beauty product being applied to a body part of the presenter. The methods further comprising determining from the live images motion, the motion indicating motion of the beauty product from the beauty product being applied to the body part of the presenter and storing the effects and the motion.
-
公开(公告)号:US11832015B2
公开(公告)日:2023-11-28
申请号:US17445043
申请日:2021-08-13
Applicant: Snap Inc.
Inventor: Amir Alavi , Olha Rykhliuk , Xintong Shi , Jonathan Solichin , Olesia Voronova , Artem Yagodin
CPC classification number: H04N5/2621 , G06F3/017 , G06T7/251 , G06T11/00 , G06V40/28 , H04N23/611 , H04N23/631 , G06T2207/10016 , G06T2207/30196
Abstract: Systems and methods herein describe a method for capturing a video in real-time by an image capture device. The system provides a plurality of visual pose hints, identifies first pose information in the video while capturing the video, applies a first series of virtual effects to the video, identifies second pose information, and applies a second series of virtual effects to the video, the second series of virtual effects based on the first series of virtual effects.
-
公开(公告)号:US20230050788A1
公开(公告)日:2023-02-16
申请号:US17820661
申请日:2022-08-18
Applicant: Snap Inc.
Inventor: Christine Barron , Virginia Drummond , Jean Luo , Alek Matthiessen , Celia Nicole Mourkogiannis , Jonathan Solichin , Olesia Voronova
IPC: G06V20/40 , G06F16/732 , G06K7/10 , G06T19/00 , G06Q30/06
Abstract: Systems, methods, and computer-readable media for adding beauty products to tutorials are presented. Methods include accessing video data comprising images of a presenter creating a tutorial, the tutorial depicting the presenter applying a beauty product to a body part of the presenter. Methods further include processing the video data to identify changes to the body part of the presenter from an application of the beauty product, and responding to identifying changes to the body part of the presenter from the application of the beauty product by processing the video data to identify the beauty product. Methods further include retrieving information regarding the beauty product and causing presentation of information regarding the beauty product on a display device.
-
公开(公告)号:US11423652B2
公开(公告)日:2022-08-23
申请号:US17155715
申请日:2021-01-22
Applicant: Snap Inc.
Inventor: Christine Barron , Virginia Drummond , Jean Luo , Alek Matthiessen , Celia Nicole Mourkogiannis , Jonathan Solichin , Olesia Voronova
Abstract: Systems, methods, and computer-readable media for adding beauty products to tutorials are presented. Methods include accessing video data comprising images of a presenter creating a tutorial, the tutorial depicting the presenter applying a beauty product to a body part of the presenter. Methods further include processing the video data to identify changes to the body part of the presenter from an application of the beauty product, and responding to identifying changes to the body part of the presenter from the application of the beauty product by processing the video data to identify the beauty product. Methods further include retrieving information regarding the beauty product and causing presentation of information regarding the beauty product on a display device.
-
-
-
-
-
-
-
-
-