-
公开(公告)号:US20220101608A1
公开(公告)日:2022-03-31
申请号:US16949077
申请日:2020-10-13
Applicant: Snap Inc.
Inventor: Hao Hu , Kevin Sarabia Dela Rosa , Bogdan Maksymchuk , Volodymyr Piven , Ekaterina Simbereva
Abstract: Aspects of the present disclosure involve a system and a method for performing operations comprising: capturing, by a client device implementing a messaging application, an image; receiving, from a server, an identification of an augmented reality experience associated with the image, the server identifying the augmented reality experience by assigning visual words to features of the image and searching a visual search database to identify a plurality of marker images, and the server retrieving the augmented reality experience associated with a given one of the plurality of marker images; automatically, in response to capturing the image, displaying one or more graphical elements of the identified augmented reality experience; and receiving input from the user interacting with the one or more graphical elements.
-
公开(公告)号:US20220101011A1
公开(公告)日:2022-03-31
申请号:US17378259
申请日:2021-07-16
Applicant: Snap Inc.
Inventor: Kevin Sarabia Dela Rosa , Hao Hu , Annie Huang
Abstract: Aspects of the present disclosure involve a system and a method for performing operations comprising: identifying a plurality of features for frames of a video received by a messaging application server; assigning a first sequence of a first subset of the plurality of features and a second sequence of a second subset of the plurality of features respectively to a first nearest visual codebook cluster and a second nearest visual codebook cluster; applying the first and second nearest visual codebook clusters to a visual search database to identify a plurality of candidate matching videos; selecting a given matching video from the plurality of candidate matching videos based on a rank representing similarity of the given matching video to the video received by the messaging application server; and accessing an augmented reality experience corresponding to the given matching video.
-
公开(公告)号:US20240428470A1
公开(公告)日:2024-12-26
申请号:US18338980
申请日:2023-06-21
Applicant: Snap Inc.
Inventor: Kevin Sarabia Dela Rosa , Hao Hu , Yanjia Li
IPC: G06T11/00 , G06F3/0482 , G06T7/60 , G06V10/74 , G06V10/77 , G06V10/776 , G06V20/20
Abstract: Described is a system for identifying content augmentations based on an interaction function initiated by a user by determining an initiation of an interaction function from a first user of an interaction system, processing data associated with the interaction function using a first machine learning model to generate a feature vector, and identifying at least one recommended content augmentation based on a comparison of the feature vector for the interaction function to a feature vector for the at least one recommended content augmentation. The system then displays the at least one recommended content augmentation to the first user with a corresponding selectable user interface element for individual recommended content augmentations.
-
公开(公告)号:US12080065B2
公开(公告)日:2024-09-03
申请号:US18071780
申请日:2022-11-30
Applicant: Snap Inc.
Inventor: Kaveh Anvaripour , Nathan Kenneth Boyd , Hao Hu , Celia Nicole Mourkogiannis , Kevin Dechau Tang
CPC classification number: G06V20/20 , G06F18/24 , G06T11/00 , G06V40/10 , H04L51/04 , H04N23/631 , H04N23/633 , G06F3/0482 , G06T2200/24
Abstract: Systems and methods are provided for performing operations including: receiving, via a messaging application, a request to scan an image captured by a camera of the user device; determining an attribute of an object depicted in the image; identifying, from a plurality of augmented reality items, an augmented reality item that is associated with the attribute of the object; combining the identified augmented reality item with the image captured by the camera; and displaying, via the messaging application, the image captured by the camera combined with the identified augmented reality item.
-
公开(公告)号:US11823456B2
公开(公告)日:2023-11-21
申请号:US17378259
申请日:2021-07-16
Applicant: Snap Inc.
Inventor: Kevin Sarabia Dela Rosa , Hao Hu , Annie Huang
CPC classification number: G06V20/48 , G06F18/214 , G06F18/22 , G06T19/006 , G06V10/758 , G06V20/46 , H04L51/10 , G06V10/462
Abstract: Aspects of the present disclosure involve a system and a method for performing operations comprising: identifying a plurality of features for frames of a video received by a messaging application server; assigning a first sequence of a first subset of the plurality of features and a second sequence of a second subset of the plurality of features respectively to a first nearest visual codebook cluster and a second nearest visual codebook cluster; applying the first and second nearest visual codebook clusters to a visual search database to identify a plurality of candidate matching videos; selecting a given matching video from the plurality of candidate matching videos based on a rank representing similarity of the given matching video to the video received by the messaging application server; and accessing an augmented reality experience corresponding to the given matching video.
-
公开(公告)号:US11620829B2
公开(公告)日:2023-04-04
申请号:US16949074
申请日:2020-10-13
Applicant: Snap Inc.
Inventor: Hao Hu , Kevin Sarabia Dela Rosa
Abstract: Aspects of the present disclosure involve a system and a method for performing operations comprising: identifying a plurality of features for an image received by a messaging application server; assigning a first of the plurality of features and a second of the plurality of features respectively to a first nearest visual codebook cluster and a second nearest visual codebook cluster; applying the first and second nearest visual codebook clusters to a visual search database to identify a plurality of candidate matching images; selecting a given matching image based on a geometric verification of the plurality of matching images and the received image; and accessing an augmented reality experience corresponding to the given matching image.
-
公开(公告)号:US20230091214A1
公开(公告)日:2023-03-23
申请号:US18071780
申请日:2022-11-30
Applicant: Snap Inc.
Inventor: Kaveh Anvaripour , Nathan Kenneth Boyd , Hao Hu , Celia Nicole Mourkogiannis , Kevin Dechau Tang
Abstract: Systems and methods are provided for performing operations including: receiving, via a messaging application, a request to scan an image captured by a camera of the user device; determining an attribute of an object depicted in the image; identifying, from a plurality of augmented reality items, an augmented reality item that is associated with the attribute of the object; combining the identified augmented reality item with the image captured by the camera; and displaying, via the messaging application, the image captured by the camera combined with the identified augmented reality item.
-
公开(公告)号:US11017233B2
公开(公告)日:2021-05-25
申请号:US16814221
申请日:2020-03-10
Applicant: Snap Inc.
Inventor: Ebony James Charlton , Hao Hu , Yanjia Li , Xing Mei , Kevin Dechau Tang
IPC: G06K9/00 , G06T11/00 , G06F3/0488 , G06F16/51 , G06F16/538 , G06T7/60
Abstract: Method for receiving an input onto a graphical user interface at a client device, capturing an image frame at the client device, the image frame comprising a depiction of an object, identifying the object within the image frame, accessing media content associated with the object within a media repository in response to identifying the object, and causing presentation of the media content within the image frame at the client device.
-
公开(公告)号:US11341728B2
公开(公告)日:2022-05-24
申请号:US16949079
申请日:2020-10-13
Applicant: Snap Inc.
Inventor: Hao Hu , Kevin Sarabia Dela Rosa , Bogdan Maksymchuk , Volodymyr Piven , Ekaterina Simbereva
Abstract: Aspects of the present disclosure involve a system and a method for performing operations comprising: capturing an image that depicts currency, receiving an identification of an augmented reality experience associated with the image, the server identifying the augmented reality experience by assigning visual words to features of the image and searching a visual search database to identify a plurality of marker images associated with one or more charities, and the server retrieving the augmented reality experience associated with a given one of the plurality of marker images; automatically, in response to capturing the image that depicts currency, displaying one or more graphical elements of the identified augmented reality experience that represent a charity of the one or more charities; and receiving a donation to the charity from a user of the client device in response to an interaction with the one or more graphical elements that represent the charity.
-
公开(公告)号:US20200311426A1
公开(公告)日:2020-10-01
申请号:US16814221
申请日:2020-03-10
Applicant: Snap Inc.
Inventor: Ebony James Charlton , Hao Hu , Yanjia Li , Xing Mei , Kevin Dechau Tang
IPC: G06K9/00 , G06T11/00 , G06F3/0488 , G06T7/60 , G06F16/51 , G06F16/538
Abstract: Method for receiving an input onto a graphical user interface at a client device, capturing an image frame at the client device, the image frame comprising a depiction of an object, identifying the object within the image frame, accessing media content associated with the object within a media repository in response to identifying the object, and causing presentation of the media content within the image frame at the client device.
-
-
-
-
-
-
-
-
-