公开(公告)号：US11348328B2

公开(公告)日：2022-05-31

申请号：US17249499

申请日：2021-03-03

Applicant: Snap Inc.

Inventor： Meng Song ,  Harsh Agrawal ,  Xiaoyu Wang ,  Xuan Huang ,  William Brendel

IPC: G06V10/20 ,  G06K9/62 ,  G06N20/00 ,  G06V10/26 ,  G06V10/75

Abstract: Systems, devices, media, and methods are presented for graphical icon identification within an image or video stream. The systems and methods receive an image including a graphical icon. The systems and methods identify a set of proposed regions of the image, at least one proposed region of the set of proposed regions containing the graphical icon and extract a set of semantic features for each proposed region of the set of proposed regions. Based on the set of semantic features of the set of proposed regions, the systems and methods identify a set of proposed icons corresponding to the graphical icon included in the image and determine a match between the graphical icon and at least one proposed icon of the set of proposed icons.

公开(公告)号：US20240372963A1

公开(公告)日：2024-11-07

申请号：US18772971

申请日：2024-07-15

Applicant: Snap inc.

Inventor： Lidiia Bogdanovych ,  William Brendel ,  Samuel Edward Hare ,  Fedir Paliakov ,  Guohui Wang ,  Xuehan Xiong ,  Jianchao Yang ,  Linjie Yang

IPC: H04N7/14 ,  G06F18/214 ,  G06F18/24 ,  G06N3/04 ,  G06N3/08 ,  G06T7/11 ,  G06T7/194 ,  G06V10/82 ,  G06V30/19 ,  G06V30/242 ,  H04N5/445 ,  H04N5/76

Abstract: A machine learning system can generate an image mask (e.g., a pixel mask) comprising pixel assignments for pixels. The pixels can be assigned to classes, including, for example, face, clothes, body skin, or hair. The machine learning system can be implemented using a convolutional neural network that is configured to execute efficiently on computing devices having limited resources, such as mobile phones. The pixel mask can be used to more accurately display video effects interacting with a user or subject depicted in the image.

公开(公告)号：US20240045899A1

公开(公告)日：2024-02-08

申请号：US18489720

申请日：2023-10-18

Applicant: Snap Inc.

Inventor： Luis Carlos Dos Santos Marujo ,  William Brendel

IPC: G06F16/48 ,  G06F16/432 ,  G06F16/9535 ,  G06F16/532

CPC classification number: G06F16/48 ,  G06F16/434 ,  G06F16/9535 ,  G06F16/532 ,  G06Q50/01

Abstract: Example embodiments described herein relate to an icon based tagging system to associate a graphical icon (e.g., an emoji) with a data category, receive media content that includes a data object and the graphical icon, assign the media content to the data category based on the presence of the graphical icon within the media content, receive a search request that comprises search criteria that includes at least the graphical icon, and present a set of search results that include the media content in response to the search request.

公开(公告)号：US11551042B1

公开(公告)日：2023-01-10

申请号：US16552393

申请日：2019-08-27

Applicant: Snap Inc.

Inventor： Jianfei Yu ,  Luis Carlos Dos Santos Marujo ,  Venkata Satya Pradeep Karuturi ,  Leonardo Ribas Machado das Neves ,  Ning Xu ,  William Brendel

IPC: G06F40/30 ,  G06K9/62 ,  G06N3/08 ,  G06N20/20 ,  G06N3/04 ,  G06F40/284 ,  G10L25/30 ,  G06F40/295 ,  G06F40/279 ,  G06F40/289 ,  G10L15/18 ,  G10L15/16

Abstract: Sentiment classification can be implemented by an entity-level multimodal sentiment classification neural network. The neural network can include left, right, and target entity subnetworks. The neural network can further include an image network that generates representation data that is combined and weighted with data output by the left, right, and target entity subnetworks to output a sentiment classification for an entity included in a network post.

公开(公告)号：US20220262092A1

公开(公告)日：2022-08-18

申请号：US17661868

申请日：2022-05-03

Applicant: Snap Inc.

Inventor： Meng Song ,  Harsh Agrawal ,  Xiaoyu Wang ,  Xuan Huang ,  William Brendel

IPC: G06V10/20 ,  G06K9/62 ,  G06N20/00 ,  G06V10/26

Abstract: Systems, devices, media, and methods are presented for graphical icon identification within an image or video stream. The systems and methods receive an image including a graphical icon. The systems and methods identify a set of proposed regions of the image, at least one proposed region of the set of proposed regions containing the graphical icon and extract a set of semantic features for each proposed region of the set of proposed regions. Based on the set of semantic features of the set of proposed regions, the systems and methods identify a set of proposed icons corresponding to the graphical icon included in the image and determine a match between the graphical icon and at least one proposed icon of the set of proposed icons.

公开(公告)号：US11157694B2

公开(公告)日：2021-10-26

申请号：US16103626

申请日：2018-08-14

Applicant: Snap Inc.

Inventor： Mariya Apanovych ,  William Brendel ,  Oleksandr Grytsiuk ,  Yurii Husiev ,  Luis Carlos Dos Santos Marujo ,  Jeremy Voss

IPC: G06F16/00 ,  G06F40/274 ,  H04L12/58 ,  G06F16/34 ,  G06F16/41 ,  G06F16/33

Abstract: Embodiments of the present disclosure relate generally to systems for presenting content suggestions within a messaging interface. A content suggestion system performs operations that include: receiving inputs that include a text string into a messaging interface; parsing a keyword from the text string of the input in response to receiving the inputs; retrieving message content that includes at least a media item based on the keyword; and presenting a chat suggestion that includes the message content within the messaging interface, according to certain example embodiments.

公开(公告)号：US10776663B1

公开(公告)日：2020-09-15

申请号：US16521956

申请日：2019-07-25

Applicant: Snap Inc.

Inventor： Lidiia Bogdanovych ,  William Brendel ,  Samuel Edward Hare ,  Fedir Poliakov ,  Guohui Wang ,  Xuehan Xiong ,  Jianchao Yang ,  Linjie Yang

IPC: G06K9/62 ,  G06T7/11 ,  G06T7/194 ,  G06N3/08 ,  G06N3/04 ,  G06K9/68 ,  G06K9/74 ,  H04N5/76 ,  H04N5/445 ,  H04N7/14

Abstract: A machine learning system can generate an image mask (e.g., a pixel mask) comprising pixel assignments for pixels. The pixels can be assigned to classes, including, for example, face, clothes, body skin, or hair. The machine learning system can be implemented using a convolutional neural network that is configured to execute efficiently on computing devices having limited resources, such as mobile phones. The pixel mask can be used to more accurately display video effects interacting with a user or subject depicted in the image.

公开(公告)号：US11853399B2

公开(公告)日：2023-12-26

申请号：US18059928

申请日：2022-11-29

Applicant: Snap Inc.

Inventor： Jianfei Yu ,  Luis Carlos Dos Santos Marujo ,  Venkata Satya Pradeep Karuturi ,  Leonardo Ribas Machado das Neves ,  Ning Xu ,  William Brendel

IPC: G06F40/30 ,  G06F18/2431 ,  G06N3/08 ,  G06N20/20 ,  G06F40/284 ,  G06N3/045 ,  G10L25/30 ,  G06F40/295 ,  G06F40/279 ,  G06F40/289 ,  G10L15/18 ,  G10L15/06

CPC classification number: G06F18/2431 ,  G06F40/284 ,  G06F40/30 ,  G06N3/045 ,  G06N3/08 ,  G06N20/20 ,  G06F40/279 ,  G06F40/289 ,  G06F40/295 ,  G10L15/06 ,  G10L15/1807 ,  G10L15/1815 ,  G10L15/1822 ,  G10L25/30

Abstract: Sentiment classification can be implemented by an entity-level multimodal sentiment classification neural network. The neural network can include left, right, and target entity subnetworks. The neural network can further include an image network that generates representation data that is combined and weighted with data output by the left, right, and target entity subnetworks to output a sentiment classification for an entity included in a network post.

公开(公告)号：US11743426B2

公开(公告)日：2023-08-29

申请号：US16992968

申请日：2020-08-13

Applicant: Snap Inc.

Inventor： Lidiia Bogdanovych ,  William Brendel ,  Samuel Edward Hare ,  Fedir Poliakov ,  Guohui Wang ,  Xuehan Xiong ,  Jianchao Yang ,  Linjie Yang

IPC: G06T7/194 ,  G06V10/82 ,  H04N7/14 ,  G06T7/11 ,  G06N3/08 ,  G06N3/04 ,  G06V30/242 ,  G06F18/214 ,  G06F18/24 ,  G06V30/19 ,  H04N5/445 ,  H04N5/76

CPC classification number: H04N7/147 ,  G06F18/214 ,  G06F18/24765 ,  G06N3/04 ,  G06N3/08 ,  G06T7/11 ,  G06T7/194 ,  G06V10/82 ,  G06V30/19173 ,  G06V30/242 ,  G06T2207/10016 ,  G06T2207/10024 ,  G06T2207/20024 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/20221 ,  G06T2207/30201 ,  H04N5/44504 ,  H04N5/76 ,  H04N7/141

Abstract: A machine learning system can generate an image mask (e.g., a pixel mask) comprising pixel assignments for pixels. The pixels can he assigned to classes, including, for example, face, clothes, body skin, or hair. The machine learning system can be implemented. using a convolutional neural network that is configured to execute efficiently on computing devices having limited resources, such as mobile phones. The pixel mask can be used to more accurately display video effects interacting with a user or subject depicted in the image.

公开(公告)号：US20220374465A1

公开(公告)日：2022-11-24

申请号：US17876997

申请日：2022-07-29

Applicant: Snap Inc.

Inventor： Luis Carlos Dos Santos Marujo ,  William Brendel

IPC: G06F16/48 ,  G06F16/532 ,  G06F16/9535 ,  G06F16/432

Abstract: Example embodiments described herein relate to an icon based tagging system to associate a graphical icon (e.g., an emoji) with a data category, receive media content that includes a data object and the graphical icon, assign the media content to the data category based on the presence of the graphical icon within the media content, receive a search request that comprises search criteria that includes at least the graphical icon, and present a set of search results that include the media content in response to the search request.