-
公开(公告)号:US12033258B1
公开(公告)日:2024-07-09
申请号:US16894680
申请日:2020-06-05
Applicant: Meta Platforms Technologies, LLC
Inventor: Maheen Sohail , Hyunbin Park , Ruoni Wang , Vincent Charles Cheung
CPC classification number: G06T13/205 , G06F3/011 , G06F3/017 , G06Q50/01 , G10L15/183 , G10L15/26 , G10L21/10 , H04M11/10
Abstract: A conversation augmentation system can automatically augment a conversation with content items based on natural language from the conversation. The conversation augmentation system can select content items to add to the conversation based on determined user “intents” generated using machine learning models. The conversation augmentation system can generate intents for natural language from various sources, such as video chats, audio conversations, textual conversations, virtual reality environments, etc. The conversation augmentation system can identify constraints for mapping the intents to content items or context signals for selecting appropriate content items. In various implementations, the conversation augmentation system can add selected content items to a storyline the conversation describes or can augment a platform in which an unstructured conversation is occurring.
-
公开(公告)号:US11836179B1
公开(公告)日:2023-12-05
申请号:US16667494
申请日:2019-10-29
Applicant: Meta Platforms Technologies, LLC
Inventor: Vincent Charles Cheung , Tali Zvi , Kent Austin White , Kevin Lin
IPC: G06F7/00 , G06F16/432 , G06F16/41 , G06F16/487 , G06N3/08 , G06F16/48 , G06F16/483
CPC classification number: G06F16/432 , G06F16/41 , G06F16/483 , G06F16/487 , G06F16/489 , G06N3/08
Abstract: A multimedia query system is described that includes a multimedia capture system configured to capture raw multimedia data comprising at least one of raw video data or raw audio data, a metadata engine configured to extract one or more anchor points of metadata from the raw multimedia data and to store the one or more anchor points of metadata, wherein the anchor points of metadata includes references to respective portions of the raw multimedia data. The multimedia query system further includes a storage engine configured to store the raw multimedia data, a recall engine configured to receive a query and to apply the query to the one or more anchor points of metadata to identify one or more raw multimedia data candidates from the portions of the raw multimedia data, and a query engine configured to generate a response to the query based on the one or more raw multimedia data candidates.
-
公开(公告)号:US11948594B2
公开(公告)日:2024-04-02
申请号:US18048246
申请日:2022-10-20
Applicant: Meta Platforms Technologies, LLC
Inventor: Maheen Sohail , Hyunbin Park , Ruoni Wang , Vincent Charles Cheung
Abstract: A conversation augmentation system can automatically augment a conversation with content items based on natural language from the conversation. The conversation augmentation system can select content items to add to the conversation based on determined user “intents” generated using machine learning models. The conversation augmentation system can generate intents for natural language from various sources, such as video chats, audio conversations, textual conversations, virtual reality environments, etc. The conversation augmentation system can identify constraints for mapping the intents to content items or context signals for selecting appropriate content items. In various implementations, the conversation augmentation system can add selected content items to a storyline the conversation describes or can augment a platform in which an unstructured conversation is occurring.
-
公开(公告)号:US11508392B1
公开(公告)日:2022-11-22
申请号:US16894690
申请日:2020-06-05
Applicant: Meta Platforms Technologies, LLC
Inventor: Maheen Sohail , Hyunbin Park , Ruoni Wang , Vincent Charles Cheung
Abstract: A conversation augmentation system can automatically augment a conversation with content items based on natural language from the conversation. The conversation augmentation system can select content items to add to the conversation based on determined user “intents” generated using machine learning models. The conversation augmentation system can generate intents for natural language from various sources, such as video chats, audio conversations, textual conversations, virtual reality environments, etc. The conversation augmentation system can identify constraints for mapping the intents to content items or context signals for selecting appropriate content items. In various implementations, the conversation augmentation system can add selected content items to a storyline the conversation describes or can augment a platform in which an unstructured conversation is occurring.
-
公开(公告)号:US11749285B2
公开(公告)日:2023-09-05
申请号:US17648067
申请日:2022-01-14
Applicant: Meta Platforms Technologies, LLC
Inventor: Vincent Charles Cheung , Chengxuan Bai , Yating Sheng
CPC classification number: G10L17/00 , G06F3/011 , G06T19/006 , G06V40/161 , G10L25/63 , H04R1/406 , H04R3/005
Abstract: This disclosure describes transcribing speech using audio, image, and other data. A system is described that includes an audio capture system configured to capture audio data associated with a plurality of speakers, an image capture system configured to capture images of one or more of the plurality of speakers, and a speech processing engine. The speech processing engine may be configured to recognize a plurality of speech segments in the audio data, identify, for each speech segment of the plurality of speech segments and based on the images, a speaker associated with the speech segment, transcribe each of the plurality of speech segments to produce a transcription of the plurality of speech segments including, for each speech segment in the plurality of speech segments, an indication of the speaker associated with the speech segment, and analyze the transcription to produce additional data derived from the transcription.
-
公开(公告)号:US11743064B2
公开(公告)日:2023-08-29
申请号:US16673803
申请日:2019-11-04
Applicant: Meta Platforms Technologies, LLC
Inventor: Vincent Charles Cheung
CPC classification number: H04L12/1822 , G02B27/017 , G06F3/017 , G06T19/006 , G06V20/10 , G06V40/172
Abstract: This disclosure describes a computing system that automatically detects users in visual proximity and adds the users to a private collaboration space enabling the users to share digital content. In one example, the computing system includes a video processing engine configured to detect, from first image data representative of a first physical environment that includes a second user, the second user, wherein the first image data is captured by an image capture system of a head-mounted display (HMD) worn by a first user. The computing system also includes a collaboration application configured to add, in response to detection of the second user, the second user to a set of users associated with a private collaboration space in which the set of users access shared digital content, wherein the set of users includes the first user.
-
公开(公告)号:US12079884B2
公开(公告)日:2024-09-03
申请号:US17234719
申请日:2021-04-19
Applicant: Meta Platforms Technologies, LLC
Inventor: Hyunbin Park , Chengxuan Bai , Jiemin Zhang , Vincent Charles Cheung , Andrew Pitcher Thompson , Maheen Sohail , Tali Zvi
IPC: G06F16/00 , G06F16/901 , G06F16/9535 , G06Q50/00
CPC classification number: G06Q50/01 , G06F16/9024 , G06F16/9535
Abstract: The present embodiments relate to automated memory creation and retrieval from moment content items. In some implementations, the automated memory creation and retrieval system can obtain moment content items from user-designated sources with a single user perspective or multiple user perspectives. The moment content items can be assigned tags and arranged in chronological order. The arranged moment content items can be clustered into memory content items based on clustering conditions. Once memory content items are created, they can be arranged into a memory hierarchy made up of connected nodes. In some implementations, the memory content items are also linked together based on similarity in various dimensions in a memory graph. The automated memory creation and retrieval system can receive search criteria for memories from a user interface and provide the user with memories from matched nodes in the memory hierarchy or linked memories in the memory graph.
-
-
-
-
-
-