公开(公告)号：US11749285B2

公开(公告)日：2023-09-05

申请号：US17648067

申请日：2022-01-14

Applicant: Meta Platforms Technologies, LLC

Inventor： Vincent Charles Cheung ,  Chengxuan Bai ,  Yating Sheng

IPC: G10L17/00 ,  G06F3/01 ,  G06T19/00 ,  G10L25/63 ,  H04R1/40 ,  H04R3/00 ,  G06V40/16

CPC classification number: G10L17/00 ,  G06F3/011 ,  G06T19/006 ,  G06V40/161 ,  G10L25/63 ,  H04R1/406 ,  H04R3/005

Abstract: This disclosure describes transcribing speech using audio, image, and other data. A system is described that includes an audio capture system configured to capture audio data associated with a plurality of speakers, an image capture system configured to capture images of one or more of the plurality of speakers, and a speech processing engine. The speech processing engine may be configured to recognize a plurality of speech segments in the audio data, identify, for each speech segment of the plurality of speech segments and based on the images, a speaker associated with the speech segment, transcribe each of the plurality of speech segments to produce a transcription of the plurality of speech segments including, for each speech segment in the plurality of speech segments, an indication of the speaker associated with the speech segment, and analyze the transcription to produce additional data derived from the transcription.

公开(公告)号：US12079884B2

公开(公告)日：2024-09-03

申请号：US17234719

申请日：2021-04-19

Applicant: Meta Platforms Technologies, LLC

Inventor： Hyunbin Park ,  Chengxuan Bai ,  Jiemin Zhang ,  Vincent Charles Cheung ,  Andrew Pitcher Thompson ,  Maheen Sohail ,  Tali Zvi

IPC: G06F16/00 ,  G06F16/901 ,  G06F16/9535 ,  G06Q50/00

CPC classification number: G06Q50/01 ,  G06F16/9024 ,  G06F16/9535

Abstract: The present embodiments relate to automated memory creation and retrieval from moment content items. In some implementations, the automated memory creation and retrieval system can obtain moment content items from user-designated sources with a single user perspective or multiple user perspectives. The moment content items can be assigned tags and arranged in chronological order. The arranged moment content items can be clustered into memory content items based on clustering conditions. Once memory content items are created, they can be arranged into a memory hierarchy made up of connected nodes. In some implementations, the memory content items are also linked together based on similarity in various dimensions in a memory graph. The automated memory creation and retrieval system can receive search criteria for memories from a user interface and provide the user with memories from matched nodes in the memory hierarchy or linked memories in the memory graph.