公开(公告)号：US11847426B2

公开(公告)日：2023-12-19

申请号：US16762302

申请日：2018-11-08

Applicant: Snap Inc.

Inventor： David Retek ,  David Palhazi ,  Marton Kajtar ,  Attila Alvarez ,  Peter Poscsi ,  Andras Nemeth ,  Matyas Trosztel ,  Zsolt Robotka ,  Janos Rovnyai

IPC: G06F40/58 ,  G06F40/205 ,  G06F3/01 ,  G06V40/20

CPC classification number: G06F40/58 ,  G06F3/014 ,  G06F3/017 ,  G06F40/205 ,  G06V40/28

Abstract: A system and method for translating sign language utterances into a target language, including: receiving motion capture data; producing phonemes/sign fragments from the received motion capture data; producing a plurality of sign sequences from the phonemes/sign fragments; parsing these sign sequences to produce grammatically parsed sign utterances; translating the grammatically parsed sign utterances into grammatical representations in the target language; and generating output utterances in the target language based upon the grammatical representations.

公开(公告)号：US20240127006A1

公开(公告)日：2024-04-18

申请号：US17967209

申请日：2022-10-17

Applicant: Snap Inc.

Inventor： Kai Zhou ,  Jennica Pounds ,  Zsolt Robotka ,  Márton Gergely Kajtár

IPC: G06F40/58 ,  G06F3/01 ,  G06F3/0346 ,  G06V10/26 ,  G06V20/20 ,  G06V40/10 ,  G06V40/20

CPC classification number: G06F40/58 ,  G06F3/014 ,  G06F3/017 ,  G06F3/0346 ,  G06V10/26 ,  G06V20/20 ,  G06V40/113 ,  G06V40/28

Abstract: A method for recognizing sign language using collaborative augmented reality devices is described. In one aspect, a method includes accessing a first image generated by a first augmented reality device and a second image generated by a second augmented reality device, the first image and the second image depicting a hand gesture of a user of the first augmented reality device, synchronizing the first augmented reality device with the second augmented reality device, in response to the synchronizing, distributing one or more processes of a sign language recognition system between the first and second augmented reality devices, collecting results from the one or more processes from the first and second augmented reality devices, and displaying, in near real-time in a first display of the first augmented reality device, text indicating a sign language translation of the hand gesture based on the results.

公开(公告)号：US20240070405A1

公开(公告)日：2024-02-29

申请号：US18501349

申请日：2023-11-03

Applicant: Snap Inc.

Inventor： Dávid Retek ,  Dávid Pálházi ,  Márton Kajtar ,  Attila Alvarez ,  Péter Pócsi ,  András Németh ,  Mátyás Trosztel ,  Zsolt Robotka ,  János Rovnyai

IPC: G06F40/58 ,  G06F3/01 ,  G06F40/205 ,  G06V40/20

CPC classification number: G06F40/58 ,  G06F3/014 ,  G06F3/017 ,  G06F40/205 ,  G06V40/28

Abstract: A system and method for translating sign language utterances into a target language, including: receiving motion capture data; producing phonemes/sign fragments from the received motion capture data; producing a plurality of sign sequences from the phonemes/sign fragments; parsing these sign sequences to produce grammatically parsed sign utterances; translating the grammatically parsed sign utterances into grammatical representations in the target language; and generating output utterances in the target language based upon the grammatical representations.