公开(公告)号：US12183123B2

公开(公告)日：2024-12-31

申请号：US18155683

申请日：2023-01-17

Applicant: Avodah, Inc.

Inventor： Michael Menefee ,  Dallas Nash ,  Trevor Chandler

IPC: G06V40/20 ,  G06F3/01 ,  G06F3/16 ,  G06F40/40 ,  G06F40/58 ,  G06N3/045 ,  G06N3/08 ,  G06T7/20 ,  G06T7/73 ,  G06V40/16 ,  G09B21/00 ,  G10L15/22 ,  G10L15/24 ,  G10L15/26 ,  H04N23/90 ,  G06N20/00 ,  G06T3/4046 ,  G06T17/00 ,  G10L13/00

Abstract: Methods, apparatus and systems for recognizing sign language movements using multiple input and output modalities. One example method includes capturing a movement associated with the sign language using a set of visual sensing devices, the set of visual sensing devices comprising multiple apertures oriented with respect to the subject to receive optical signals corresponding to the movement from multiple angles, generating digital information corresponding to the movement based on the optical signals from the multiple angles, collecting depth information corresponding to the movement in one or more planes perpendicular to an image plane captured by the set of visual sensing devices, producing a reduced set of digital information by removing at least some of the digital information based on the depth information, generating a composite digital representation by aligning at least a portion of the reduced set of digital information, and recognizing the movement based on the composite digital representation.

公开(公告)号：US12002236B2

公开(公告)日：2024-06-04

申请号：US17397523

申请日：2021-08-09

Applicant: AVODAH, INC.

Inventor： Trevor Chandler ,  Dallas Nash ,  Michael Menefee

IPC: G06F3/01 ,  G06F3/03 ,  G06F18/25 ,  G06N3/045 ,  G06T7/20 ,  G06T7/73 ,  G06T7/90 ,  G06V40/16 ,  G06V40/20

CPC classification number: G06T7/73 ,  G06F3/017 ,  G06F3/0304 ,  G06F18/256 ,  G06N3/045 ,  G06T7/20 ,  G06T7/90 ,  G06V40/165 ,  G06V40/23 ,  G06V40/28

Abstract: Disclosed are methods, apparatus and systems for gesture recognition based on neural network processing. One exemplary method for identifying a gesture communicated by a subject includes receiving a plurality of images associated with the gesture, providing the plurality of images to a first 3-dimensional convolutional neural network (3D CNN) and a second 3D CNN, where the first 3D CNN is operable to produce motion information, where the second 3D CNN is operable to produce pose and color information, and where the first 3D CNN is operable to implement an optical flow algorithm to detect the gesture, fusing the motion information and the pose and color information to produce an identification of the gesture, and determining whether the identification corresponds to a singular gesture across the plurality of images using a recurrent neural network that comprises one or more long short-term memory units.

公开(公告)号：US20220026992A1

公开(公告)日：2022-01-27

申请号：US17397523

申请日：2021-08-09

Applicant: AVODAH, INC.

Inventor： Trevor Chandler ,  Dallas Nash ,  Michael Menefee

IPC: G06F3/01 ,  G06N3/04 ,  G06K9/62 ,  G06T7/73 ,  G06T7/90

Abstract: Disclosed are methods, apparatus and systems for gesture recognition based on neural network processing. One exemplary method for identifying a gesture communicated by a subject includes receiving a plurality of images associated with the gesture, providing the plurality of images to a first 3-dimensional convolutional neural network (3D CNN) and a second 3D CNN, where the first 3D CNN is operable to produce motion information, where the second 3D CNN is operable to produce pose and color information, and where the first 3D CNN is operable to implement an optical flow algorithm to detect the gesture, fusing the motion information and the pose and color information to produce an identification of the gesture, and determining whether the identification corresponds to a singular gesture across the plurality of images using a recurrent neural network that comprises one or more long short-term memory units.

公开(公告)号：US11055521B2

公开(公告)日：2021-07-06

申请号：US16730587

申请日：2019-12-30

Applicant: AVODAH, INC.

Inventor： Trevor Chandler ,  Dallas Nash ,  Michael Menefee

IPC: G06K9/00 ,  G06N3/08 ,  G06N20/00 ,  G06F3/01 ,  G09B21/00 ,  G06F40/40 ,  G06F40/58 ,  G10L15/26 ,  G06F3/16 ,  G10L15/22 ,  G10L15/24 ,  H04N5/247 ,  G06T7/73 ,  G06N3/04 ,  G06T7/20 ,  G10L13/00 ,  G06T3/40 ,  G06T17/00

Abstract: Disclosed are methods, apparatus and systems for real-time gesture recognition. One exemplary method for the real-time identification of a gesture communicated by a subject includes receiving, by a first thread of the one or more multi-threaded processors, a first set of image frames associated with the gesture, the first set of image frames captured during a first time interval, performing, by the first thread, pose estimation on each frame of the first set of image frames including eliminating background information from each frame to obtain one or more areas of interest, storing information representative of the one or more areas of interest in a shared memory accessible to the one or more multi-threaded processors, and performing, by a second thread of the one or more multi-threaded processors, a gesture recognition operation on a second set of image frames associated with the gesture.

公开(公告)号：US20250022265A1

公开(公告)日：2025-01-16

申请号：US18629724

申请日：2024-04-08

Applicant: AVODAH, INC.

Inventor： Trevor Chandler ,  Dallas Nash ,  Michael Menefee

IPC: G06V10/82 ,  G06F3/01 ,  G06F3/16 ,  G06F40/40 ,  G06F40/58 ,  G06N3/045 ,  G06N3/08 ,  G06N20/00 ,  G06T3/4046 ,  G06T7/20 ,  G06T7/73 ,  G06T17/00 ,  G06V10/764 ,  G06V40/16 ,  G06V40/20 ,  G09B21/00 ,  G10L13/00 ,  G10L15/22 ,  G10L15/24 ,  G10L15/26 ,  H04N23/90

Abstract: Disclosed are methods, apparatus and systems for real-time gesture recognition. One exemplary method for the real-time identification of a gesture communicated by a subject includes receiving, by a first thread of the one or more multi-threaded processors, a first set of image frames associated with the gesture, the first set of image frames captured during a first time interval, performing, by the first thread, pose estimation on each frame of the first set of image frames including eliminating background information from each frame to obtain one or more areas of interest, storing information representative of the one or more areas of interest in a shared memory accessible to the one or more multi-threaded processors, and performing, by a second thread of the one or more multi-threaded processors, a gesture recognition operation on a second set of image frames associated with the gesture.

公开(公告)号：US11557152B2

公开(公告)日：2023-01-17

申请号：US17208968

申请日：2021-03-22

Applicant: Avodah, Inc.

Inventor： Michael Menefee ,  Dallas Nash ,  Trevor Chandler

IPC: G06V40/20 ,  G06N3/08 ,  G06F3/01 ,  G09B21/00 ,  G06F40/40 ,  G06F40/58 ,  G10L15/26 ,  G06V40/16 ,  G06F3/16 ,  G10L15/22 ,  G10L15/24 ,  H04N5/247 ,  G06T7/73 ,  G06N3/04 ,  G06T7/20 ,  G10L13/00 ,  G06N20/00 ,  G06T3/40 ,  G06T17/00

Abstract: Methods, apparatus and systems for recognizing sign language movements using multiple input and output modalities. One example method includes capturing a movement associated with the sign language using a set of visual sensing devices, the set of visual sensing devices comprising multiple apertures oriented with respect to the subject to receive optical signals corresponding to the movement from multiple angles, generating digital information corresponding to the movement based on the optical signals from the multiple angles, collecting depth information corresponding to the movement in one or more planes perpendicular to an image plane captured by the set of visual sensing devices, producing a reduced set of digital information by removing at least some of the digital information based on the depth information, generating a composite digital representation by aligning at least a portion of the reduced set of digital information, and recognizing the movement based on the composite digital representation.

公开(公告)号：US20210374393A1

公开(公告)日：2021-12-02

申请号：US17347351

申请日：2021-06-14

Applicant: Avodah, Inc.

Inventor： Trevor Chandler ,  Dallas Nash ,  Michael Menefee

IPC: G06K9/00 ,  G06K9/62 ,  G06N3/08 ,  G06T17/00 ,  G06N20/00

Abstract: Methods, devices and systems for training a pattern recognition system are described. In one example, a method for training a sign language translation system includes generating a three-dimensional (3D) scene that includes a 3D model simulating a gesture that represents a letter, a word, or a phrase in a sign language. The method includes obtaining a value indicative of a total number of training images to be generated, using the value indicative of the total number of training images to determine a plurality of variations of the 3D scene for generating of the training images, applying each of plurality of variations to the 3D scene to produce a plurality of modified 3D scenes, and capturing an image of each of the plurality of modified 3D scenes to form the training images for a neural network of the sign language translation system.

公开(公告)号：US11036973B2

公开(公告)日：2021-06-15

申请号：US16410147

申请日：2019-05-13

Applicant: Avodah, Inc.

Inventor： Trevor Chandler ,  Dallas Nash ,  Michael Menefee

IPC: G06K9/00 ,  G06K9/62 ,  G06N3/08 ,  G06T17/00 ,  G06N20/00

Abstract: Methods, devices and systems for training a pattern recognition system are described. In one example, a method for training a sign language translation system includes generating a three-dimensional (3D) scene that includes a 3D model simulating a gesture that represents a letter, a word, or a phrase in a sign language. The method includes obtaining a value indicative of a total number of training images to be generated, using the value indicative of the total number of training images to determine a plurality of variations of the 3D scene for generating of the training images, applying each of plurality of variations to the 3D scene to produce a plurality of modified 3D scenes, and capturing an image of each of the plurality of modified 3D scenes to form the training images for a neural network of the sign language translation system.

公开(公告)号：USD912139S1

公开(公告)日：2021-03-02

申请号：US29678367

申请日：2019-01-28

Applicant: Avodah, Inc.

Designer： Michael Menefee ,  Dallas Nash ,  Trevor Chandler

公开(公告)号：USD976320S1

公开(公告)日：2023-01-24

申请号：US29772402

申请日：2021-03-01

Applicant: AVODAH, INC.

Designer： Michael Menefee ,  Dallas Nash ,  Trevor Chandler