摘要:
A continuous sign-language recognition apparatus and input apparatus which employ expressions of template patterns of sign-language word as well as the template patterns of sign-language word to realize high speed and highly accurate sign-language recognition. Each of component patterns constituting a template pattern of a sign-language word is expressed by a feature vector representing the pattern when the pattern is a static pattern, or by a time-series pattern of a feature vector when the pattern is a dynamic pattern. Also, using the template patterns of sign-language word, different matching methods are applied to the static and dynamic patterns for recognizing each component pattern, and the respective results are integrated on the basis of a temporal overlap of the respective component patterns to continuously recognize sign-language words.
摘要:
In a sign-language learning system, the data of sign-language desired by a learner can be outputted quickly and accurately and moreover in the display method matching the requirement of individual learner and the individual learners can easily make additional registration. The sign-language data is preserved in a sign-language dictionary (1) and a desired sign-language data is searched on the basis of an entry word or contents by means of a dictionary search device (2). The searched sign-language data is displayed in a display output device (8) in accordance with a requirement of a learner by means of image synthesis. The sign-language data is registered by a dictionary registration device (3).
摘要:
In continuous sign language recognition, reference sign language patterns of good quality are generated. Continuous sign language patterns and reference sign language patterns are efficiently compressed. The compressed continuous sign language patterns are sequentially and directly matched with the compressed reference sign language patterns to recognize the sign language at high speed and with high precision. A reference sign pattern generating unit (3) generates a reference sign language pattern by normalizing sample patterns while taking into consideration of their nonlinear compression/expansion and by calculating an average of the sample patterns. A continuous sign language recognition unit (5) recognizes a continuous sign language at high speed by sequentially matching the continuous sign language of time sequential patterns with reference sign language patterns while allowing nonlinear expansion and compression in the time domain. A sign language translation system is provided in which a sign language as well as the facial expression or emotion of a sign language user is recognized and converted into a spoken language with emotion, and transferred in the form of texts, voices, sign languages of another type to a particular partner among a plurality of unknown system users.
摘要:
A sign language/word translation system can cope with the case where no word corresponding to a hand operation is found. The system includes a configuration for taking a countermeasure against the finding of a plurality of words corresponding to a hand operation. When a word corresponding to a hand operation is not found in a sign language word dictionary (5), a finger operation is input, a character corresponding to the finger operation is searched for in a manual alphabet pattern dictionary (6), and the character train thus obtained is found from a character word dictionary (7), thereby producing an appropriate word. Also, a plurality of words found from the sign language word dictionary (5) are displayed as translation candidates, and the user inputs by a hand operation as to whether the translation candidate is appropriate or not. The translation candidate that has been decided to be appropriate is determined as word resulting from translation.
摘要:
A continuous sign-language recognition apparatus and input apparatus which employ expressions of template patterns of sign-language word as well as the template patterns of sign-language word to realize high speed and highly accurate sign-language recognition. Each of component patterns constituting a template pattern of a sign-language word is expressed by a feature vector representing the pattern when the pattern is a static pattern, or by a time-series pattern of a feature vector when the pattern is a dynamic pattern. Also, using the template patterns of sign-language word, different matching methods are applied to the static and dynamic patterns for recognizing each component pattern, and the respective results are integrated on the basis of a temporal overlap of the respective component patterns to continuously recognize sign-language words.
摘要:
In a sign-language learning system, the data of sign-language desired by a learner can be outputted quickly and accurately and moreover in the display method matching the requirement of individual learner and the individual learners can easily make additional registration. The sign-language data is preserved in a sign-language dictionary (1) and a desired sign-language data is searched on the basis of an entry word or contents by means of a dictionary search device (2). The searched sign-language data is displayed in a display output device (8) in accordance with a requirement of a learner by means of image synthesis. The sign-language data is registered by a dictionary registration device (3).
摘要:
A sign language/word translation system can cope with the case where no word corresponding to a hand operation is found. The system includes a configuration for taking a countermeasure against the finding of a plurality of words corresponding to a hand operation. When a word corresponding to a hand operation is not found in a sign language word dictionary (5), a finger operation is input, a character corresponding to the finger operation is searched for in a manual alphabet pattern dictionary (6), and the character train thus obtained is found from a character word dictionary (7), thereby producing an appropriate word. Also, a plurality of words found from the sign language word dictionary (5) are displayed as translation candidates, and the user inputs by a hand operation as to whether the translation candidate is appropriate or not. The translation candidate that has been decided to be appropriate is determined as word resulting from translation.