摘要:
A finite state data structure includes paths that represent pairs of strings, with a first string that is a string of tag combinations and a second string that is a string of tags for tokens in a language. The second strings of a set of paths with the same first string include only highly probable strings of tags for the first string. The data structure can be an FST or a bimachine, and can be used for mapping strings of tag combinations to strings of tags. The tags can, for example, indicate parts of speech of words, and the tag combinations can be ambiguity classes or, in a bimachine, reduced ambiguity classes. An FST can be obtained by approximating a Hidden Markov Model. A bimachine can include left-to-right and right-to-left sequential FSTs obtained based on frequencies of tokens in a training corpus.
摘要:
A stand-alone, hand-held apparatus is provided, which combines elements of a scanning dictionary with an automatic-translation software, for in-context translation. Additionally, the apparatus may include a text-to-speech synthesis, for in-tandem exposure to spoken and translated forms of a portion of text, such as a clause, a sentence, or a few sentences. A whole document may thus be read, for example, sentence by sentence. The apparatus may further be used for teaching correct pronunciation of any portion of text, by recording the user's pronunciation of the portion of text and comparing it with a text-to-speech synthesis produced by the apparatus.
摘要:
Character data of a word or phrase in a document is designated. Desired data is retrieved from a predetermined database on the basis of the designated character data. One sentence including at least the designated character data is cut out and subjected to sentence analysis. On the basis of a sentence analysis result, specific data is selected from the retrieval result acquired from the database. In addition, character data of a word or phrase in a document is designated. One sentence including at least the designated character data is cut out and subjected to sentence analysis to extract a keyword. A retrieval condition is prepared on the basis of the extracted keyword, and desired data is retrieved from a predetermined database on the basis of the retrieved conditional expression.
摘要:
A natural language understanding system is described to provide generation of concept codes from free-text medical data. A probabilistic model of lexical semantics, is implemented by means of a Bayesian network, and is used to determine the most probable concept or meaning associated with a sentence or phrase. The inventive method and system includes the steps of checking for synonyms, checking spelling, performing syntactic parsing, transforming text to its “deep” or semantic form, and performing a semantic analysis based on a probabilistic model of lexical semantics.
摘要:
A grammar programming language (“GPL”) compiler compiles each rule in a natural language grammar into a separate function that can be invoked by a translation system to apply the rule to a representation of a natural language expression. The GPL compiler can output the functions for the rules as source code for a standard computer programming language to be further compiled into object code that can be directly executed by a computer processor. The GPL compiler can also generate special functions for each rule to enable multi-layered operations on the representations and to handle the processing of representations of ambiguous expressions.
摘要:
A language recognition system, method and program product for recognizing language based input from computer users on a network of connected computers. Each computer includes at least one user based language model trained for a corresponding user for automatic speech recognition, handwriting recognition, machine translation, gesture recognition or other similar actions that require interpretation of user activities. Network computer users are clustered into classes of similar users according to user similarities such as, nationality, profession, sex, age, etc. User characteristics are collected by sensors and from databases and, then, distributed over the network during user activities. Language models with similarities among similar users on the network are identified. The language models include a language model domain, with similar language models being clustered according to their domains. Language models identified as similar are modified in response to user production activities. After modification of one language model, other identified similar language models are compared and adapted. Also, user data, including information about user activities and language model data, is transmitted over the network to other similar users. Language models are adapted only in response to similar user activities, when these activities are recorded and transmitted over the network. Language models are given a global context based on similar users that are connected together over the network.
摘要:
A method and apparatus is provided to enable a user watching and/or listening to a program to search for new information in the stream of a telecommunications data. The apparatus includes a voice recognition system that recognizes the user's request and causes a search to be performed in the long stream of data of at least one other telecommunication channel. The system includes a storage device for storing and processing the request. Upon recognition of the request, the incoming signal or signals are scanned for matches with the request. Upon finding the match between the request and the incoming signal, information related to the data is brought to the viewer's attention. This can be accomplished by either changing the viewer's station or by bringing in a split screen display forward into the display.
摘要:
A language identification system for automatically identifying a language in which an input text is written based upon a probabilistic analysis of predetermined portions of words sampled from the input text. The predetermined portions of words reflect morphological characteristics of natural languages. The automatic language identification system determines which language of a plurality of represented languages a given text is written based upon a value representing the relative likelihood that the text is a particular one of the plurality of represented languages due to a presence of a morphologically-significant word portion in the text. Preferably the word portion is the last three characters in a word. The relative likelihood is derived from a relative frequency of occurrence of the fixed-length word ending in each of a plurality of language corpuses, within each language corpus corresponding to one of the plurality of represented languages. Specifically, the automatic language identification system includes a language corpus analyzer that generates, for each of a plurality of word endings extracted from at least one of the language corpuses, a plurality of probabilities associated with the word ending and one of the plurality of represented languages. Each of the language corpuses represents a natural language and each of the probabilities represents a relative likelihood that the text is the associated language due to the presence of the associated word ending in the text. The relative likelihood is derived from a relative frequency that the associated word ending occurs in each of the plurality of language corpuses. The automatic language identification system also comprises a language identification engine that determines, for each of the represented languages, an arithmetic sum of the relative probabilities for all the word endings which appear in the text. The source language is determined to be the represented language having the greatest arithmetic sum of relative probabilities, provided this sum exceeds zero.
摘要:
A method for forming an index comprising indexing features for a plurality of documents, includes the steps of identifying each of at least some of the terms present in the documents, generating from each identified term at least one equivalent term which is different from but linguistically related to the identified term, forming for each of the identified terms a first indexing feature comprising the identified term and an identifier of the or each document in which the identified term occurs, forming for each of the equivalent terms a second indexing feature comprising the equivalent term and an identifier of the or each document in which the identifier term to which the equivalent term is equivalent occurs, and forming an index comprising the first and second indexing features.
摘要:
A text input section (1) divides an inputted text into sentences and attaches a number to each of the sentences, which is stored in a text data base together with the number. An important word recognizing section (2) generates a list of important words for each sentence to store it in a storing section (8). An important word weighting section (3) weights each important word. A relation degree computing section (4) computes a relation degree between an attention sentence and a precedent sentence. An important degree computing section (5) computes an importance degree of each attention sentence. A tree structure determining section (6) determines a parent sentence of the attention sentence and determines a tree structure of the inputted text. Unlike the case of determining whether or not character strings of key words are merely coincident with each other, it is possible to determine a parent sentence of each sentence based on a degree of connection between two sentences and analyze a structure of the inputted text with high accuracy according to the above construction.