Abstract:
A nonlinear adaptive signal processor is provided wherein during a training phase, based upon a prior knowledge of the desired processor response to a given input, the output signal preceding the contemporary value of the output signal is employed in the feedback sense for minimizing storage required of the desired responses of the processor which, when trained, responds as desired to a different input having the same statistics as the input employed in the training phase.
Abstract:
Operation of a trained processor beyond an untrained point where successive time sampled sets of level dependent signals stored in a tree storage array at successive memory locations along with a trained response for each set at a subsequent memory location form a data base to locate and extract a trained response to subsequent sets encountered following completion of training. A test set forming an untrained point is sequentially compared with each trained set stored in memory to establish and store a difference function relative to each trained set. Logic means selects as the trained response for the untrained point the trained response from those trained responses for which the trained sets have the same minimal difference function and which satisfies a predetermined decision criteria.
Abstract:
This invention relates to nonlinear processors and more particularly to the utilization both during training and execution of linear subprocessors which are selected and employed in dependence upon the function to be processed and to provide weighting coefficients by which the function to be processed is weighted.
Abstract:
A trainable signal processor having at least one input signal u and one desired output signal z applied thereto during training and having at least one input signal u and one actual output signal x derived therefrom during execution is provided. From each member of the input sequence u(ti) a key Ki is generated. Ki may have only a finite number of values and is a single valued function of u. Corresponding to a specific value of the Ki generated during training a trained response is derived from samples of the desired output signal z measured at instances ti at which that value of Ki occurred and is maintained in a tree allocated file. The file thereby associates with each set of Ki values a trained response. Storage is provided for only those sets of Ki values which actually occurred during training, generally constituting a small fraction of those sets which may theoretically occur, particularly when the input is of multidimensional character. During execution the tree allocated file provides for efficient retrieval of the trained responses which are employed in determining the actual output signal of the processor.
Abstract:
A system is comprised of a series of trainable nonlinear processors in cascade. The processors are trained in sequence as follows. In a first phase of the sequence, a set of input signals comprising input information upon which the system is to be trained and a corresponding set of desired responses to these input signals are introduced into the first processor. When the first processor has been trained over the entire set, a second phase commences in which a second set of input signals along with the output of the first processor and corresponding set of desired responses are introduced into the second processor. During this second phase the input signals to the first and second processors are in sequential correspondence. In one embodiment of the invention the set of input signals to the first processor comprises the same set of input signals being introduced into the second processor delayed by a fixed time interval. The training sequence continues until all processors in the series have been trained in a similar manner. The input to the kth or last processor will comprise a set of input signals, the desired output responses to those input signals and the output of the (k-l)the processor. The input to each preceding processor will th separate sets of input signals which in one embodiment are the set of input signals to the kth processor, retrogressively, delayed in time by one additional time interval and the output of the previous processor. The system may be looked upon as a minimum entropy system in which the entropy or measure of uncertainty is decreased at each stage. When all of the processors have been trained, the system is ready for execution and the actual output of the last stage is a minimum entropy approximation of a proper desired output when an input signal, without a corresponding desired response, is introduced into the completed system of cascaded processors.
Abstract:
A trained processor is described which operates beyond an untrained point. Information is stored in a memory array in a tree allocated file. Information is stored in the memory as key functions with associated trained responses. After the processor has been trained, it is able during an execution cycle to find and appropriate response for other key functions. These key functions are compared with the reference key functions stored in the memory array to find an appropriate trained response. During the execution cycle, there are some key functions for which there is no corresponding reference key function stored in the memory array and thereupon no appropriate trained response. These key functions for which no trained response is found are termed untrained points. Thereupon a key function which constitutes an untrained point is effectively compared with the reference key functions stored in the memory array to establish and store a difference function relative to each stored key function. Logic means then selects for the untrained point a trained response from those trained responses best satisfying a predetermined decision criteria. During the comparison operation, conditions are measured that indicate when key functions corresponding to a given group of trained responses cannot be an appropriate response for the untrained point in question. Logic means waive further examination of stored key functions, and thereby greatly expedite the efficiency of search.
Abstract:
Training control is provided for a nonlinear adaptive signal processor wherein, during a long training phase on a nonstationary function, but based upon a prior knowledge of the desired processor response to a given input, the inertia to change established during long training is modified by production and utilization of variable error dependent gain control.