摘要:
A multi-sensor data fusion system and method provides adaptive weighting of the contributions from a plurality of sensors in the system using an additive calculation of a sensor reliability function for each sensor. During a predetermined tracking period, data is received from each individual sensor in the system and a sensor reliability function is determined for each sensor based on the SNR (signal-to-noise ratio) for the received data from each sensor. Each sensor reliability function is individually weighted based on the SNR for each sensor and a comparison of predetermined sensor operation characteristics for each sensor and a best performing (most reliable) sensor. Additive calculations are performed on the sensor reliability functions to produce both an absolute and a relative reliability function which provide a confidence level for the multi-sensor system relating to the correct classification (recognition) of targets and decoys.
摘要:
A system for providing stand-off biometric verification of a driver of a vehicle while the vehicle is moving and/or a person on foot at a control gate, including an RFID vehicle tag reader, an RFID personal smart card reader and a facial detection and recognition (verification) system. The driver carries a RFID personal smart card that stores personal information of the driver and a face template of the driver. The vehicle carries a RFID vehicle tag that stores information regarding the vehicle. When the vehicle approaches the control gate, the RFID vehicle tag reader reads data from the RFID vehicle tag and the RFID personal tag reader reads data from the RFID personal smart card. The facial detection and verification system scans and reads a facial image for the driver. All the data and facial images detected by the readers are sent to a local computer at the control gate for further processing (final face verification). The local computer at the control gate decodes and retrieves the face template from the data read from the RFID personal smart card.
摘要:
A multi-sensor data fusion system and method provide an additive fusion technique including a modified belief function (algorithm) to adaptively weight the contributions from a plurality of sensors in the system and to produce multiple reliability terms including reliability terms associated with noise for low SNR situations. During a predetermined tracking period, data is received from each individual sensor in the system and a predetermined algorithm is performed to generate sensor reliability functions for each sensor based on each sensor SNR using at least one additional reliability factor associated with noise. Each sensor reliability function may be individually weighted based on the SNR for each sensor and other factors. Additive calculations are performed on the reliability functions to produce at least one system reliability function which provides a confidence level for the multi-sensor system relating to the correct classification (recognition) of desired objects (e.g., targets and decoys).
摘要:
A target detection and tracking system provides dynamic changing of the integration time (IT) for the system IR sensor within a discrete set of values to maintain a high sensor sensitivity. The system changes the integration time to the same or a different sensor integration time within the discrete set based on the image data output from the sensor satisfying pre-determined system parameter thresholds. The system includes an IT-related saturation prediction function allowing the system to avoid unnecessary system saturation when determining whether an IT change should be made. The tracking portion of the system provides tracking feedback allowing target objects with a low sensor signature to be detected without being obscured by nearby uninterested objects that produce system saturation.
摘要:
Embodiments utilize captured data, such as gas data and/or flame/heat data, from sensors in an environment to generate a data-constructed image for use in predicting explosion likelihood within an environment. Some embodiments utilize gas and flame data to generate the data-constructed image that is processable via one or more model(s) to determine whether the environment includes one or more sub-regions at risk of explosion. Some embodiments receive a plurality of gas sensor data and a plurality of flame sensor data, generate a data-constructed image including a plurality of channels based at least in part on such data, and generate explosion prediction data by applying at least a portion of the data-constructed image to a prediction model.
摘要:
A speech recognition method includes receiving audible data and user data. The audible data includes information about an utterance by the user. The user data includes information about movements by the user. The method further includes fusing the audible data and the user data to obtain fused data and determining at least one spoken word of the utterance based on the fused data.
摘要:
Embodiments are disclosed for receiving a user input and an input video comprising multiple frames. The method may include extracting a text feature from the user input. The method may further include extracting a plurality of image features from the frames. The method may further include identifying one or more keyframes from the frames that include the object. The method may further include clustering one or more groups of the one or more keyframes. The method may further include generating a plurality of segmentation masks for each group. The method may further include determining a set of reference masks corresponding to the user input and the object. The method may further include generating a set of fusion masks by combining the plurality of segmentation masks and the set of reference masks. The method may further include propagating the set of fusion masks and outputting a final set of masks.
摘要:
Methods, systems, and apparatuses, including computer programs encoded on computer storage media, for automated foodservice are described. An example method includes receiving one or more images from one or more cameras capturing a food container comprising a plurality of compartments; determining, using a first machine learning model based on the one or more images, a user action comprising a user taking food from a first compartment of the plurality of compartments; receiving a plurality of pieces of weight sensor data from a plurality of weight sensors coupled to a frame hosting the food container; determining, using a second machine learning model based on the plurality of pieces of weight sensor data, a second compartment of the plurality of compartments; in response to the first compartment being the same as the second compartment, displaying the weight and the food information of the food taken by the user.
摘要:
An approach for an iris liveness detection is provided. A plurality of image pairs is acquired using one or more image sensors of a mobile device. A particular image pair is selected from the plurality of image pairs, and a hyperspectral image is generated for the particular image pair. Based on, at least in part, the hyperspectral image, a particular feature vector for the eye-iris region depicted in the particular image pair is generated, and one or more trained model feature vectors generated for facial features of a particular user of the device are retrieved. Based on, at least in part, the particular feature vector and the one or more trained model feature vectors, a distance metric is determined and compared with a threshold. If the distance metric exceeds the threshold, then a first message indicating that the plurality of image pairs fails to depict the particular user is generated. It is also determined whether at least one characteristic, of one or more characteristics determined for NIR images, changes from image-to-image by at least a second threshold. If so, then a second message is generated to indicate that the plurality of image pairs depicts the particular user of a mobile device. The second message may also indicate that an authentication of an owner to the mobile device was successful. Otherwise, a third message is generated to indicate that a presentation attack on the mobile device is in progress.
摘要:
In general, certain embodiments of the present disclosure provide a detection and avoidance system for a vehicle. According to various embodiments, the detection and avoidance system comprises an imaging unit configured to obtain a first image of a field of view at a first camera channel. The first camera channel filters radiation at a wavelength, where one or more objects in the field of view do not emit radiation at the wavelength. The detection and avoidance system further comprises a processing unit configured to receive the first image from the imaging unit and to detect one or more objects therein, as well as a notifying unit configured to communicate collision hazard information determined based upon the detected one or more objects to a pilot control system of the vehicle. Accordingly, the pilot control maneuvers the vehicle to avoid the detected objects.