-
公开(公告)号:US20250000412A1
公开(公告)日:2025-01-02
申请号:US18216995
申请日:2023-06-30
Applicant: Rockwell Collins, Inc.
Inventor: Peggy Wu , Andrew Radlbeck , Brigid A. Blakeslee , Ganesh Sundaramoorthi
Abstract: A computer system records eye tracking data and identifies movements in the eye tracking data to determine gaze and pupil dynamics. The system also records physiological data such as heart rate, electroencephalogram (EEG), and functional near-infrared spectroscopy (fNIRs), and used the physiological data to determine an emotional state. Eye tracking data is correlated with a current task; the system determines a performance metric based on eye tracking data, and applies a positive or negative emotional weighting.
-
公开(公告)号:US20240355121A1
公开(公告)日:2024-10-24
申请号:US18136583
申请日:2023-04-19
Applicant: Rockwell Collins, Inc.
Inventor: Kin Gwn Lore , Ganesh Sundaramoorthi , Kishore K. Reddy
IPC: G06V20/40 , A61B5/00 , A61B5/01 , A61B5/0533
CPC classification number: G06V20/44 , A61B5/01 , A61B5/0533 , A61B5/6802
Abstract: A wearable device includes neuromorphic event cameras. A processor receives data streams from the event cameras and makes application specific predictions/determinations. The event cameras may be outward facing to make determinations about the environment or a specific task, inward facing to monitor the state of the user, or both. The processor may be configured as a trained neural network to receive the data streams and produce output based on predefined sets of training data. Sensors other than event cameras may supply data to the processor and neural network, including other cameras via a feature recognition process.
-
公开(公告)号:US20250069381A1
公开(公告)日:2025-02-27
申请号:US18238180
申请日:2023-08-25
Applicant: Rockwell Collins, Inc.
Inventor: Sudeepta Mondal , Ganesh Sundaramoorthi
IPC: G06V10/82 , G06V10/72 , G06V10/764
Abstract: A system may include at least one processor configured to: obtain a trained neural network (NN); obtain or calculate at least one average feature information associated with the trained NN, each of the at least one average feature information including a given average feature information summarizing in-class statistics that each layer of the trained NN uses for a given class; receive an incoming observation influencing a given layer; calculate a corresponding feature information of the incoming observation, the corresponding feature information summarizing statistics of the incoming observation for the given layer; classify the incoming observation as being in the given class; calculate a distance score associated with a distance between the corresponding feature information of the incoming observation and the given average feature information; determine the incoming observation is an out-of-distribution (OOD) sample; and output an alert indicating the incoming observation is OOD and/or discard the incoming observation's classification.
-
4.
公开(公告)号:US20250000372A1
公开(公告)日:2025-01-02
申请号:US18216825
申请日:2023-06-30
Applicant: Rockwell Collins, Inc.
Inventor: Peggy Wu , Brigid A. Blakeslee , Andrew Radlbeck , Ganesh Sundaramoorthi
IPC: A61B5/0205 , G06V20/40 , G06V40/18
Abstract: A computer system records eye tracking data and identifies movements in the eye tracking data to determine gaze and pupil dynamics. Eye tracking data is correlated with physiological data including heart rate. The system looks at the heart rate of the operator in real time to evaluate whether they exhibit an anticipatory response to switch attention. The system differentiates between behaviors that are cognitively initiated as opposed to triggered by the environment. The system correlates eye tracking data and physiological data with previously identified knowledge about the training scenario to assess whether the operator is able to direct attention to the right stimuli based on task needs. The system examines whether there is follow through behavior of shifting gaze to specific instruments as defined by the current task.
-
公开(公告)号:US20250005785A1
公开(公告)日:2025-01-02
申请号:US18216968
申请日:2023-06-30
Applicant: Rockwell Collins, Inc.
Inventor: Brigid A. Blakeslee , Andrew Radlbeck , Peggy Wu , Ganesh Sundaramoorthi
Abstract: A computer system records eye tracking data and identifies movements in the eye tracking data to create and iteratively refine associations between eye features and basic geometric shapes. The associations are used to rapidly identify eye features for eye tracking. The system derives performance metrics and fatigue estimations from the identified basic geometric shapes, including changes in such shapes over time. The system continuously adjusts and/or weights the associations in real-time based on eye tracking data.
-
公开(公告)号:US12124625B1
公开(公告)日:2024-10-22
申请号:US18216841
申请日:2023-06-30
Applicant: Rockwell Collins, Inc.
Inventor: Peggy Wu , Brigid A. Blakeslee , Andrew Radlbeck , Ganesh Sundaramoorthi
IPC: G06F3/01
CPC classification number: G06F3/013
Abstract: A computer system records eye tracking data and identifies movements in the eye tracking data to determine gaze and pupil dynamics. Eye tracking data is correlated with a current task and predetermined vigilance requirements. The system determines if the user is exhibiting an appropriate level of vigilance based on the task or is becoming fixated. When fixation is detected, the system may engage in remedial action. A task flow diagram represents the operator tasks. Interactions between the user and the instrumentation are used to estimate the probability distribution of the task the user is currently conducting. The system correlates eye tracking data and physiological data such as electroencephalogram (EEG) and functional near-infrared spectroscopy (fNIRs) to determine neuroactivity. Monitoring neuroactivity reduces the probability of a false positive for fixation.
-
公开(公告)号:US20240324923A1
公开(公告)日:2024-10-03
申请号:US18611304
申请日:2024-03-20
Applicant: Rockwell Collins, Inc.
Inventor: Peggy Wu , Ganesh Sundaramoorthi , Andrew Radlbeck , Brigid A. Blakeslee
CPC classification number: A61B5/163 , A61B3/14 , A61B5/1103 , A61B5/168 , A61B5/18 , A61B5/486 , G16H30/40 , A61B2503/22
Abstract: An on aircraft computer system records and analyzes biometric data to identify indicia of impaired performance, such as pilot fatigue, attention tunneling, or cognitive overload. Such impairment is identified by alterations in pilot gaze or eye movement, head movement, facial parameters, eye lid position, heart rate, breathing, or brain wave patterns. Appropriate corrective action is applied based on the type of impaired performance identified, including altering a level of automation, contacting a ground dispatcher or ground pilot, or contacting a co-pilot or other crew member. Biometric data is continuously logged and correlated with data from other avionics systems to refine formulas relating biometric data to states of alertness and crew rest procedures.
-
8.
公开(公告)号:US20250005939A1
公开(公告)日:2025-01-02
申请号:US18216941
申请日:2023-06-30
Applicant: Rockwell Collins, Inc.
Inventor: Peggy Wu , Andrew Radlbeck , Brigid A. Blakeslee , Ganesh Sundaramoorthi
Abstract: A computer system records eye tracking data and identifies movements in the eye tracking data to determine gaze and pupil dynamics. Eye tracking data is correlated with known task steps. The system anticipates where the pilot's gaze should be based on the known task steps, and characterizes the pilot response based on a change in gaze. The system produces a pilot situational awareness metric based on the characterization. The system further characterizes the pilot's response based on a delay to switch gaze. Such delays may conform to both minimum and maximum thresholds. The system continuously adjusts and/or weights the situational awareness metric based on ongoing, prospective, gaze monitoring.
-
公开(公告)号:US20250000357A1
公开(公告)日:2025-01-02
申请号:US18216911
申请日:2023-06-30
Applicant: Rockwell Collins, Inc.
Inventor: Andrew Radlbeck , Peggy Wu , Brigid A. Blakeslee , Ganesh Sundaramoorthi
Abstract: A computer system records eye tracking data and identifies movements in the eye tracking data to generate a model of eye movement and pupil dynamics. The model is used to produce a performance metric for the user based on deviations of the predicted output from what is physically possible as defined by the bio-kinematic model. The system continuously stores eye tracking data to enhance the bio-kinematic models. Bio-kinematic models may be generalized or specific to a particular user. The system continuously adjusts and/or weights the bio-kinematic model in real-time based on eye tracking data.
-
-
-
-
-
-
-
-