-
公开(公告)号:US11960644B2
公开(公告)日:2024-04-16
申请号:US17481959
申请日:2021-09-22
发明人: Peggy Wu , Ahmad F. Osman
CPC分类号: G06F3/013 , B64D43/00 , B64D47/08 , G06F3/011 , G06F3/017 , G06T7/70 , G06V40/20 , G06T2207/10016 , G06T2207/20081 , G06T2207/20084 , G06T2207/30196 , G06T2207/30201 , G06V20/597
摘要: A system and method for inferring operator intent by detecting operator focus incorporates cameras positioned within a cockpit or control space of a vehicle and oriented at an operator of the vehicle. The cameras capture images of the operator in a control seat; the images are analyzed (either individually or sequentially) to determine a gaze and/or body pose of the operator (including, e.g., a position and orientation of the torso and limbs). By comparing the determined gaze and/or body pose to the positions and orientations of potential focus targets within the control space (e.g., windows, display units, and/or control panels that the operator may engage with visually and/or physically), the system predicts the most likely future focus target or targets: what the operator is most likely to visually and/or physically engage with next. Operator intent may be further analyzed to identify potentially abnormal or anomalous behavior.
-
2.
公开(公告)号:US20220392319A1
公开(公告)日:2022-12-08
申请号:US17733111
申请日:2022-04-29
发明人: Arjun Harsha Rao , Timothy J. Wittkop , Christopher L George , Michael P. Matessa , Peggy Wu , Wade T. Johnson , Sarah Barber , Felix B. Turcios , Bryan C. Schultz
摘要: A system may include a vehicle. The vehicle may include an array of haptic devices. The system may further include at least one processor configured to: determine a location of an object or occurrence relative to the user; based at least on the location of the object or occurrence relative to the user, select at least one haptic device of the array of haptic devices to be driven and function as a directional haptic alert to the user, wherein the directional haptic alert is indicative of a direction from the user toward the object or occurrence; and output at least one command to cause a driving of the selected at least one haptic device, wherein the driving of the selected at least one haptic device is perceivable by the user as the directional haptic alert.
-
公开(公告)号:US12087092B2
公开(公告)日:2024-09-10
申请号:US17734860
申请日:2022-05-02
发明人: Christopher L George , Arjun Harsha Rao , Timothy J. Wittkop , Wade T. Johnson , Peggy Wu , Michael P. Matessa
CPC分类号: G06V40/19 , B64D45/00 , G06T7/70 , G06V40/197 , G08G5/0021 , G08G5/003 , G06T2207/30201
摘要: An aircraft-based pilot safety system (PSS) includes cameras or other gaze sensors fixed at an aircraft pilot and configured to capture an image stream focused on the pilot's eyes. The gaze sensors continually assess the gaze direction of the pilot (e.g., toward a display, instrument panel, and/or indicator within the cockpit that the pilot is currently looking at or focusing on) and thereby can establish when the pilot is executing a scan pattern and if that scan pattern is nominal for the current flight context by comparing the scan pattern to context-specific reference scan patterns. If, for example, the pilot's gaze deviates from where it should be (e.g., as determined by the current flight segment) or the current scan pattern is interrupted, the system may prompt the pilot to redirect their gaze or resume the scan pattern.
-
公开(公告)号:US20230044247A1
公开(公告)日:2023-02-09
申请号:US17514315
申请日:2021-10-29
发明人: Ahmad F. Osman , Peggy Wu
摘要: A computer-implemented method is described. The method is be implemented by processors of an aircraft system. The method includes receiving images of an eye and a lighting configuration associated with a cockpit of an aircraft. The method further includes detecting a position of the eye within each of the images. The method further includes compensating for a pupillary light response of the eye based on the position of the eye within the image and the lighting configuration. By compensating for the pupillary light response, a fatigue level of the operator is estimated with reduced noise.
-
公开(公告)号:US20220388677A1
公开(公告)日:2022-12-08
申请号:US17734710
申请日:2022-05-02
发明人: Christopher L. George , Arjun Harsha Rao , Timothy J. Wittkop , Wade T. Johnson , Peggy Wu , Michael P. Matessa
摘要: An operator safety system (OSS) monitors the physiological well-being of an aircraft pilot or vehicle operator, and has engaged and disengaged operational states (the engaged state associated with active monitoring). The OSS includes a smart engage/disengage system incorporating presence sensors (e.g., visual, seat-based) installed in the cockpit or control area of the vehicle. When the presence sensors determine that the pilot/operator is no longer present in their seat but the OSS is still engaged, the OSS prompts the operator to disengage the OSS (e.g., via single-touch display interface or remotely to a mobile device). When the presence sensors determine that the operator is present or seated, but the OSS is disengaged, the OSS prompts the operator to re-engage the OSS.
-
6.
公开(公告)号:US12051274B2
公开(公告)日:2024-07-30
申请号:US17518363
申请日:2021-11-03
发明人: Peggy Wu , Ahmad F. Osman
摘要: A system and method for continuous real-time assessment of the situational awareness of an aircraft operator incorporates gaze sensors to determine the current gaze target (or sequence of gaze targets) of the operator, e.g., which interfaces the operator is looking at. The system receives operational context from aircraft systems indicative of current events and conditions both internal and external to the aircraft (e.g., operational status, mission or flight plan objectives, weather conditions). Based on the determined gaze targets and coterminous operational context, the system evaluates the situational awareness of the operator relative to the operational context, e.g., perceptive of the operational context; comprehending the operational context and its implications, and projecting the operator's perception and comprehension into responsive action and second-order ramifications according to task models indicative of expected behavior.
-
7.
公开(公告)号:US11978334B2
公开(公告)日:2024-05-07
申请号:US17733111
申请日:2022-04-29
发明人: Arjun Harsha Rao , Timothy J. Wittkop , Christopher L George , Michael P. Matessa , Peggy Wu , Wade T. Johnson , Sarah Barber , Felix B. Turcios , Bryan C. Schultz
CPC分类号: G08B6/00 , G02B27/0093 , G02B27/0101 , G02B27/017 , G02B27/0179 , G08G5/0021 , G08G5/0078 , G08G5/0091 , G08G5/045 , G02B2027/014 , G02B2027/0187
摘要: A system may include a vehicle. The vehicle may include an array of haptic devices. The system may further include at least one processor configured to: determine a location of an object or occurrence relative to the user; based at least on the location of the object or occurrence relative to the user, select at least one haptic device of the array of haptic devices to be driven and function as a directional haptic alert to the user, wherein the directional haptic alert is indicative of a direction from the user toward the object or occurrence; and output at least one command to cause a driving of the selected at least one haptic device, wherein the driving of the selected at least one haptic device is perceivable by the user as the directional haptic alert.
-
8.
公开(公告)号:US20230043771A1
公开(公告)日:2023-02-09
申请号:US17518363
申请日:2021-11-03
发明人: Peggy Wu , Ahmad F. Osman
摘要: A system and method for continuous real-time assessment of the situational awareness of an aircraft operator incorporates gaze sensors to determine the current gaze target (or sequence of gaze targets) of the operator, e.g., which interfaces the operator is looking at. The system receives operational context from aircraft systems indicative of current events and conditions both internal and external to the aircraft (e.g., operational status, mission or flight plan objectives, weather conditions). Based on the determined gaze targets and coterminous operational context, the system evaluates the situational awareness of the operator relative to the operational context, e.g., perceptive of the operational context; comprehending the operational context and its implications, and projecting the operator's perception and comprehension into responsive action and second-order ramifications according to task models indicative of expected behavior.
-
公开(公告)号:US20220392354A1
公开(公告)日:2022-12-08
申请号:US17744357
申请日:2022-05-13
发明人: Arjun Harsha Rao , Peggy Wu , Christopher L George , Timothy J. Wittkop , Michael P. Matessa , Wade T. Johnson
摘要: A context driven alerting system and method is described in accordance with one or more embodiments of the present disclosure. The alerting system and method may consider a pilot's physiological, psychological, and behavioral state during a given mission context. The system may include biometric information which is fused with a context of the flight. The context may be based on one or more of a mission profile data or an aircraft state data. The fused data may be time synchronized and provided to an alerting algorithm. The alerting algorithm may then provide an alert to the pilot which includes a priority, intensity, frequency, or modality determined based on the fused information.
-
公开(公告)号:US20220392261A1
公开(公告)日:2022-12-08
申请号:US17734860
申请日:2022-05-02
发明人: Christopher L George , Arjun Harsha Rao , Timothy J. Wittkop , Wade T. Johnson , Peggy Wu , Michael P. Matessa
摘要: An aircraft-based pilot safety system (PSS) includes cameras or other gaze sensors fixed at an aircraft pilot and configured to capture an image stream focused on the pilot's eyes. The gaze sensors continually assess the gaze direction of the pilot (e.g., toward a display, instrument panel, and/or indicator within the cockpit that the pilot is currently looking at or focusing on) and thereby can establish when the pilot is executing a scan pattern and if that scan pattern is nominal for the current flight context by comparing the scan pattern to context-specific reference scan patterns. If, for example, the pilot's gaze deviates from where it should be (e.g., as determined by the current flight segment) or the current scan pattern is interrupted, the system may prompt the pilot to redirect their gaze or resume the scan pattern.
-
-
-
-
-
-
-
-
-