-
公开(公告)号:US20240341648A1
公开(公告)日:2024-10-17
申请号:US18644889
申请日:2024-04-24
CPC分类号: A61B5/163 , A61B5/7267 , A61B5/7435
摘要: Systems and methods are provided for collecting eye-gaze data for training an eye-gaze prediction model. The collecting includes selecting a scan path passing through a series of regions of a grid on a screen of a computing device, moving a symbol as an eye-gaze target along the scan path, and receiving facial images at eye-gaze points. The eye-gaze points are uniformly distributed within the respective regions. Areas of the regions that are adjacent to edges and corners of the screen are smaller than other regions. The difference in areas shifts centers of the regions toward the edges, density of data closer to the edges. The scan path passes through locations in proximity to the edges and corners of the screen for capturing more eye-gaze points in the proximity. The methods interactively enhance variations of facial images by displaying instructions to the user to make specific actions associated with the face.
-
公开(公告)号:US20190034057A1
公开(公告)日:2019-01-31
申请号:US15840477
申请日:2017-12-13
发明人: Dmytro RUDCHENKO , Eric N. BADGER , Akhilesh KAZA , Jacob Daniel COHEN , Peter John ANSELL , Jonathan T. CAMPBELL , Harish S. KULKARNI
IPC分类号: G06F3/0481 , G06F3/01 , G06F3/0488
摘要: Systems and methods disclosed herein relate to assigning dynamic eye-gaze dwell-times. Dynamic dwell-times may be tailored to the individual user. For example, a dynamic dwell-time system may be configured to receive data from the user, such as the duration of time the user takes to execute certain actions within applications (e.g., read a word suggestion before actually selecting it). The dynamic dwell-time system may also prevent users from making unintended selections by providing different dwell times for different buttons. Specifically, on a user interface, longer dwell times may be established for the critical keys (e.g., “close” program key, “send” key, word suggestions, and the like) and shorter dwell times may be established for the less critical keys (e.g., individual character keys on a virtual keyboard, spacebar, backspace, and the like).
-
公开(公告)号:US20230195224A1
公开(公告)日:2023-06-22
申请号:US18113222
申请日:2023-02-23
CPC分类号: G06F3/013 , G06F3/012 , G06N3/04 , G06N3/08 , G06T7/73 , G06T2207/10024 , G06T2207/20084 , G06T2207/30201
摘要: Systems and methods are provided for predicting an eye gaze location of an operator of a computing device. In particular, the method generates an image grid that includes regions of interest based on a facial image. The facial image is based on a received image frame of a video stream that captures the operator using the computing device. The image grid further includes a region that indicate rotation information of the face. The method further uses a combination of trained neural networks to extract features of the regions of interest in the image grid and predict the eye gaze location on the screen of the computing device. The trained set of neural networks includes a convolutional neural network. The method optionally generate head pose pitch, roll, and yaw information to improve accuracy of predicting the location of an eye gaze.
-
公开(公告)号:US20220334637A1
公开(公告)日:2022-10-20
申请号:US17234493
申请日:2021-04-19
摘要: Systems and methods are provided for predicting an eye gaze location of an operator of a computing device. In particular, the method generates an image grid that includes regions of interest based on a facial image. The facial image is based on a received image frame of a video stream that captures the operator using the computing device. The image grid further includes a region that indicate rotation information of the face. The method further uses a combination of trained neural networks to extract features of the regions of interest in the image grid and predict the eye gaze location on the screen of the computing device. The trained set of neural networks includes a convolutional neural network. The method optionally generate head pose pitch, roll, and yaw information to improve accuracy of predicting the location of an eye gaze.
-
公开(公告)号:US20240211096A1
公开(公告)日:2024-06-27
申请号:US18537112
申请日:2023-12-12
发明人: Dmytro RUDCHENKO , Eric N. BADGER , Akhilesh KAZA , Jacob Daniel COHEN , Peter John ANSELL , Jonathan T. CAMPBELL , Harish S. KULKARNI
IPC分类号: G06F3/04817 , G06F3/01 , G06F3/0481 , G06F3/04886 , G06F40/274 , G06N20/00
CPC分类号: G06F3/04817 , G06F3/013 , G06F3/0481 , G06F3/04886 , G06F40/274 , G06N20/00
摘要: Systems and methods disclosed herein relate to assigning dynamic eye-gaze dwell-times. Dynamic dwell-times may be tailored to the individual user. For example, a dynamic dwell-time system may be configured to receive data from the user, such as the duration of time the user takes to execute certain actions within applications (e.g., read a word suggestion before actually selecting it). The dynamic dwell-time system may also prevent users from making unintended selections by providing different dwell times for different buttons. Specifically, on a user interface, longer dwell times may be established for the critical keys (e.g., “close” program key, “send” key, word suggestions, and the like) and shorter dwell times may be established for the less critical keys (e.g., individual character keys on a virtual keyboard, spacebar, backspace, and the like).
-
公开(公告)号:US20240152205A1
公开(公告)日:2024-05-09
申请号:US18414641
申请日:2024-01-17
发明人: Narasimhan RAGHUNATH , Austin B. HODGES , Fei SU , Akhilesh KAZA , Peter John ANSELL , Jonathan T. CAMPBELL , Harish S. KULKARNI
IPC分类号: G06F3/01 , G06F3/0481 , G06F3/04842 , G06F3/04886
CPC分类号: G06F3/013 , G06F3/0481 , G06F3/04842 , G06F3/04886 , G06F40/274
摘要: Systems and methods disclosed herein are related to an intelligent UI element selection system using eye-gaze technology. In some example aspects, a UI element selection zone may be determined. The selection zone may be defined as an area surrounding a boundary of the UI element. Gaze input may be received and the gaze input may be compared with the selection zone to determine an intent of the user. The gaze input may comprise one or more gaze locations. Each gaze location may be assigned a value according to its proximity to the UI element and/or its relation to the UI element's selection zone. Each UI element may be assigned a threshold. If the aggregated value of gaze input is equal to or greater than the threshold for the UI element, then the UI element may be selected.
-
公开(公告)号:US20220330863A1
公开(公告)日:2022-10-20
申请号:US17234568
申请日:2021-04-19
摘要: Systems and methods are provided for collecting eye-gaze data for training an eye-gaze prediction model. The collecting includes selecting a scan path that passes through a series of regions of a grid on a screen of a computing device, moving a symbol as an eye-gaze target along the scan path, and receiving facial images at eye-gaze points. The eye-gaze points are uniformly distributed within the respective regions. Areas of the regions that are adjacent to edges and corners of the screen are smaller than other regions. The difference in areas shifts centers of the regions toward the edges, density of data closer to the edges. The scan path passes through locations in proximity to the edges and corners of the screen for capturing more eye-gaze points in the proximity. The methods interactively enhance variations of facial images by displaying instructions to the user to make specific actions associated with the face.
-
公开(公告)号:US20210325962A1
公开(公告)日:2021-10-21
申请号:US17362156
申请日:2021-06-29
发明人: Narasimhan RAGHUNATH , Austin B. HODGES , Fei SU , Akhilesh KAZA , Peter John ANSELL , Jonathan T. CAMPBELL , Harish S. KULKARNI
IPC分类号: G06F3/01 , G06F3/0484 , G06F3/0481 , G06F3/0488
摘要: Systems and methods disclosed herein are related to an intelligent UI element selection system using eye-gaze technology. In some example aspects, a UI element selection zone may be determined. The selection zone may be defined as an area surrounding a boundary of the UI element. Gaze input may be received and the gaze input may be compared with the selection zone to determine an intent of the user. The gaze input may comprise one or more gaze locations. Each gaze location may be assigned a value according to its proximity to the UI element and/or its relation to the UI element's selection zone. Each UI element may be assigned a threshold. If the aggregated value of gaze input is equal to or greater than the threshold for the UI element, then the UI element may be selected.
-
公开(公告)号:US20210318794A1
公开(公告)日:2021-10-14
申请号:US17357107
申请日:2021-06-24
发明人: Dmytro RUDCHENKO , Eric N. BADGER , Akhilesh KAZA , Jacob Daniel COHEN , Peter John ANSELL , Jonathan T. CAMPBELL , Harish S. KULKARNI
IPC分类号: G06F3/0481 , G06F3/01 , G06F3/0488
摘要: Systems and methods disclosed herein relate to assigning dynamic eye-gaze dwell-times. Dynamic dwell-times may be tailored to the individual user. For example, a dynamic dwell-time system may be configured to receive data from the user, such as the duration of time the user takes to execute certain actions within applications (e.g., read a word suggestion before actually selecting it). The dynamic dwell-time system may also prevent users from making unintended selections by providing different dwell times for different buttons. Specifically, on a user interface, longer dwell times may be established for the critical keys (e.g., “close” program key, “send” key, word suggestions, and the like) and shorter dwell times may be established for the less critical keys (e.g., individual character keys on a virtual keyboard, spacebar, backspace, and the like).
-
公开(公告)号:US20190033965A1
公开(公告)日:2019-01-31
申请号:US15840098
申请日:2017-12-13
发明人: Narasimhan RAGHUNATH , Austin B. HODGES , Fei SU , Akhilesh KAZA , Peter John ANSELL , Jonathan T. CAMPBELL , Harish S. KULKARNI
IPC分类号: G06F3/01 , G06F3/0488 , G06F3/0484
摘要: Systems and methods disclosed herein are related to an intelligent UI element selection system using eye-gaze technology. In some example aspects, a UI element selection zone may be determined. The selection zone may be defined as an area surrounding a boundary of the UI element. Gaze input may be received and the gaze input may be compared with the selection zone to determine an intent of the user. The gaze input may comprise one or more gaze locations. Each gaze location may be assigned a value according to its proximity to the UI element and/or its relation to the UI element's selection zone. Each UI element may be assigned a threshold. If the aggregated value of gaze input is equal to or greater than the threshold for the UI element, then the UI element may be selected.
-
-
-
-
-
-
-
-
-