-
公开(公告)号:US11662814B2
公开(公告)日:2023-05-30
申请号:US17555230
申请日:2021-12-17
发明人: Jiankang Sun , Hao Zhang , Lili Chen , Yachong Xue , Xinkai Li
CPC分类号: G06F3/013 , G06T7/70 , G06T2207/10048
摘要: A sight positioning method, a head-mounted display device, a computer device, and a computer-readable storage medium are provided. The method includes: determining a first transform relation and a second transform relation, where the first transform relation is a transform relation between an image coordinate system and a light source coordinate system, and the second transform relation is a transform relation between the light source coordinate system and a display unit coordinate system; calculating coordinates of a pupil center in the image coordinate system according to an eye image of eyes of a user acquired by the image acquisition equipment; and obtaining coordinates of the pupil center serving as a fixation point position in the display unit coordinate system of the display unit according to the coordinates of the pupil center in the image coordinate system, the first transform relation and the second transform relation.
-
2.
公开(公告)号:US11734841B2
公开(公告)日:2023-08-22
申请号:US17349952
申请日:2021-06-17
发明人: Yachong Xue , Hao Zhang , Lili Chen , Jiankang Sun , Guixin Yan , Xiaolei Liu , Yaoyu Lv , Menglei Zhang , Xinkai Li
CPC分类号: G06T7/292 , G06F3/013 , G06T3/40 , G06T7/73 , G06V40/161 , G06V40/19 , H04N23/90 , G06T2207/20212 , G06T2207/30201
摘要: A method for tracking eye gaze, a system, a processing device and a computer readable storage medium are provided. The method includes: acquiring original images acquired by multiple image acquisition devices, splicing the multiple original images into a spliced image, and determining a responsible region of each image acquisition device in the spliced image; performing preliminary face locating on the spliced image, and determining one or more original images corresponding to a preliminarily located face position according to the preliminarily located face position and the responsible region; and performing secondary face locating on the one or more determined original images to obtain face pose information and a positional relation of pupils with respect to human eyes, and calculating coordinates of gaze points of the human eyes according to the obtained face pose information and the positional relation of the pupils with respect to the human eyes.
-
公开(公告)号:US11699303B2
公开(公告)日:2023-07-11
申请号:US17319933
申请日:2021-05-13
发明人: Yachong Xue , Hao Zhang , Lili Chen , Jiankang Sun , Xinkai Li , Guixin Yan , Xiaolei Liu , Yaoyu Lv , Menglei Zhang
CPC分类号: G06V40/193 , G06T7/80 , G06V40/171 , G06V40/19
摘要: A system and a method of calculating coordinates of a pupil center point are provided. The system for acquiring the coordinates of the pupil center point includes a first camera, a second camera, a storage and a processor. The first camera is configured to capture a first image including a face and output the first image to the processor, the second camera is configured to capture a second image including a pupil and output the second image to the processor, a resolution of the first camera is smaller than a resolution of the second camera, and the storage is configured to store processing data, and the processor is configured to: acquire the first image and the second image; extract a first eye region corresponding to an eye from the first image; convert the first eye region into the second image, to acquire a second eye region corresponding to the eye in the second image; and detect a pupil in the second eye region and acquire the coordinates of the pupil center point.
-
4.
公开(公告)号:US12020655B2
公开(公告)日:2024-06-25
申请号:US18014184
申请日:2021-08-16
发明人: Yachong Xue , Xue Dong , Hao Zhang , Lili Chen , Jiankang Sun , Guixin Yan , Yaoyu Lv , Menglei Zhang , Xinkai Li
CPC分类号: G09G3/3426 , G06F3/013 , G09G2320/0626 , G09G2320/0686 , G09G2354/00 , G09G2360/16
摘要: Provided is a method for controlling a display apparatus. In the method, the display apparatus receives at least two pieces of data to be displayed from at least two terminals respectively, wherein the at least two pieces of data to be displayed include screen projection data and status parameters of the at least two terminals, and then displays the status parameter, and performs a screen projection based on the screen projection data.
-
公开(公告)号:US11941171B1
公开(公告)日:2024-03-26
申请号:US17765612
申请日:2021-05-28
发明人: Menglei Zhang , Jiankang Sun , Guixin Yan , Yaoyu Lv , Yachong Xue , Xinkai Li
IPC分类号: G06F3/01 , G06T7/215 , G06T7/292 , G06T7/73 , G06T11/00 , G06V10/22 , G06V10/764 , G06V10/82 , G06V40/10
CPC分类号: G06F3/013 , G06T7/215 , G06T7/292 , G06T7/74 , G06T11/00 , G06V10/235 , G06V10/764 , G06V10/82 , G06V40/10 , G06T2207/20084 , G06T2207/30201
摘要: An eye gaze tracking method, apparatus and system are provided, which belong to the technical field of image processing. The eye gaze tracking method includes: capturing, by at least two cameras, frames of facial images when a viewer views display screen; segmenting a current frame of facial image with pre-trained eye detection model to obtain an image for left and right eyes; calculating a similarity between the current frame of facial image and each of previous N frames of facial images; if the similarity between the current frame of facial image and each of previous N frames of facial images is less than the preset threshold, detecting a position on display screen at which the eyes of the viewer gaze with pre-trained eye detection model. Embodiments of the present disclosure can improve accuracy and efficiency of eye gaze tracking.
-
-
-
-