-
1.
公开(公告)号:US11734841B2
公开(公告)日:2023-08-22
申请号:US17349952
申请日:2021-06-17
发明人: Yachong Xue , Hao Zhang , Lili Chen , Jiankang Sun , Guixin Yan , Xiaolei Liu , Yaoyu Lv , Menglei Zhang , Xinkai Li
CPC分类号: G06T7/292 , G06F3/013 , G06T3/40 , G06T7/73 , G06V40/161 , G06V40/19 , H04N23/90 , G06T2207/20212 , G06T2207/30201
摘要: A method for tracking eye gaze, a system, a processing device and a computer readable storage medium are provided. The method includes: acquiring original images acquired by multiple image acquisition devices, splicing the multiple original images into a spliced image, and determining a responsible region of each image acquisition device in the spliced image; performing preliminary face locating on the spliced image, and determining one or more original images corresponding to a preliminarily located face position according to the preliminarily located face position and the responsible region; and performing secondary face locating on the one or more determined original images to obtain face pose information and a positional relation of pupils with respect to human eyes, and calculating coordinates of gaze points of the human eyes according to the obtained face pose information and the positional relation of the pupils with respect to the human eyes.
-
公开(公告)号:US11699303B2
公开(公告)日:2023-07-11
申请号:US17319933
申请日:2021-05-13
发明人: Yachong Xue , Hao Zhang , Lili Chen , Jiankang Sun , Xinkai Li , Guixin Yan , Xiaolei Liu , Yaoyu Lv , Menglei Zhang
CPC分类号: G06V40/193 , G06T7/80 , G06V40/171 , G06V40/19
摘要: A system and a method of calculating coordinates of a pupil center point are provided. The system for acquiring the coordinates of the pupil center point includes a first camera, a second camera, a storage and a processor. The first camera is configured to capture a first image including a face and output the first image to the processor, the second camera is configured to capture a second image including a pupil and output the second image to the processor, a resolution of the first camera is smaller than a resolution of the second camera, and the storage is configured to store processing data, and the processor is configured to: acquire the first image and the second image; extract a first eye region corresponding to an eye from the first image; convert the first eye region into the second image, to acquire a second eye region corresponding to the eye in the second image; and detect a pupil in the second eye region and acquire the coordinates of the pupil center point.
-
3.
公开(公告)号:US11579466B2
公开(公告)日:2023-02-14
申请号:US17288722
申请日:2020-08-13
发明人: Yaoyu Lv , Hongzhen Xue , Guixin Yan , Fuqiang Ma , Lili Chen , Hao Zhang , Zhanshan Ma , Shuo Zhang
IPC分类号: G02B30/54 , H04N13/393 , G02B30/52 , G06T17/20
摘要: A method of simulating volumetric 3D display, includes: acquiring a display variable of a virtual display screen in a volumetric 3D display simulation space, the virtual display screen comprising a plurality of stereo pixels, the display variable comprising a voxel parameter of the plurality of stereo pixels, and the voxel parameter comprising a size in a first direction of the plurality of stereo pixels, a size in a second direction of the plurality of stereo pixels, and a size in a third direction of the plurality of stereo pixels; determining a display state parameter of a first stereo pixel of the plurality of stereo pixels for an object to be displayed according to the display variable; and simulating display of the object to be displayed according to the display state parameter. A computer-readable storage medium and a volumetric 3D display simulation apparatus are further provided.
-
公开(公告)号:US11373337B2
公开(公告)日:2022-06-28
申请号:US16332113
申请日:2018-08-15
发明人: Jinghua Miao , Hao Zhang , Lili Chen , Yukun Sun , Yali Liu , Xi Li , Bin Zhao , Xuefeng Wang , Lixin Wang , Jianwen Suo , Wenyu Li , Ziqiang Guo , Ruifeng Qin , Guixin Yan , Feng Pan
摘要: The present disclosure is related to an image processing method of virtual reality. The image processing method may include obtaining position information of a gaze point; performing a compression process on an original image to obtain a compressed image based on the position information of the gaze point; performing a compression process on a distorted image of the original image in an lens to obtain a compressed distorted image based on the position information of the gaze point; and performing an anti-distortion process on the compressed image to obtain an anti-distortion image based on a relationship between the compressed image and the compressed distorted image. The position information of the gaze point may be position information of a gaze point of a user's eye on an original image.
-
5.
公开(公告)号:US20190304130A1
公开(公告)日:2019-10-03
申请号:US16177356
申请日:2018-10-31
发明人: Minglei Chu , Hao Zhang , Lili Chen , Guixin Yan , Bin Zhao , Ziqiang Guo , Jian Sun , Wenhong Tian , Xinjian Liu , Zhanshan Ma , Jiankang Sun
IPC分类号: G06T7/73
摘要: A spatial positioning method, a spatial positioning device, a spatial positioning system, and a computer readable storage medium are disclosed. The spatial positioning method includes: acquiring a two-dimensional image of an object to be positioned having a plurality of marking points, the two-dimensional image comprising a plurality of marking point images in one-to-one correspondence with the plurality of marking points; determining a correspondence between the plurality of marking points and the plurality of marking point images according to a relative positional relationship among the plurality of marking points and a relative positional relationship among the plurality of marking point images; and determining at least one spatial degree of freedom of the object to be positioned according to the relative positional relationship among the plurality of marking points, the relative positional relationship among the plurality of marking point images, and the correspondence between the plurality of marking points and the plurality of marking point images.
-
公开(公告)号:US12039947B2
公开(公告)日:2024-07-16
申请号:US17416455
申请日:2020-12-29
发明人: Yinwei Chen , Guixin Yan , Jian Sang , Tiankuo Shi
IPC分类号: G09G3/36 , G02F1/13 , G02F1/1335 , G02F1/13357 , G02F1/1347 , G09G3/20
CPC分类号: G09G3/3607 , G02F1/1323 , G02F1/133531 , G02F1/13362 , G02F1/1347 , G09G3/2096 , G02F1/133504 , G09G2330/021 , G09G2358/00
摘要: The present disclosure discloses a display device and a driving method thereof. The driving method includes: when an anti-peep mode is enabled, generating M-frame sub-picture information and M-frame raster picture information according to information of a current picture frame to be displayed; controlling a sub-display panel in the display device to sequentially display M sub-pictures according to the M-frame sub-picture information, controlling pixel rows of the sub-pictures to be periodically arranged and displayed as first pixel groups, and controlling the first pixel groups of the pixel rows corresponding to the sub-pictures to be mutually misaligned; and controlling a sub-raster panel in the display device to sequentially display M raster pictures according to the M-frame raster picture information, and controlling pixel rows of the raster pictures to be periodically arranged and displayed as second pixel groups.
-
公开(公告)号:US11610380B2
公开(公告)日:2023-03-21
申请号:US16700039
申请日:2019-12-02
发明人: Guixin Yan , Hao Zhang , Lili Chen , Minglei Chu , Wenhong Tian , Zhanshan Ma , Ziqiang Guo
IPC分类号: G06T19/20 , H04N13/302 , G02B30/26 , H04N13/117
摘要: A method for interacting with an autostereoscopic display is disclosed. The method includes initiating displaying by the autostereoscopic display a left eye view and a right eye view that contain a virtual manipulated object, determining a real-world coordinate of the virtual manipulated object perceived by a user located at a predetermined viewing position of the auto stereoscopic display, receiving an interactive action of the user's manipulating body acquired by a motion tracker, where the interaction action includes a real-world coordinate of the manipulating body, determining whether an interaction condition is triggered based at least in part on the real-world coordinate of the virtual manipulated object and the real-world coordinate of the manipulating body, and refreshing the left eye view and the right eye view based on the interactive action of the manipulating body acquired by the motion tracker, in response to determining that the interaction condition is triggered.
-
公开(公告)号:US20210223859A1
公开(公告)日:2021-07-22
申请号:US16305882
申请日:2018-01-30
发明人: Jiankang Sun , Hao Zhang , Lili Chen , Minglei Chu , Jian Sun , Ziqiang Guo , Guixin Yan , Yakun Wang
摘要: Embodiments of the present disclosure provide a method and a device for determining a gaze placement and a computer readable storage medium. The method comprises acquiring an ocular image of a subject; determining at least one gaze characteristic vector based on an ocular image; determining a gaze placement of the subject, according to a gaze estimation model and the at least one characteristic vector. The characteristic vector comprises at least one of: a first characteristic vector from a first reference speckle center to a pupil center, wherein the first reference speckle is formed by a first reference source in the ocular image; a second characteristic vector from the pupil center to a second reference speckle center, wherein the second reference speckle is formed by a second reference source in the ocular image; a third characteristic vector from the second reference speckle center to the first reference speckle center.
-
公开(公告)号:US10971108B2
公开(公告)日:2021-04-06
申请号:US16523118
申请日:2019-07-26
发明人: Minglei Chu , Lili Chen , Hao Zhang , Zehua Dong , Guixin Yan , Jinghua Miao
摘要: This disclosure relates to an image display method and apparatus, an electronic device, a VR device, and a non-transitory computer-readable storage medium. An image display method applied to a VR device comprises: determining an activity state of the VR device according to measurement data of a sensor within the VR device; determining a processing mode of a current frame image to be displayed according to the activity state, wherein the processing mode is one of a flicker suppression process and a forwarding process; and processing the current frame image to be displayed according to the processing mode to obtain a current frame image for a display in the VR device, and sending it to the display.
-
公开(公告)号:US20210049760A1
公开(公告)日:2021-02-18
申请号:US16935327
申请日:2020-07-22
发明人: Guixin Yan , Minglei Chu , Hao Zhang , Lili Chen , Xue Dong
摘要: The present disclosure provides a sight line detection method, a sight line detection device, a computer readable storage medium, and a computer device. The sight line detection method comprises: receiving an image of a user taken by a camera; acquiring a plurality of face feature points according to the image of the user; calculating an eye center position and a pupil position based on the plurality of face feature points; obtaining an eye sight line based on the eye center position and obtaining a camera sight line base on the pupil position; and determining whether the eye sight line coincides with the camera sight line, and in a case where the eye sight line coincides with the camera sight line, performing a sight line detection with the eye sight line coincided with the camera sight line as a reference line.
-
-
-
-
-
-
-
-
-