System and method for identifying a camera pose of a forward facing camera in a vehicle

    公开(公告)号:US10726576B2

    公开(公告)日:2020-07-28

    申请号:US16312458

    申请日:2017-06-29

    摘要: A method includes capturing images of a vehicle driver's face from a driver facing camera and images of a forward road scene from a forward facing camera. The images are analyzed to derive gaze direction data in a vehicle frame of reference. The gaze direction data are statistically collated to determine a frequency distribution of gaze angles. One or more peaks in the frequency distribution are identified and associated with corresponding reference points in the images to determine one or more reference gaze positions in the vehicle frame of reference. The one or more reference gaze positions are correlated with a position of the reference points in a forward facing camera frame of reference to determine a camera pose of a forward facing camera in the vehicle frame of reference.

    High performance imaging system using a dielectric metasurface

    公开(公告)号:US11431889B2

    公开(公告)日:2022-08-30

    申请号:US16772861

    申请日:2018-12-07

    发明人: John Noble

    摘要: Described herein is an imaging system (200) for a driver monitoring system (100). The imaging system (200) includes a light source (108) for generating an input light beam (202) and projecting the input light beam (202) along a path towards a driver (102) of a vehicle. System (200) also includes a dielectric metasurface (201) positioned within the path of the input light beam (202). The metasurface (201) has a two dimensional array of surface elements configured to impose predetermined phase, polarization and/or intensity changes to the input light beam (202) to generate an output light beam (204) for illuminating the driver (102). System (200) further includes an image sensor (106) configured to image reflected light (208) being light from the output light beam (204) that is reflected from the driver.

    SYSTEM AND METHOD FOR IDENTIFYING A CAMERA POSE OF A FORWARD FACING CAMERA IN A VEHICLE

    公开(公告)号:US20190266751A1

    公开(公告)日:2019-08-29

    申请号:US16312458

    申请日:2017-06-29

    IPC分类号: G06T7/73 G06K9/00 H04N5/247

    摘要: A method includes capturing images of a vehicle driver's face from a driver facing camera and images of a forward road scene from a forward facing camera. The images are analyzed to derive gaze direction data in a vehicle frame of reference. The gaze direction data are statistically collated to determine a frequency distribution of gaze angles. One or more peaks in the frequency distribution are identified and associated with corresponding reference points in the images to determine one or more reference gaze positions in the vehicle frame of reference. The one or more reference gaze positions are correlated with a position of the reference points in a forward facing camera frame of reference to to determine a camera pose of a forward facing camera in the vehicle frame of reference.

    Driver attention state estimation

    公开(公告)号:US11455810B2

    公开(公告)日:2022-09-27

    申请号:US17280591

    申请日:2019-09-30

    摘要: A disclosed system is configured to estimate an attention state of a subject within a scene. An imaging camera captures digital images of the subject and one or more light sources illuminate the subject during a period in which the digital images are captured. The system also includes a processor that processes the captured images to generate subject attention data of the subject. The processor further generates a primary visual attention ray of the subject from current subject attention data; generates a distribution of visual attention rays having an origin common to the primary visual attention ray; projects the visual attention rays onto a digital representation of the scene having a plurality of predefined regions of interest; determines an intersection of the projected visual attention rays with one or more of the regions of interest; and based on the intersection, estimates an attention state of the subject's attention.

    Camera registration in a multi-camera system

    公开(公告)号:US11017558B2

    公开(公告)日:2021-05-25

    申请号:US16313317

    申请日:2017-06-29

    摘要: Described herein is a method of registering a position and an orientation of one or more cameras in a camera imaging system. The method includes: receiving, from a depth imaging device, data indicative of a three dimensional image of the scene. The three dimensional image is calibrated with a reference frame relative to the scene. The reference frame includes a reference position and reference orientation. A three dimensional position of each of the cameras within the three dimensional image is determined relative to the reference frame. An orientation of each camera is determined to relative to the reference frame. The position and orientation of each camera is combined to determine a camera pose relative to the reference frame.

    System and method for improving signal to noise ratio in object tracking under poor light conditions

    公开(公告)号:US11386709B2

    公开(公告)日:2022-07-12

    申请号:US16759951

    申请日:2018-07-27

    发明人: John Noble

    摘要: Described herein is a system and method for performing eye tracking. One embodiment provides a system (100) including a camera (106) for capturing images of a vehicle driver's (102) eye and light emitting diodes (LEDs—108 and 110) configured to selectively illuminate the driver's eye during image capture by the camera (106). A processor (118) is configured to process at least a subset of the captured images to determine one or more eye tracking parameters of the subjects eye and to determine one or more illumination characteristics of the images. A controller (120) is configured to send an LED control signal to the LEDs (108 and 110) to control the drive current amplitude and pulse time of the LEDs (108 and 110). The controller (120) selectively adjusts the drive current amplitude and/or pulse time based on the determined illumination characteristics of a previous captured image or images.

    Method and system of distinguishing between a glance event and an eye closure event

    公开(公告)号:US11144756B2

    公开(公告)日:2021-10-12

    申请号:US16091356

    申请日:2017-03-30

    IPC分类号: G06K9/00

    摘要: Described herein are methods and systems of distinguishing between a glance event and an eye closure event in a subject monitoring system. A method includes capturing a number of images of the subject's face including at least one eye of the subject over a period of time; processing the images to determine a closure state of at least one eye; detecting potential eye closure events in which the closure state of at least one eye is determined to be in a closed state; for corresponding detected potential eye closure event, determining a head pitch angle of the subject and classifying the potential eye closure event as a glance event if a head pitch angle of the subject is detected to change by an angle greater than a predetermined head pitch angle and otherwise classifying the potential eye closure event as an eye closure event.

    Systems and methods for identifying pose of cameras in a scene

    公开(公告)号:US10909721B2

    公开(公告)日:2021-02-02

    申请号:US16311471

    申请日:2017-06-29

    摘要: Described herein are systems and methods of determining a pose of a camera within a vehicle scene. In one embodiment, a method includes the initial step of capturing an image of the vehicle scene from the camera. At step, reference data indicative of the vehicle scene is loaded, the reference data includes positions and orientations of known features within the vehicle scene. Next, at step, the geometric appearance of one or more of the known features is identified within the image. Finally, at step, the three dimensional position and orientation of the camera relative to the known features identified in step c) is determined from the geometric appearance, and a pose of the camera within the vehicle scene is calculated.

    CAMERA REGISTRATION IN A MULTI-CAMERA SYSTEM
    10.
    发明申请

    公开(公告)号:US20190164310A1

    公开(公告)日:2019-05-30

    申请号:US16313317

    申请日:2017-06-29

    摘要: Described herein is a method of registering a position and an orientation of one or more cameras in a camera imaging system. The method includes: receiving, from a depth imaging device, data indicative of a three dimensional image of the scene. The three dimensional image is calibrated with a reference frame relative to the scene. The reference frame includes a reference position and reference orientation. A three dimensional position of each of the cameras within the three dimensional image is determined relative to the reference frame. An orientation of each camera is determined to relative to the reference frame. The position and orientation of each camera is combined to determine a camera pose relative to the reference frame.