-
公开(公告)号:US20200262347A1
公开(公告)日:2020-08-20
申请号:US15929460
申请日:2020-05-04
Applicant: Magna Electronics Inc.
Inventor: Nikhil Gupta , Hilda Faraji , Daan He , Ghanshyam Rathi
Abstract: A method for dynamically calibrating a vehicular camera includes disposing a camera at a vehicle and operating the camera to capture multiple frames of image data while the vehicle is in motion and is steered within at least two ranges of steering angles. Feature points are determined in an image frame when the vehicle is steered within a respective range of steering angles, and motion trajectories of those feature points are tracked in subsequent image frames for the respective range of steering angles. A horizon line is determined based on the tracked feature points. Responsive to determination that the determined horizon line is non-parallel to the horizontal axis of the image plane, at least one of pitch, roll or yaw of the camera is adjusted. Image data captured by the camera is processed at the control for object detection.
-
公开(公告)号:US11554717B2
公开(公告)日:2023-01-17
申请号:US17302933
申请日:2021-05-17
Applicant: MAGNA ELECTRONICS INC.
Inventor: Nikhil Gupta , Hilda Faraji , Daan He , Ghanshyam Rathi
Abstract: A vehicular vision system includes a camera disposed at a vehicle and operable to capture multiple frames of image data during a driving maneuver of the vehicle. A control includes an image processor that processes frames of captured image data to determine feature points in an image frame when the vehicle is operated within a first range of steering angles, and to determine motion trajectories of those feature points in subsequent image frames for the respective range of steering angles. The control determines a horizon line based on the determined motion trajectories. Responsive to determination that the determined horizon line is non-parallel to the horizontal axis of the image plane, at least one of pitch, roll or yaw of the camera is adjusted. Image data captured by the camera is processed at the control for object detection.
-
公开(公告)号:US10919458B2
公开(公告)日:2021-02-16
申请号:US15929700
申请日:2020-05-18
Applicant: MAGNA ELECTRONICS INC.
Inventor: Nikhil Gupta , Hilda Faraji , Daan He , Ghanshyam Rathi
Abstract: A method for calibrating a vehicular camera includes providing at least a front or rear camera and a side camera with overlapping fields of view, and calibrating the front or rear camera, capturing a calibrated frame of image data with the front or rear camera, and capturing a sideward frame of image data with a side camera. At least one feature is determined present in the overlapping region of the calibrated frame, and pixel positions of the determined feature are predicted for the side camera. Misalignment of the side camera is determined based on a comparison of the predicted pixel positions of the determined feature to the pixel positions of the determined feature in the sideward frame of image data captured by the side camera. Processing of image data captured by the side camera is adjusted to accommodate the determined misalignment.
-
公开(公告)号:US20180086284A1
公开(公告)日:2018-03-29
申请号:US15830116
申请日:2017-12-04
Applicant: MAGNA ELECTRONICS INC.
Inventor: Nikhil Gupta , Hilda Faraji , Daan He , Ghanshyam Rathi
CPC classification number: B60R11/04 , B60R2300/105 , B60R2300/303 , G03B43/00 , G06T3/4038 , G06T7/80 , G06T7/85 , G06T2207/30252 , H04N17/002
Abstract: A method for dynamically ascertaining alignment of a vehicular camera relative to a vehicle to which the camera is attached includes determining a plurality of steering angle ranges for the vehicle, each of which is a range of steering angles that approximates straight vehicle motion over less than two seconds of travel time of the vehicle while the vehicle is in motion and turning. Image data captured by a camera of the vehicle is processed to determine a central vanishing point when the vehicle is in motion and moving straight. A plurality of feature points are selected in the image frames for each steering angle range, and a vanishing point for a plurality of tracked motion trajectories for each steering angle range is determined. An alignment of the camera is determined based at least in part on the determined central vanishing point and a determined vanishing line.
-
公开(公告)号:US11007934B2
公开(公告)日:2021-05-18
申请号:US15929460
申请日:2020-05-04
Applicant: MAGNA ELECTRONICS INC.
Inventor: Nikhil Gupta , Hilda Faraji , Daan He , Ghanshyam Rathi
Abstract: A method for dynamically calibrating a vehicular camera includes disposing a camera at a vehicle and operating the camera to capture multiple frames of image data while the vehicle is in motion and is steered within at least two ranges of steering angles. Feature points are determined in an image frame when the vehicle is steered within a respective range of steering angles, and motion trajectories of those feature points are tracked in subsequent image frames for the respective range of steering angles. A horizon line is determined based on the tracked feature points. Responsive to determination that the determined horizon line is non-parallel to the horizontal axis of the image plane, at least one of pitch, roll or yaw of the camera is adjusted. Image data captured by the camera is processed at the control for object detection.
-
公开(公告)号:US20210268962A1
公开(公告)日:2021-09-02
申请号:US17302933
申请日:2021-05-17
Applicant: MAGNA ELECTRONICS INC.
Inventor: Nikhil Gupta , Hilda Faraji , Daan He , Ghanshyam Rathi
Abstract: A vehicular vision system includes a camera disposed at a vehicle and operable to capture multiple frames of image data during a driving maneuver of the vehicle. A control includes an image processor that processes frames of captured image data to determine feature points in an image frame when the vehicle is operated within a first range of steering angles, and to determine motion trajectories of those feature points in subsequent image frames for the respective range of steering angles. The control determines a horizon line based on the determined motion trajectories. Responsive to determination that the determined horizon line is non-parallel to the horizontal axis of the image plane, at least one of pitch, roll or yaw of the camera is adjusted. Image data captured by the camera is processed at the control for object detection.
-
公开(公告)号:US20160267657A1
公开(公告)日:2016-09-15
申请号:US15161711
申请日:2016-05-23
Applicant: MAGNA ELECTRONICS INC.
Inventor: Nikhil Gupta , Hilda Faraji , Daan He , Ghanshyam Rathi
CPC classification number: B60R1/00 , B60R2300/105 , B60R2300/402 , B60R2300/8086 , B60R2300/8093 , G06T7/80 , G06T2207/30252 , H04N17/00 , H04N17/002
Abstract: A method for dynamically correcting misalignment of a vehicular camera includes fixedly disposing a camera at a vehicle and operating the camera to acquire multiple frames of image data whilst the vehicle is moving generally in a straight line. A plurality of sets of feature points are selected in an image frame, with each set including a first feature point and a second feature point. For each set of feature points, a motion trajectory of that set's feature points is tracked in subsequent image frames. For each tracked first and second feature points, a vanishing point is established in the image plane. Based on the established vanishing point, a vanishing line is determined in the image plane. When the vanishing line is determined to be non-horizontal in the image plane, at least one of pitch, roll or yaw of the camera is adjusted to correct rotational misalignment of the camera.
Abstract translation: 用于动态校正车辆摄像机的未对准的方法包括在车辆处固定地设置摄像机并且操作摄像机以在车辆大体上以直线移动时获取多帧图像数据。 在图像帧中选择多组特征点,其中每个集合包括第一特征点和第二特征点。 对于每组特征点,该集合的特征点的运动轨迹在随后的图像帧中被跟踪。 对于每个跟踪的第一和第二特征点,在图像平面中建立消失点。 基于已建立的消失点,在图像平面中确定消失线。 当消失线在图像平面中被确定为非水平时,调整照相机的俯仰,滚动或偏转中的至少一个以校正照相机的旋转未对准。
-
公开(公告)号:US20200276939A1
公开(公告)日:2020-09-03
申请号:US15929700
申请日:2020-05-18
Applicant: MAGNA ELECTRONICS INC.
Inventor: Nikhil Gupta , Hilda Faraji , Daan He , Ghanshyam Rathi
Abstract: A method for calibrating a vehicular camera includes providing at least a front or rear camera and a side camera with overlapping fields of view, and calibrating the front or rear camera, capturing a calibrated frame of image data with the front or rear camera, and capturing a sideward frame of image data with a side camera. At least one feature is determined present in the overlapping region of the calibrated frame, and pixel positions of the determined feature are predicted for the side camera. Misalignment of the side camera is determined based on a comparison of the predicted pixel positions of the determined feature to the pixel positions of the determined feature in the sideward frame of image data captured by the side camera. Processing of image data captured by the side camera is adjusted to accommodate the determined misalignment.
-
公开(公告)号:US10654423B2
公开(公告)日:2020-05-19
申请号:US15830116
申请日:2017-12-04
Applicant: MAGNA ELECTRONICS INC.
Inventor: Nikhil Gupta , Hilda Faraji , Daan He , Ghanshyam Rathi
Abstract: A method for dynamically ascertaining alignment of a vehicular camera relative to a vehicle to which the camera is attached includes determining a plurality of steering angle ranges for the vehicle, each of which is a range of steering angles that approximates straight vehicle motion over less than two seconds of travel time of the vehicle while the vehicle is in motion and turning. Image data captured by a camera of the vehicle is processed to determine a central vanishing point when the vehicle is in motion and moving straight. A plurality of feature points are selected in the image frames for each steering angle range, and a vanishing point for a plurality of tracked motion trajectories for each steering angle range is determined. An alignment of the camera is determined based at least in part on the determined central vanishing point and a determined vanishing line.
-
公开(公告)号:US20190168670A1
公开(公告)日:2019-06-06
申请号:US16266178
申请日:2019-02-04
Applicant: MAGNA ELECTRONICS INC.
Inventor: Nikhil Gupta , Hilda Faraji , Daan He , Ghanshyam Rathi
Abstract: A method for dynamically calibrating without manual intervention a forward viewing vehicular camera with respect to its three rotational degrees of freedom includes disposing a camera at a vehicle and operating the camera to acquire multiple frames of image data as the vehicle is moving and steered through a plurality of steering angles. Feature points are determined in an image frame when the vehicle is steered within a respective range of steering angles and motion trajectories of those feature points are tracked in subsequent image frames for the respective range of steering angles. A vanishing point is established in the image plane for the feature points for the respective range of steering angles. Based on established vanishing points, a vanishing line is determined. When the vanishing line is determined to be non-horizontal, at least one of pitch, roll or yaw of the camera is adjusted.
-
-
-
-
-
-
-
-
-