公开(公告)号：US20240161622A1

公开(公告)日：2024-05-16

申请号：US18373528

申请日：2023-09-27

Applicant: Mobileye Vision Technologies Ltd.

Inventor： Gideon Stein ,  Itay Blumenthal ,  Nadav Shaag ,  Jeffrey Moskowitz

IPC: G08G1/16 ,  B60W40/06 ,  G06T7/246 ,  G06T7/55 ,  G06V10/764 ,  G06V10/82 ,  G06V20/56 ,  G06V20/58

CPC classification number: G08G1/166 ,  B60W40/06 ,  G06T7/248 ,  G06T7/55 ,  G06V10/764 ,  G06V10/82 ,  G06V20/56 ,  G06V20/58 ,  G08G1/165 ,  B60W2420/403 ,  G06T2207/10016 ,  G06T2207/10028 ,  G06T2207/20084 ,  G06T2207/30252

Abstract: System and techniques for vehicle environment modeling with a camera are described herein. A time-ordered sequence of images representative of a road surface may be obtained. An image from this sequence is a current image. A data set may then be provided to an artificial neural network (ANN) to produce a three-dimensional structure of a scene. Here, the data set includes a portion of the sequence of images that includes the current image, motion of the sensor from which the images were obtained, and an epipole. The road surface is then modeled using the three-dimensional structure of the scene.

公开(公告)号：US12223744B2

公开(公告)日：2025-02-11

申请号：US17777212

申请日：2021-03-01

Applicant: Mobileye Vision Technologies Ltd.

Inventor： Gideon Stein ,  Itay Blumenthal ,  Jeffrey Moskowitz ,  Nadav Shaag ,  Natalie Carlebach

IPC: G06V20/56 ,  B60W40/06 ,  G06T3/18 ,  G06T5/50 ,  G06T5/60 ,  G06T7/50 ,  G06T17/05

Abstract: System and techniques for vehicle environment modeling with a camera are described herein. A device for modeling an environment comprises: a hardware sensor interface to obtain a sequence of unrectified images representative of a road environment, the sequence of unrectified images including a first unrectified image, a previous unrectified image, and a previous-previous unrectified image; and processing circuitry to: provide the first unrectified image, the previous unrectified image, and the previous-previous unrectified image to an artificial neural network (ANN) to produce a three-dimensional structure of a scene; determine a selected homography; and apply the selected homography to the three-dimensional structure of the scene to create a model of the road environment.

公开(公告)号：US11803981B2

公开(公告)日：2023-10-31

申请号：US17613617

申请日：2020-05-29

Applicant: Mobileye Vision Technologies Ltd.

Inventor： Gideon Stein ,  Itay Blumenthal ,  Nadav Shaag ,  Jeffrey Moskowitz ,  Natalie Carlebach

IPC: G06T7/579 ,  G06T7/292 ,  H04N13/25 ,  B60R1/22 ,  G06V10/774 ,  G06V20/58 ,  G06V10/82 ,  G06T3/00 ,  G06T17/05 ,  G06N3/045 ,  G06V10/25 ,  G06V20/56 ,  G08G1/16 ,  G06T17/00

CPC classification number: G06T7/579 ,  B60R1/22 ,  G06N3/045 ,  G06T3/0093 ,  G06T7/292 ,  G06T17/00 ,  G06T17/05 ,  G06V10/25 ,  G06V10/7747 ,  G06V10/82 ,  G06V20/56 ,  G06V20/58 ,  G08G1/166 ,  H04N13/25 ,  G06T2200/04 ,  G06T2200/08 ,  G06T2207/10016 ,  G06T2207/10021 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/30252 ,  G08G1/165

Abstract: Various systems and methods for modeling a scene. A device for modeling a scene includes a hardware interface to obtain a time-ordered sequence of images representative of a scene, the time-ordered sequence including a plurality of images, one of the sequence of images being a current image, the scene captured by a monocular imaging system; and processing circuitry to: provide a data set to an artificial neural network (ANN) to produce a three-dimensional structure of the scene, the data set including: a portion of the sequence of images, the portion of the sequence of images including the current image; and motion of a sensor that captured the sequence of images; and model the scene using the three-dimensional structure of the scene, wherein the three-dimensional structure is determined for both moving and fixed objects in the scene.

公开(公告)号：US11568653B2

公开(公告)日：2023-01-31

申请号：US17841937

申请日：2022-06-16

Applicant: Mobileye Vision Technologies Ltd.

Inventor： Gideon Stein ,  Itay Blumenthal ,  Jeffrey Moskowitz ,  Nadav Shaag ,  Natalie Carlebach

IPC: G06T7/00 ,  G06V20/56 ,  B60W40/06 ,  G06T7/50

Abstract: System and techniques for vehicle environment modeling with a camera are described herein. A device for modeling an environment comprises: a hardware sensor interface to obtain a sequence of unrectified images representative of a road environment, the sequence of unrectified images including a first unrectified image, a previous unrectified image, and a previous-previous unrectified image; and processing circuitry to: provide the first unrectified image, the previous unrectified image, and the previous-previous unrectified image to an artificial neural network (ANN) to produce a three-dimensional structure of a scene; determine a selected homography; and apply the selected homography to the three-dimensional structure of the scene to create a model of the road environment.

公开(公告)号：US20210362724A1

公开(公告)日：2021-11-25

申请号：US17393093

申请日：2021-08-03

Applicant: MOBILEYE VISION TECHNOLOGIES LTD.

Inventor： Gideon Stein ,  Itay Blumenthal ,  Nadav Shaag

IPC: B60W40/06 ,  B60W50/00 ,  B62D15/02 ,  B60G17/018 ,  G05D1/02 ,  G06K9/46 ,  G06T3/40 ,  B60T8/172 ,  G06T7/55 ,  G06K9/00

Abstract: Systems and methods are provided for determining a road profile along a predicted path. In one implementation, a system includes at least one image capture device configured to acquire a plurality of images of an area in a vicinity of a user vehicle; a data interface; and at least one processing device configured to receive the plurality of images captured by the image capture device through the data interface; and compute a profile of a road along one or more predicted paths of the user vehicle. At least one of the one or more predicted paths is predicted based on image data.

公开(公告)号：US20240132154A1

公开(公告)日：2024-04-25

申请号：US18535458

申请日：2023-12-11

Applicant: MOBILEYE VISION TECHNOLOGIES LTD.

Inventor： Gideon Stein ,  Itay Blumenthal ,  Nadav Shaag

IPC: B62D15/02 ,  B60G17/0165 ,  B60G17/018 ,  B60G17/019 ,  B60T8/172 ,  B60W40/06 ,  B60W50/00 ,  G06T3/40 ,  G06T7/55 ,  G06V10/40 ,  G06V20/56

CPC classification number: B62D15/025 ,  B60G17/0165 ,  B60G17/0182 ,  B60G17/019 ,  B60T8/172 ,  B60W40/06 ,  B60W50/0097 ,  B62D15/021 ,  B62D15/0295 ,  G06T3/40 ,  G06T7/55 ,  G06V10/40 ,  G06V20/588 ,  B60T2201/08 ,  B60T2201/083 ,  B60T2210/32 ,  G06T2207/10021 ,  G06T2207/20084 ,  G06T2207/30241 ,  G06T2207/30256

Abstract: Systems and methods are provided for navigating a host vehicle. A navigation system for the host vehicle may include at least one processor programmed to receive an image representative of an environment of a host vehicle; analyze the image to determine a predicted path of the host vehicle; determine, based on the image, an indicator of comfort associated with the predicted path; identify, based on the indicator of comfort, an alternative path of the host vehicle; and output a control signal configured to modify an operation of a component of the host vehicle to follow the alternative path of the host vehicle.

公开(公告)号：US20220366706A1

公开(公告)日：2022-11-17

申请号：US17841937

申请日：2022-06-16

Applicant: Mobileye Vision Technologies Ltd.

Inventor： Gideon Stein ,  Itay Blumenthal ,  Jeffrey Moskowitz ,  Nadav Shaag ,  Natalie Carlebach

IPC: G06V20/56 ,  B60W40/06 ,  G06T7/50

Abstract: System and techniques for vehicle environment modeling with a camera are described herein. A device for modeling an environment comprises: a hardware sensor interface to obtain a sequence of unrectified images representative of a road environment, the sequence of unrectified images including a first unrectified image, a previous unrectified image, and a previous-previous unrectified image; and processing circuitry to: provide the first unrectified image, the previous unrectified image, and the previous-previous unrectified image to an artificial neural network (ANN) to produce a three-dimensional structure of a scene; determine a selected homography; and apply the selected homography to the three-dimensional structure of the scene to create a model of the road environment.

公开(公告)号：US20220309693A1

公开(公告)日：2022-09-29

申请号：US17698344

申请日：2022-03-18

Applicant: Mobileye Vision Technologies Ltd.

Inventor： Nadav Shaag

IPC: G06T7/521 ,  G06N3/08 ,  G01B11/22 ,  G01S17/89 ,  G01S17/931

Abstract: Techniques are disclosed for improving upon the usage of Light Detection and Ranging (LIDAR) supervision to perform image depth estimation. The techniques use a generator and adversary network to generate respective models that “compete” against one another to enable the generator model to output a desired output image that compensates for a LIDAR image having a structured or lined data pattern. The techniques described herein may be suitable for use by vehicles and/or other agents operating in a particular environment as part of machine vision algorithms that are implemented to perform autonomous and/or semi-autonomous functions.

公开(公告)号：US10984259B2

公开(公告)日：2021-04-20

申请号：US16658360

申请日：2019-10-21

Applicant: Mobileye Vision Technologies Ltd.

Inventor： Gideon Stein ,  Itay Blumenthal ,  Nadav Shaag ,  Yaakov Kingsley

IPC: H04N7/18 ,  G06K9/00 ,  G06T7/73 ,  G06T7/13 ,  G06K9/46 ,  G06K9/52 ,  G06T5/00 ,  G06T7/20 ,  G06T7/40 ,  G06T7/60

Abstract: In some embodiments, a first homography, created from two images of a roadway, is decomposed to determine an ego-motion, and the ego-motion is used to adjust a previous estimate of a road plane. The adjusted previous estimate of the road plane is combined with the current estimate of the plane to create a second homography, and the second homography is used to determine residual motion and vertical deviation in the surface of the roadway. In some embodiments, multiple road profiles each corresponding to a common portion of a roadway are adjusted in slope and offset by optimizing a function having a data term, a smoothness term and a regularization term; and the adjusted road profiles are combined into a multi-frame road profile. In some embodiments, road profile information for a predetermined number of data points is transmitted in periodic data bursts, with more than one data point per data burst.

公开(公告)号：US20200062264A1

公开(公告)日：2020-02-27

申请号：US16667884

申请日：2019-10-29

Applicant: MOBILEYE VISION TECHNOLOGIES LTD.

Inventor： Gideon Stein ,  Itay Blumenthal ,  Nadav Shaag

IPC: B60W40/06 ,  G06T7/55 ,  B60T8/172 ,  G06T3/40 ,  G06K9/46 ,  B62D15/02 ,  G05D1/02 ,  B60G17/018 ,  B60W50/00 ,  G06K9/00

Abstract: Systems and methods are provided for determining a road profile along a predicted path. In one implementation, a system includes at least one image capture device configured to acquire a plurality of images of an area in a vicinity of a user vehicle; a data interface; and at least one processing device configured to receive the plurality of images captured by the image capture device through the data interface; and compute a profile of a road along one or more predicted paths of the user vehicle. At least one of the one or more predicted paths is predicted based on image data.