公开(公告)号：US20170177980A1

公开(公告)日：2017-06-22

申请号：US15381919

申请日：2016-12-16

Applicant: STMicroelectronics SA

Inventor： Manu ALIBAY ,  Stéphane AUBERGER ,  Bogdan-Florin STANCIULESCU

IPC: G06K9/62 ,  H04N5/232

CPC classification number: G06K9/6289 ,  G06K9/46 ,  G06K2009/4666 ,  G06T7/246 ,  G06T2207/10016 ,  G06T2207/30244 ,  H04N5/23238 ,  H04N5/23254 ,  H04N5/23258 ,  H04N5/23267 ,  H04N5/2329

Abstract: A method generates a binary descriptor associated with a given point in a current frame of a succession of video frames obtained by an apparatus such as an image sensor. The method includes determining a pattern of points pairs around said given point in the current frame, and performing intensity comparison processing between the two points of each pair. The apparatus is likely to move in a rotation between the previous frame and the current frame. The method includes processing the pattern of points of the current frame with tridimensional rotation information representative of the apparatus rotation between the previous frame and the current frame and obtained from inertial measurements provided by at least one inertial sensor.

公开(公告)号：US20180247422A1

公开(公告)日：2018-08-30

申请号：US15692794

申请日：2017-08-31

Applicant: STMicroelectronics SA

Inventor： Manu ALIBAY ,  Olivier POTHIER ,  Victor MACELA ,  Alain BELLON ,  Arnaud BOURGE

IPC: G06T7/521 ,  G01S17/08

CPC classification number: G06T7/521 ,  G01S17/08 ,  G06T7/55 ,  G06T7/593 ,  G06T2207/10012 ,  G06T2207/10021 ,  G06T2207/10028 ,  G06T2207/20212 ,  H04N13/207 ,  H04N13/254 ,  H04N13/271 ,  H04N2013/0081

Abstract: The method of determination of a depth map of a scene comprises generation of a distance map of the scene obtained by time of flight measurements, acquisition of two images of the scene from two different viewpoints, and stereoscopic processing of the two images taking into account the distance map. The generation of the distance map includes generation of distance histograms acquisition zone by acquisition zone of the scene, and the stereoscopic processing includes, for each region of the depth map corresponding to an acquisition zone, elementary processing taking into account the corresponding histogram.

公开(公告)号：US20190141247A1

公开(公告)日：2019-05-09

申请号：US16236043

申请日：2018-12-28

Applicant: STMicroelectronics SA

Inventor： Manu ALIBAY ,  Stéphane AUBERGER

IPC: H04N5/232 ,  G06T7/35 ,  G06T7/33 ,  H04N5/14

CPC classification number: H04N5/23254 ,  G06T7/33 ,  G06T7/35 ,  G06T2207/20076 ,  H04N5/145 ,  H04N5/23267

Abstract: A method determines a movement of an apparatus between capturing first and second images. The method includes testing model hypotheses of the movement by for example a RANSAC algorithm, operating on a set of first points in the first image and assumed corresponding second points in the second image to deliver the best model hypothesis. The testing includes, for each first point, calculating a corresponding estimated point using the tested model hypothesis, determining the back-projection error between the estimated point and the second point in the second image, and comparing each back projection error with a threshold. The testing comprises for each first point, determining a correction term based on an estimation of the depth of the first point in the first image and an estimation of the movement between the first and second images, and determining the threshold associated with the first point by using said correction term.

公开(公告)号：US20170180644A1

公开(公告)日：2017-06-22

申请号：US15382013

申请日：2016-12-16

Applicant: STMicroelectronics SA

Inventor： Manu ALIBAY ,  Stéphane AUBERGER

IPC: H04N5/232 ,  H04N5/14

CPC classification number: H04N5/23254 ,  G06T7/33 ,  G06T7/35 ,  G06T2207/20076 ,  H04N5/145 ,  H04N5/23267

Abstract: A method determines a movement of an apparatus between capturing first and second images. The method includes testing model hypotheses of the movement by for example a RANSAC algorithm, operating on a set of first points in the first image and assumed corresponding second points in the second image to deliver the best model hypothesis. The testing includes, for each first point, calculating a corresponding estimated point using the tested model hypothesis, determining the back-projection error between the estimated point and the second point in the second image, and comparing each back projection error with a threshold. The testing comprises for each first point, determining a correction term based on an estimation of the depth of the first point in the first image and an estimation of the movement between the first and second images, and determining the threshold associated with the first point by using said correction term.

公开(公告)号：US20170178355A1

公开(公告)日：2017-06-22

申请号：US15381928

申请日：2016-12-16

Applicant: STMicroelectronics SA

Inventor： Manu ALIBAY ,  Stéphane AUBERGER ,  Bogdan-Florin STANCIULESCU

IPC: G06T7/70

CPC classification number: G06T7/70 ,  G06T7/73 ,  G06T2207/10016 ,  G06T2207/20076 ,  G06T2207/30196 ,  G06T2207/30244

Abstract: A method estimates an ego-motion of an apparatus between a first image and a second image of a succession of images captured by the apparatus, in a SLAM type algorithm containing a localization part including the ego-motion estimating and a mapping part. The ego-motion comprises a 3D rotation of the apparatus and a position variation of the apparatus in the 3D space, and the ego-motion estimating comprises performing a first part and performing a second part after having performed the first part, the first part including estimating the 3D rotation of the apparatus and the second part including, the 3D rotation having been estimated, estimating the position variation of the apparatus in the 3D space.

公开(公告)号：US20170178347A1

公开(公告)日：2017-06-22

申请号：US15382164

申请日：2016-12-16

Applicant: STMicroelectronics SA

Inventor： Manu ALIBAY ,  Stéphane AUBERGER

IPC: G06T7/277

CPC classification number: G06T7/277 ,  G06T2207/10004 ,  G06T2207/10028 ,  G06T2207/20076 ,  G06T2207/30241 ,  G06T2207/30244

Abstract: Method of estimating a position variation of a motion of an apparatus between a first instant and a second instant, said motion including a rotation of the apparatus and said position variation, said position variation including a position and a velocity, wherein estimating said position variation comprises performing a particles filtering for estimating said position and velocity from the probabilistic-weighted average of the particles, said particles filter using a known estimation of said rotation and being parameterized for taking into account a quality of said rotation estimation.

公开(公告)号：US20160105590A1

公开(公告)日：2016-04-14

申请号：US14848962

申请日：2015-09-09

Applicant: STMICROELECTRONICS SA

Inventor： Manu ALIBAY ,  Stéphane AUBERGER

IPC: H04N5/14 ,  H04N5/232

CPC classification number: H04N5/145 ,  G06T7/246 ,  G06T7/277 ,  G06T2207/10016 ,  H04N5/23254 ,  H04N5/23258 ,  H04N5/23277

Abstract: The method includes for each current pair of first and second successive video images determining movement between the two images. The determining includes a phase of testing homography model hypotheses on the movement by a RANSAC type algorithm operating on a set of points in the first image and first assumed corresponding points in the second image so as to deliver one of the homography model hypothesis that defines the movement. The test phase includes a test of first homography model hypotheses of the movement obtained from a set of second points in the first image and second assumed corresponding points in the second image. At least one second homography model hypothesis is obtained from auxiliary information supplied by an inertial sensor and representative of a movement of the image sensor between the captures of the two successive images of the pair.

Abstract translation: 该方法包括用于确定两个图像之间的移动的每对当前第一和第二连续视频图像对。 该确定包括通过对第一图像中的一组点和第二图像中的第一假定对应点操作的RANSAC类型算法来测试运动上的单应性模型假设的相位，以便递送定义 运动。 测试阶段包括从第一图像中的一组第二点和第二图像中的第二假定对应点获得的运动的第一单应性模型假设的测试。 从由惯性传感器提供的辅助信息获得至少一个第二单应性模型假说，并表示图像传感器在该对的两个连续图像的捕获之间的运动。