-
公开(公告)号:US20220103709A1
公开(公告)日:2022-03-31
申请号:US17547751
申请日:2021-12-10
申请人: ML Netherlands C.V.
发明人: Alexander Ilic , Benedikt Koeppel
IPC分类号: H04N1/00 , H04N13/271 , H04N13/275 , G06T19/20 , H04N13/221 , G06T7/55 , G01B11/24 , G06T7/73 , H04N13/211 , B33Y50/00 , G06T15/04 , G06T17/20
摘要: A smartphone may be freely moved in three dimensions as it captures a stream of images of an object. Multiple image frames may be captured in different orientations and distances from the object and combined into a composite image representing an three-dimensional image of the object. The image frames may be formed into the composite image based on representing features of each image frame as a set of points in a three dimensional depth map. Coordinates of the points in the depth map may be estimated with a level of certainty. The level of certainty may be used to determine which points are included in the composite image. The selected points may be smoothed and a mesh model may be formed by creating a convex hull of the selected points. The mesh model and associated texture information may be used to render a three-dimensional representation of the object on a two-dimensional display. Additional techniques include processing and formatting of the three-dimensional representation data to be printed by a three-dimensional printer so a three-dimensional model of the object may be formed.
-
公开(公告)号:US20210144353A1
公开(公告)日:2021-05-13
申请号:US16950752
申请日:2020-11-17
申请人: ML Netherlands C.V.
发明人: Alexander Ilic , Peter Weigand , Erik Fonseka
摘要: A smartphone may be freely moved in three dimensions as it captures a stream of images of an object. Multiple image frames may be captured in different orientations and distances from the object and combined into a composite image representing an image of the object. The image frames may be formed into the composite image based on representing features of each image frame as a set of points in a three dimensional point cloud. Inconsistencies between the image frames may be adjusted when projecting respective points in the point cloud into the composite image. Quality of the image frames may be improved by processing the image frames to correct errors. Distracting features, such as the finger of a user holding the object being scanned, can be replaced with background content. As the scan progresses, a direction for capturing subsequent image frames is provided to a user as a real-time feedback.
-
公开(公告)号:US20200374455A1
公开(公告)日:2020-11-26
申请号:US16899487
申请日:2020-06-11
申请人: ML Netherlands C.V.
发明人: Alexander Ilic , Manuel Werlberger
摘要: A method of forming a visual representation of an object from a plurality of image frames acquired using a portable electronic device, the method comprising the steps of determining at least one parameter of motion of the portable electronic device; determining at least one capture condition for at least one first image frame of the plurality of image frames; computing, based on the at least one parameter of motion and the at least one capture condition, an indication of blur in the image frame; based on the indication of blur, conditionally taking a corrective action.
-
公开(公告)号:US20200162629A1
公开(公告)日:2020-05-21
申请号:US16685983
申请日:2019-11-15
申请人: ML Netherlands C.V.
发明人: Alexander Ilic , Benedikt Koeppel
IPC分类号: H04N1/00 , G06T7/73 , G01B11/24 , G06T7/55 , G06T17/20 , G06T15/04 , B33Y50/00 , H04N13/221 , G06T19/20 , H04N13/275 , H04N13/271
摘要: A smartphone may be freely moved in three dimensions as it captures a stream of images of an object. Multiple image frames may be captured in different orientations and distances from the object and combined into a composite image representing an three-dimensional image of the object. The image frames may be formed into the composite image based on representing features of each image frame as a set of points in a three dimensional depth map. Coordinates of the points in the depth map may be estimated with a level of certainty. The level of certainty may be used to determine which points are included in the composite image. The selected points may be smoothed and a mesh model may be formed by creating a convex hull of the selected points. The mesh model and associated texture information may be used to render a three-dimensional representation of the object on a two-dimensional display. Additional techniques include processing and formatting of the three-dimensional representation data to be printed by a three-dimensional printer so a three-dimensional model of the object may be formed.
-
公开(公告)号:US20210392241A1
公开(公告)日:2021-12-16
申请号:US17461778
申请日:2021-08-30
申请人: ML Netherlands C.V.
发明人: Alexander Ilic
摘要: A smartphone may be freely moved in three dimensions as it captures a stream of images of an object. Multiple image frames may be captured in different orientations and distances from the object and combined into a composite image representing an image of the object. The image frames may be formed into the composite image based on representing features of each image frame as a set of points in a three dimensional point cloud. Inconsistencies between the image frames may be adjusted when projecting respective points in the point cloud into the composite image. Quality of the image frames may be improved by processing the image frames to correct errors. Reflections and shadows may be detected and removed. Further, optical character recognition may be applied. As the scan progresses, a direction for capturing subsequent image frames is provided to a user as a real-time feedback.
-
公开(公告)号:US20190342533A1
公开(公告)日:2019-11-07
申请号:US16416847
申请日:2019-05-20
申请人: ML Netherlands C.V.
发明人: Alexander Ilic , Peter Weigand , Erik Fonseka
摘要: A smartphone may be freely moved in three dimensions as it captures a stream of images of an object. Multiple image frames may be captured in different orientations and distances from the object and combined into a composite image representing an image of the object. The image frames may be formed into the composite image based on representing features of each image frame as a set of points in a three dimensional point cloud. Inconsistencies between the image frames may be adjusted when projecting respective points in the point cloud into the composite image. Quality of the image frames may be improved by processing the image frames to correct errors. Distracting features, such as the finger of a user holding the object being scanned, can be replaced with background content. As the scan progresses, a direction for capturing subsequent image frames is provided to a user as a real-time feedback.
-
公开(公告)号:US10225428B2
公开(公告)日:2019-03-05
申请号:US15048875
申请日:2016-02-19
申请人: ML Netherlands C.V.
IPC分类号: G06K9/36 , H04N1/107 , H04N1/387 , G06T7/00 , H04N1/195 , G06F3/033 , G06K9/22 , G06K9/62 , G06T7/30
摘要: A computer peripheral that may operate as a scanner. The scanner captures image frames as it is moved across an object. The image frames are formed into a composite image based on computations in two processes. In a first process, fast track processing determines a coarse position of each of the image frames based on a relative position between each successive image frame and a respective preceding image determine by matching overlapping portions of the image frames. In a second process, fine position adjustments are computed to reduce inconsistencies from determining positions of image frames based on relative positions to multiple prior image frames. The peripheral may also act as a mouse and may be configured with one or more navigation sensors that can be used to reduce processing time required to match a successive image frame to a preceding image frame.
-
公开(公告)号:US11245806B2
公开(公告)日:2022-02-08
申请号:US16685983
申请日:2019-11-15
申请人: ML Netherlands C.V.
发明人: Alexander Ilic , Benedikt Koeppel
IPC分类号: H04N1/00 , H04N13/271 , H04N13/275 , G06T19/20 , G06T7/55 , G01B11/24 , G06T7/73 , H04N13/211 , B33Y50/00 , G06T15/04 , G06T17/20 , H04N13/221
摘要: A smartphone may be freely moved in three dimensions as it captures a stream of images of an object. Multiple image frames may be captured in different orientations and distances from the object and combined into a composite image representing an three-dimensional image of the object. The image frames may be formed into the composite image based on representing features of each image frame as a set of points in a three dimensional depth map. Coordinates of the points in the depth map may be estimated with a level of certainty. The level of certainty may be used to determine which points are included in the composite image. The selected points may be smoothed and a mesh model may be formed by creating a convex hull of the selected points. The mesh model and associated texture information may be used to render a three-dimensional representation of the object on a two-dimensional display. Additional techniques include processing and formatting of the three-dimensional representation data to be printed by a three-dimensional printer so a three-dimensional model of the object may be formed.
-
公开(公告)号:US10708491B2
公开(公告)日:2020-07-07
申请号:US15109466
申请日:2015-01-05
申请人: ML Netherlands C.V.
发明人: Alexander Ilic , Manuel Werlberger
摘要: A method of forming a visual representation of an object from a plurality of image frames acquired using a portable electronic device, the method comprising the steps of determining at least one parameter of motion of the portable electronic device; determining at least one capture condition for at least one first image frame of the plurality of image frames; computing, based on the at least one parameter of motion and the at least one capture condition, an indication of blur in the image frame; based on the indication of blur, conditionally taking a corrective action.
-
公开(公告)号:US10484561B2
公开(公告)日:2019-11-19
申请号:US15308959
申请日:2015-05-11
申请人: ML Netherlands C.V.
发明人: Alexander Ilic , Benedikt Koeppel
IPC分类号: H04N13/271 , H04N13/275 , G06T19/20 , G06T7/55 , G06T15/04 , H04N13/221 , H04N1/00 , G01B11/24 , G06T7/73 , B33Y50/00 , G06T17/20
摘要: A smartphone may be freely moved in three dimensions as it captures a stream of images of an object. Multiple image frames may be captured in different orientations and distances from the object and combined into a composite image representing an three-dimensional image of the object. The image frames may be formed into the composite image based on representing features of each image frame a set of points in a three dimensional depth map. Coordinates of the points in the depth map may be estimated with a level of certainty. The level of certainty may be used to determine which points are included in the composite image. The selected points may be smoothed and a mesh model may be formed by creating a convex hull of the selected points. The mesh model and associated texture information may be used to render a three-dimensional representation of the object on a two-dimensional display. Additional techniques include processing and formatting of the three-dimensional representation data to be printed by a three-dimensional printer so a three-dimensional model of the object may be formed.
-
-
-
-
-
-
-
-
-