-
公开(公告)号：US20180032838A1
公开(公告)日：2018-02-01
申请号：US15223438
申请日：2016-07-29
Applicant: Massachusetts Institute of Technology
Inventor： Neal Wadhwa , Tali Dekel , Donglai Wei , Frederic Durand , William T. Freeman
CPC classification number: G06T3/0093 , G06T11/00 , G06T11/001
Abstract: Geometries of the structures and objects deviate from their idealized models, while not always visible to the naked eye. Embodiments of the present invention reveal and visualize such subtle geometric deviations, which can contain useful, surprising information. In an embodiment of the present invention, a method can include fitting a model of a geometry to an input image, matting a region of the input image according to the model based on a sampling function, generating a deviation function based on the matted region, extrapolating the deviation function to an image wide warping field, and generating an output image by warping the input image according to the warping. In an embodiment of the present invention, Deviation Magnification inputs takes a still image or frame, fits parametric models to objects of interest, and generates an output image exaggerating departures from ideal geometries.
-
公开(公告)号：US09338331B2
公开(公告)日：2016-05-10
申请号：US14592211
申请日：2015-01-08
Applicant: Massachusetts Institute of Technology
Inventor： Neal Wadhwa , Michael Rubinstein , Frederic Durand , William T. Freeman
CPC classification number: H04N5/144 , G06T3/40 , G09G2340/045 , H04N5/20 , H04N5/213
Abstract: Some embodiments are directed to a method, corresponding system, and corresponding apparatus for rendering a video and/or image display to amplify small motions through video magnification. Some embodiments include a new compact image pyramid representation, the Riesz pyramid, that may be used for real-time, high-quality phase-based video magnification. Some embodiments are less overcomplete than even the smallest two orientation, octave-bandwidth complex steerable pyramid. Some embodiments are implemented using compact, efficient linear filters in the spatial domain. Some embodiments produce motion magnified videos that are of comparable quality to those using the complex steerable pyramid. In some embodiments, the Riesz pyramid is used with phase-based video magnification. The Riesz pyramid may phase-shift image features along their dominant orientation, rather than along every orientation like the complex steerable pyramid.
Abstract translation: 一些实施例涉及用于渲染视频和/或图像显示以通过视频放大放大小运动的方法，对应系统和相应装置。 一些实施例包括可用于实时，高质量的基于相位的视频放大的新的紧凑型图像金字塔表示（Riesz金字塔）。 一些实施例比甚至最小的两个取向，八度带宽复杂的可操纵金字塔更不完全。 使用空间域中的紧凑，有效的线性滤波器来实现一些实施例。 一些实施例产生与使用复杂的可控金字塔的那些具有可比质量的运动放大视频。 在一些实施例中，雷斯金字塔用于基于相位的视频放大。 雷斯金字塔可以沿其主导方向相移图像特征，而不是像复杂的可控金字塔一样沿着每个方向。
-
公开(公告)号：US20150124062A1
公开(公告)日：2015-05-07
申请号：US14531548
申请日：2014-11-03
Applicant: Massachusetts Institute of Technology
Inventor： Piotr Krzysztof Didyk , Pitchaya Sitthi-Amorn , Wojciech Matusik , Frederic Durand , William T. Freeman
IPC: H04N13/04
CPC classification number: H04N13/302 , H04N13/111 , H04N13/122 , H04N13/128 , H04N13/351
Abstract: Multi-view autostereoscopic displays provide an immersive, glasses-free 3D viewing experience, but they preferably use correctly filtered content from multiple viewpoints. The filtered content, however, may not be easily obtained with current stereoscopic production pipelines. The proposed method and system takes a stereoscopic video as an input and converts it to multi-view and filtered video streams that may be used to drive multi-view autostereoscopic displays. The method combines a phase-based video magnification and an interperspective antialiasing into a single filtering process. The whole algorithm is simple and may be efficiently implemented on current GPUs to yield real-time performance. Furthermore, the ability to retarget disparity is naturally supported. The method is robust and works transparent materials, and specularities. The method provides superior results when compared to the state-of-the-art depth-based rendering methods. The method is showcased in the context of a real-time 3D videoconferencing system.
Abstract translation: 多视图自动立体显示器提供了沉浸式，无眼镜的3D观看体验，但是它们优选地从多个视点正确滤波内容。 然而，当前立体生产管道可能不容易获得过滤的内容。 所提出的方法和系统采用立体视频作为输入，并将其转换为可用于驱动多视点自动立体显示器的多视图和滤波视频流。 该方法将基于相位的视频放大和间隔抗锯齿组合到单个滤波过程中。 整个算法很简单，可以在当前的GPU上有效地实现，以实现实时性能。 此外，自然地支持重新定位差异的能力。 该方法是坚固的，透明的材料和镜面反射。 与最先进的基于深度的渲染方法相比，该方法提供了优异的结果。 该方法在实时3D视频会议系统的上下文中展示。
-
公开(公告)号：US20190035086A2
公开(公告)日：2019-01-31
申请号：US15445499
申请日：2017-02-28
Applicant: Massachusetts Institute of Technology
Inventor： Oral Buyukozturk , William T. Freeman , Frederic Durand , Myers Abraham Davis , Neal Wadhwa , Justin G. Chen
IPC: G06T7/20
CPC classification number: G06T7/20 , G06T7/262 , G06T7/277 , G06T2207/10016 , G06T2207/20056 , G06T2207/30241 , G06T2207/30244
Abstract: A method and corresponding apparatus for measuring object motion using camera images may include measuring a global optical flow field of a scene. The scene may include target and reference objects captured in an image sequence. Motion of a camera used to capture the image sequence may be determined relative to the scene by measuring an apparent, sub-pixel motion of the reference object with respect to an imaging plane of the camera. Motion of the target object corrected for the camera motion may be calculated based on the optical flow field of the scene and on the apparent, sub-pixel motion of the reference object with respect to the imaging plane of the camera. Embodiments may enable measuring vibration of structures and objects from long distance in relatively uncontrolled settings, with or without accelerometers, with high signal-to-noise ratios.
-
公开(公告)号：US20180268543A1
公开(公告)日：2018-09-20
申请号：US15982765
申请日：2018-05-17
Inventor： Hao-yu Wu , Michael Rubinstein , Eugene Inghaw Shih , John V. Guttag , Frederic Durand , William T. Freeman , Neal Wadhwa
CPC classification number: G06T7/0012 , G06T7/0016 , G06T7/254 , G06T7/262 , G06T2207/20016 , G06T2207/30076 , G06T2207/30088 , G06T2207/30104 , G06T2207/30201
Abstract: In an embodiment, a method converts two images to a transform representation in a transform domain. For each spatial position, the method examines coefficients representing a neighborhood of the spatial position that is spatially the same across each of the two images. The method calculates a first vector in the transform domain based on first coefficients representing the spatial position, the first vector representing change from a first to second image of the two images describing deformation. The method modifies the first vector to create a second vector in the transform domain representing amplified movement at the spatial position between the first and second images. The method calculates second coefficients based on the second vector of the transform domain. From the second coefficients, the method generates an output image showing motion amplified according to the second vector for each spatial position between the first and second images.
-
Patent Agency Ranking
公开(公告)号：US20160010982A1
公开(公告)日：2016-01-14
申请号：US14815092
申请日：2015-07-31
Applicant: Massachusetts Institute of Technology
Inventor： YiChang Shih , Myers Abraham Davis , Samuel Wiliam Hasinoff , Frederic Durand , William T. Freeman
CPC classification number: G01B11/303 , G01B11/254 , G06K9/6215 , G06T7/70 , H04N7/18
Abstract: In one embodiment, a method comprises projecting, from a projector, a diffused on an object. The method further includes capturing, with a first camera in a particular location, a reference image of the object while the diffused is projected on the object. The method further includes capturing, with a second camera positioned in the particular location, a test image of the object while the diffused is projected on the object. The method further includes comparing speckles in the reference image to the test image. The projector, first camera and second camera are removably provided to and positioned in a site of the object.
Abstract translation: 在一个实施例中，一种方法包括从投影仪投影漫射在物体上。 该方法还包括在扩散物投射到对象上时，利用特定位置的第一相机捕获对象的参考图像。 所述方法还包括：当位于所述特定位置的第二摄像机捕获所述对象的测试图像，同时将所述漫射投影到所述对象上。 该方法还包括将参考图像中的斑点与测试图像进行比较。 投影仪，第一相机和第二相机可移除地提供到物体的位置并定位在物体的位置。
-
公开(公告)号：US09131118B2
公开(公告)日：2015-09-08
申请号：US13676933
申请日：2012-11-14
Applicant: Massachusetts Institute of Technology
Inventor： YiChang Shih , Myers Abraham Davis , Samuel William Hasinoff , Frederic Durand , William T. Freeman
CPC classification number: G01B11/303 , G01B11/254 , G06K9/6215 , G06T7/70 , H04N7/18
Abstract: In one embodiment, a method comprises projecting, from a projector, a diffused on an object. The method further includes capturing, with a first camera in a particular location, a reference image of the object while the diffused is projected on the object. The method further includes capturing, with a second camera positioned in the particular location, a test image of the object while the diffused is projected on the object. The method further includes comparing speckles in the reference image to the test image. The projector, first camera and second camera are removably provided to and positioned in a site of the object.
Abstract translation: 在一个实施例中，一种方法包括从投影仪投影漫射在物体上。 该方法还包括在扩散物投射到对象上时，利用特定位置的第一相机捕获对象的参考图像。 所述方法还包括：当位于所述特定位置的第二摄像机捕获所述对象的测试图像，同时将所述漫射投影到所述对象上。 该方法还包括将参考图像中的斑点与测试图像进行比较。 投影仪，第一相机和第二相机可移除地提供到物体的位置并定位在物体的位置。
-
公开(公告)号：US20150195430A1
公开(公告)日：2015-07-09
申请号：US14592211
申请日：2015-01-08
Applicant: Massachusetts Institute of Technology
Inventor： Neal Wadhwa , Michael Rubinstein , Frederic Durand , William T. Freeman
CPC classification number: H04N5/144 , G06T3/40 , G09G2340/045 , H04N5/20 , H04N5/213
Abstract: Some embodiments are directed to a method, corresponding system, and corresponding apparatus for rendering a video and/or image display to amplify small motions through video magnification. Some embodiments include a new compact image pyramid representation, the Riesz pyramid, that may be used for real-time, high-quality phase-based video magnification. Some embodiments are less overcomplete than even the smallest two orientation, octave-bandwidth complex steerable pyramid. Some embodiments are implemented using compact, efficient linear filters in the spatial domain. Some embodiments produce motion magnified videos that are of comparable quality to those using the complex steerable pyramid. In some embodiments, the Riesz pyramid is used with phase-based video magnification. The Riesz pyramid may phase-shift image features along their dominant orientation, rather than along every orientation like the complex steerable pyramid.
Abstract translation: 一些实施例涉及用于渲染视频和/或图像显示以通过视频放大放大小运动的方法，对应系统和相应装置。 一些实施例包括可用于实时，高质量的基于相位的视频放大的新的紧凑型图像金字塔表示（Riesz金字塔）。 一些实施例比甚至最小的两个取向，八度带宽复杂的可操纵金字塔更不完全。 使用空间域中的紧凑，有效的线性滤波器来实现一些实施例。 一些实施例产生与使用复杂的可控金字塔的那些具有可比质量的运动放大视频。 在一些实施例中，雷斯金字塔用于基于相位的视频放大。 雷斯金字塔可以沿其主导方向相移图像特征，而不是像复杂的可控金字塔一样沿着每个方向。
-
公开(公告)号：US20150016690A1
公开(公告)日：2015-01-15
申请号：US14279254
申请日：2014-05-15
Applicant: Massachusetts Institute of Technology
Inventor： William T. Freeman , Frederic Durand , Tianfan Xue , Michael Rubinstein , Neal Wadhwa
IPC: G06T7/20
CPC classification number: G06T7/20 , G01P5/001 , G01P5/26 , G02B27/54 , G06T7/246 , G06T2207/10016 , G06T2207/10021 , G06T2207/10056 , G06T2207/30241
Abstract: An imaging method and corresponding apparatus according to an embodiment of the present invention enables measurement and visualization of fluid flow. An embodiment method includes obtaining video captured by a video camera with an imaging plane. Representations of motions in the video are correlated. A textured background of the scene can be modeled as stationary, with a refractive field translating between background and video camera. This approach offers multiple advantages over conventional fluid flow visualization, including an ability to use ordinary video equipment outside a laboratory without particle injection. Even natural backgrounds can be used, and fluid motion can be distinguished from refraction changes. Depth and three-dimensional information can be recovered using stereo video, and uncertainty methods can enhance measurement robustness where backgrounds are less textured. Example applications can include avionics and hydrocarbon leak detection.
Abstract translation: 根据本发明的实施例的成像方法和相应的装置能够测量和可视化流体流动。 一种实施方式包括获得具有成像平面的由摄像机拍摄的视频。 视频中的动作表示是相关的。 场景的纹理背景可以被建模为静止的，折射场在背景和摄像机之间转换。 这种方法比常规流体流动可视化提供了多个优点，包括在没有颗粒注射的情况下在实验室外使用普通视频设备的能力。 甚至可以使用自然背景，并且可以区分流体运动与折射变化。 可以使用立体视频恢复深度和三维信息，不确定性方法可以增强背景较少纹理的测量鲁棒性。 示例应用可以包括航空电子设备和碳氢化合物泄漏检测。
-
公开(公告)号：US20140132761A1
公开(公告)日：2014-05-15
申请号：US13676933
申请日：2012-11-14
Applicant: MASSACHUSETTS INSTITUTE OF TECHNOLOGY
Inventor： YiChang Shih , Myers Abraham Davis , Samuel William Hasinoff , Frederic Durand , William T. Freeman
CPC classification number: G01B11/303 , G01B11/254 , G06K9/6215 , G06T7/70 , H04N7/18
Abstract: In one embodiment, a method comprises projecting, from a projector, a diffused on an object. The method further includes capturing, with a first camera in a particular location, a reference image of the object while the diffused is projected on the object. The method further includes capturing, with a second camera positioned in the particular location, a test image of the object while the diffused is projected on the object. The method further includes comparing speckles in the reference image to the test image. The projector, first camera and second camera are removably provided to and positioned in a site of the object.
Abstract translation: 在一个实施例中，一种方法包括从投影仪投影漫射在物体上。 该方法还包括在扩散物投射到对象上时，利用特定位置的第一相机捕获对象的参考图像。 所述方法还包括：当位于所述特定位置的第二摄像机捕获所述对象的测试图像，同时将所述漫射投影到所述对象上。 该方法还包括将参考图像中的斑点与测试图像进行比较。 投影仪，第一相机和第二相机可移除地提供到物体的位置并定位在物体的位置。
-
-
-
-
-
-
-
-
-
Search Results
35
records
(took 0.034 seconds)
