-
公开(公告)号：US20180032838A1
公开(公告)日：2018-02-01
申请号：US15223438
申请日：2016-07-29
Applicant: Massachusetts Institute of Technology
Inventor： Neal Wadhwa , Tali Dekel , Donglai Wei , Frederic Durand , William T. Freeman
CPC classification number: G06T3/0093 , G06T11/00 , G06T11/001
Abstract: Geometries of the structures and objects deviate from their idealized models, while not always visible to the naked eye. Embodiments of the present invention reveal and visualize such subtle geometric deviations, which can contain useful, surprising information. In an embodiment of the present invention, a method can include fitting a model of a geometry to an input image, matting a region of the input image according to the model based on a sampling function, generating a deviation function based on the matted region, extrapolating the deviation function to an image wide warping field, and generating an output image by warping the input image according to the warping. In an embodiment of the present invention, Deviation Magnification inputs takes a still image or frame, fits parametric models to objects of interest, and generates an output image exaggerating departures from ideal geometries.
-
公开(公告)号：US09338331B2
公开(公告)日：2016-05-10
申请号：US14592211
申请日：2015-01-08
Applicant: Massachusetts Institute of Technology
Inventor： Neal Wadhwa , Michael Rubinstein , Frederic Durand , William T. Freeman
CPC classification number: H04N5/144 , G06T3/40 , G09G2340/045 , H04N5/20 , H04N5/213
Abstract: Some embodiments are directed to a method, corresponding system, and corresponding apparatus for rendering a video and/or image display to amplify small motions through video magnification. Some embodiments include a new compact image pyramid representation, the Riesz pyramid, that may be used for real-time, high-quality phase-based video magnification. Some embodiments are less overcomplete than even the smallest two orientation, octave-bandwidth complex steerable pyramid. Some embodiments are implemented using compact, efficient linear filters in the spatial domain. Some embodiments produce motion magnified videos that are of comparable quality to those using the complex steerable pyramid. In some embodiments, the Riesz pyramid is used with phase-based video magnification. The Riesz pyramid may phase-shift image features along their dominant orientation, rather than along every orientation like the complex steerable pyramid.
Abstract translation: 一些实施例涉及用于渲染视频和/或图像显示以通过视频放大放大小运动的方法，对应系统和相应装置。 一些实施例包括可用于实时，高质量的基于相位的视频放大的新的紧凑型图像金字塔表示（Riesz金字塔）。 一些实施例比甚至最小的两个取向，八度带宽复杂的可操纵金字塔更不完全。 使用空间域中的紧凑，有效的线性滤波器来实现一些实施例。 一些实施例产生与使用复杂的可控金字塔的那些具有可比质量的运动放大视频。 在一些实施例中，雷斯金字塔用于基于相位的视频放大。 雷斯金字塔可以沿其主导方向相移图像特征，而不是像复杂的可控金字塔一样沿着每个方向。
-
公开(公告)号：US20150124062A1
公开(公告)日：2015-05-07
申请号：US14531548
申请日：2014-11-03
Applicant: Massachusetts Institute of Technology
Inventor： Piotr Krzysztof Didyk , Pitchaya Sitthi-Amorn , Wojciech Matusik , Frederic Durand , William T. Freeman
IPC: H04N13/04
CPC classification number: H04N13/302 , H04N13/111 , H04N13/122 , H04N13/128 , H04N13/351
Abstract: Multi-view autostereoscopic displays provide an immersive, glasses-free 3D viewing experience, but they preferably use correctly filtered content from multiple viewpoints. The filtered content, however, may not be easily obtained with current stereoscopic production pipelines. The proposed method and system takes a stereoscopic video as an input and converts it to multi-view and filtered video streams that may be used to drive multi-view autostereoscopic displays. The method combines a phase-based video magnification and an interperspective antialiasing into a single filtering process. The whole algorithm is simple and may be efficiently implemented on current GPUs to yield real-time performance. Furthermore, the ability to retarget disparity is naturally supported. The method is robust and works transparent materials, and specularities. The method provides superior results when compared to the state-of-the-art depth-based rendering methods. The method is showcased in the context of a real-time 3D videoconferencing system.
Abstract translation: 多视图自动立体显示器提供了沉浸式，无眼镜的3D观看体验，但是它们优选地从多个视点正确滤波内容。 然而，当前立体生产管道可能不容易获得过滤的内容。 所提出的方法和系统采用立体视频作为输入，并将其转换为可用于驱动多视点自动立体显示器的多视图和滤波视频流。 该方法将基于相位的视频放大和间隔抗锯齿组合到单个滤波过程中。 整个算法很简单，可以在当前的GPU上有效地实现，以实现实时性能。 此外，自然地支持重新定位差异的能力。 该方法是坚固的，透明的材料和镜面反射。 与最先进的基于深度的渲染方法相比，该方法提供了优异的结果。 该方法在实时3D视频会议系统的上下文中展示。
-
公开(公告)号：US10997329B2
公开(公告)日：2021-05-04
申请号：US15012463
申请日：2016-02-01
Applicant: Massachusetts Institute of Technology , Shell Oil Company
Inventor： William T. Freeman , Oral Buyukozturk , John W. Fisher, III , Frederic Durand , Hossein Mobahi , Neal Wadhwa , Zoran Dzunic , Justin G. Chen , James Long , Reza Mohammadi Ghazi , Theodericus Johannes Henricus Smit , Sergio Daniel Kapusta
Abstract: Structural health monitoring (SHM) is essential but can be expensive to perform. In an embodiment, a method includes sensing vibrations at a plurality of locations of a structure by a plurality of time-synchronized sensors. The method further includes determining a first set of dependencies of all sensors of the time-synchronized sensors at a first sample time to any sensors of a second sample time, and determining a second set of dependencies of all sensors of the time-synchronized sensors at the second sample time to any sensors of a third sample time. The second sample time is later than the first sample time, and the third sample time is later than the second sample time. The method then determines whether the structure has changed if the first set of dependencies is different from the second set of dependencies. Therefore, automated SHM can ensure safety at a lower cost to building owners.
-
公开(公告)号：US10288420B2
公开(公告)日：2019-05-14
申请号：US14815092
申请日：2015-07-31
Applicant: Massachusetts Institute of Technology
Inventor： YiChang Shih , Myers Abraham Davis , Samuel Wiliam Hasinoff , Frederic Durand , William T. Freeman
Abstract: In one embodiment, a method comprises projecting, from a projector, a diffused on an object. The method further includes capturing, with a first camera in a particular location, a reference image of the object while the diffused is projected on the object. The method further includes capturing, with a second camera positioned in the particular location, a test image of the object while the diffused is projected on the object. The method further includes comparing speckles in the reference image to the test image. The projector, first camera and second camera are removably provided to and positioned in a site of the object.
-
Patent Agency Ranking
公开(公告)号：US20180096482A1
公开(公告)日：2018-04-05
申请号：US15819791
申请日：2017-11-21
Applicant: Massachusetts Institute of Technology
Inventor： William T. Freeman , Frederic Durand , Tianfan Xue , Michael Rubinstein , Neal Wadhwa
CPC classification number: G06T7/20 , G01P5/001 , G01P5/26 , G02B27/54 , G06T7/246 , G06T2207/10016 , G06T2207/10021 , G06T2207/10056 , G06T2207/30241
Abstract: An apparatus according to an embodiment of the present invention enables measurement and visualization of a refractive field such as a fluid. An embodiment device obtains video captured by a video camera with an imaging plane. Representations of apparent motions in the video are correlated to determine actual motions of the refractive field. A textured background of the scene can be modeled as stationary, with a refractive field translating between background and video camera. This approach offers multiple advantages over conventional fluid flow visualization, including an ability to use ordinary video equipment outside a laboratory without particle injection. Even natural backgrounds can be used, and fluid motion can be distinguished from refraction changes. Embodiments can render refractive flow visualizations for augmented reality, wearable devices, and video microscopes.
-
公开(公告)号：US20180061063A1
公开(公告)日：2018-03-01
申请号：US15445499
申请日：2017-02-28
Applicant: Massachusetts Institute of Technology
Inventor： Oral Buyukozturk , William T. Freeman , Frederic Durand , Myers Abraham Davis , Neal Wadhwa , Justin G. Chen
IPC: G06T7/20
CPC classification number: G06T7/20 , G06T7/262 , G06T7/277 , G06T2207/10016 , G06T2207/20056 , G06T2207/30241 , G06T2207/30244
Abstract: A method and corresponding apparatus for measuring object motion using camera images may include measuring a global optical flow field of a scene. The scene may include target and reference objects captured in an image sequence. Motion of a camera used to capture the image sequence may be determined relative to the scene by measuring an apparent, sub-pixel motion of the reference object with respect to an imaging plane of the camera. Motion of the target object corrected for the camera motion may be calculated based on the optical flow field of the scene and on the apparent, sub-pixel motion of the reference object with respect to the imaging plane of the camera. Embodiments may enable measuring vibration of structures and objects from long distance in relatively uncontrolled settings, with or without accelerometers, with high signal-to-noise ratios.
-
8.发明授权公开(公告)号：US09842404B2
公开(公告)日：2017-12-12
申请号：US14279266
申请日：2014-05-15
Applicant: Massachusetts Institute of Technology
Inventor： William T. Freeman , Frederic Durand , Tianfan Xue , Michael Rubinstein , Neal Wadhwa
CPC classification number: G06T7/20 , G01P5/001 , G01P5/26 , G02B27/54 , G06T7/246 , G06T2207/10016 , G06T2207/10021 , G06T2207/10056 , G06T2207/30241
Abstract: An imaging method and corresponding apparatus according to an embodiment of the present invention enables measurement and visualization of fluid flow. An embodiment method includes obtaining video captured by a video camera with an imaging plane. Representations of motions in the video are correlated. A textured background of the scene can be modeled as stationary, with a refractive field translating between background and video camera. This approach offers multiple advantages over conventional fluid flow visualization, including an ability to use ordinary video equipment outside a laboratory without particle injection. Even natural backgrounds can be used, and fluid motion can be distinguished from refraction changes. Depth and three-dimensional information can be recovered using stereo video, and uncertainty methods can enhance measurement robustness where backgrounds are less textured. Example applications can include avionics and hydrocarbon leak detection.
-
公开(公告)号：US09811901B2
公开(公告)日：2017-11-07
申请号：US13850717
申请日：2013-03-26
Applicant: Massachusetts Institute of Technology
Inventor： Hao-yu Wu , Michael Rubinstein , Eugene Inghaw Shih , John V. Guttag , Frederic Durand , William T. Freeman
CPC classification number: G06T7/0012 , G06T7/0016 , G06T7/254 , G06T7/262 , G06T2207/20016 , G06T2207/30076 , G06T2207/30088 , G06T2207/30104 , G06T2207/30201
Abstract: In one embodiment, a method of amplifying temporal variation in at least two images comprises examining pixel values of the at least two images. The temporal variation of the pixel values between the at least two images can be below a particular threshold. The method can further include applying signal processing to the pixel values.
-
公开(公告)号：US10834372B2
公开(公告)日：2020-11-10
申请号：US16000662
申请日：2018-06-05
Applicant: Massachusetts Institute of Technology
Inventor： Wojciech Matusik , Piotr K. Didyk , William T. Freeman , Petr Kellnhofer , Pitchaya Sitthi-Amorn , Frederic Durand , Szu-Po Wang
IPC: H04N13/111 , G06T7/593 , H04N13/128
Abstract: A method and system of converting stereo video content to multi-view video content combines an Eulerian approach with a Lagrangian approach. The method comprises generating a disparity map for each of the left and right views of a received stereoscopic frame. For each corresponding pair of left and right scanlines of the received stereoscopic frame, the method further comprises decomposing the left and right scanlines into a left sum of wavelets or other basis functions, and a right sum wavelets or other basis functions. The method further comprises establishing an initial disparity correspondence between left wavelets and right wavelets based on the generated disparity maps, and refining the initial disparity between the left wavelet and the right wavelet using a phase difference between the corresponding wavelets. The method further comprises reconstructing at least one novel view based on the left and right wavelets.
-
-
-
-
-
-
-
-
-
Search Results
38
records
(took 0.028 seconds)
