摘要:
In illustrative implementations of this invention, multi-path analysis of transient illumination is used to reconstruct scene geometry, even of objects that are occluded from the camera. An ultrafast camera system is used. It comprises a photo-sensor (e.g., accurate in the picosecond range), a pulsed illumination source (e.g. a femtosecond laser) and a processor. The camera emits a very brief light pulse that strikes a surface and bounces. Depending on the path taken, part of the light may return to the camera after one, two, three or more bounces. The photo-sensor captures the returning light bounces in a three-dimensional time image I(x,y,t) for each pixel. The camera takes different angular samples from the same viewpoint, recording a five-dimensional STIR (Space Time Impulse Response). A processor analyzes onset information in the STIR to estimate pairwise distances between patches in the scene, and then employs isometric embedding to estimate patch coordinates.
摘要:
Provided are an apparatus and method for processing a light field image that is acquired and processed using a mask to spatially modulate a light field. The apparatus includes a lens, a mask to spatially modulate 4D light field data of a scene passing through the lens to include wideband information on the scene, a sensor to detect a 2D image corresponding to the spatially modulated 4D light field data, and a data processing unit to recover the 4D light field data from the 2D image to generate an all-in-focus image.
摘要:
An optical receiver is arranged at a location in a scene. The optical receiver includes a photo sensor configured to detect spatio-temporal modulated optical signals directed at the scene from a set of spatially dispersed optical transmitters, and to convert the optical signals from each of the optical transmitters to a corresponding electronic signal. The electronic signals can be analyzed to determine geometric properties of the location in the scene.
摘要:
A method and system determines a 3D pose of an object in a scene. Depth edges are determined from a set of images acquired of a scene including multiple objects while varying illumination in the scene. The depth edges are linked to form contours. The images are segmented into regions according to the contours. An occlusion graph is constructed using the regions. The occlusion graph includes a source node representing an unoccluded region of an unoccluded object in scene. The contour associated with the unoccluded region is compared with a set of silhouettes of the objects, in which each silhouette has a known pose. The known pose of a best matching silhouette is selected as the pose of the unoccluded object.
摘要:
A bidirectional screen alternately switches between a display mode showing conventional graphics and a capture mode in which the LCD backlight is disabled and the LCD displays a pinhole array or a tiled-broadband code. A large-format image sensor is placed behind the liquid crystal layer. Together, the image sensor and LCD function as a mask-based light field camera, capturing an array of images equivalent to that produced by an array of cameras spanning the display surface. The recovered multi-view orthographic imagery is used to passively estimate the depth of scene points from focus.
摘要:
A method and system marks a scene and images acquired of the scene with tags. A set of tags is projected into a scene while modulating an intensity of each tag according to a unique temporally varying code. Each tag is projected as an infrared signal at a known location in the scene. Sequences of infrared and color images are acquired of the scene while performing the projecting and the modulating. A subset of the tags is detected in the sequence of infrared images. Then, the sequence of color image is displayed while marking a location of each detected tag in the displayed sequence of color images, in which the marked location of the detected tag corresponds to the known location of the tag in the scene.
摘要:
A method increases a resolution of a moving object in an image acquired of a scene by a camera. The image scene is temporally modulated according to a temporally encoding pattern, while integrating the image in a camera sensor to produce a blurred input image. The blurred input image is resolved according to the temporally encoding pattern to produce an enhanced and deblurred output image in which the object has an increased resolution.
摘要:
A method and system generate an enhanced output image. A first image is acquired of a scene illuminated by a first illumination condition. A second image is acquired of the scene illuminated by a second illumination condition. First and second gradient images are determined from the first and second images. Orientations of gradients in the first and second gradient images are compared to produce a combined gradient image, and an enhanced output image is constructed from the combined gradient image.
摘要:
The embodiments of the invention provide a method for increasing a resolution of a moving object in an image acquired of a scene by a camera. An image acquired of a scene including a moving object is temporally modulated, according to a temporally encoding pattern, while integrating the image in a camera sensor to produce a blurred input image. The blurred input image is resolved according to the temporally encoding pattern to produce an enhanced and deblurred output image in which the object has an increased resolution.
摘要:
An optical receiver is arranged at a location in a scene. The optical receiver includes a photo sensor configured to detect spatio-temporal modulated optical signals directed at the scene from a set of spatially dispersed optical transmitters, and to convert the optical signals from each of the optical transmitters to a corresponding electronic signal. The electronic signals can be analyzed to determine geometric properties of the location in the scene.