公开(公告)号：US07245287B2

公开(公告)日：2007-07-17

申请号：US10982284

申请日：2004-11-04

申请人： Kenneth P. Hinckley ,  Michael J. Sinclair ,  Richard S. Szeliski ,  Matthew J. Conway ,  Erik J. Hanson

发明人： Kenneth P. Hinckley ,  Michael J. Sinclair ,  Richard S. Szeliski ,  Matthew J. Conway ,  Erik J. Hanson

IPC分类号： G09G5/00

CPC分类号： G06F3/0317 ,  G06F3/0346 ,  G06F3/0395

摘要： A pad for a computer input device includes a top surface over which the input device is slid and a bottom surface, opposite the top surface, for contacting a support surface. The bottom surface having a raised pivot portion allowing movement of the pad about the pivot portion.

摘要翻译： 用于计算机输入装置的垫包括输入装置滑动的顶表面和与顶表面相对的底表面，用于接触支撑表面。 底表面具有凸起的枢转部分，允许垫绕枢转部分移动。

公开(公告)号：US07155032B2

公开(公告)日：2006-12-26

申请号：US11242585

申请日：2005-10-01

申请人： Richard S. Szeliski ,  Shmuel Avidan ,  Padmanabhan Anandan

发明人： Richard S. Szeliski ,  Shmuel Avidan ,  Padmanabhan Anandan

IPC分类号： G06K9/00

CPC分类号： H04N19/53 ,  G06T7/215

摘要： The present invention is embodied in a system and method for extracting structure from multiple images of a scene by representing the scene as a group of image layers, including reflection and transparency layers. In general, the present invention performs layer extraction from multiple images containing reflections and transparencies. The present invention includes an optimal approach for recovering layer images and their associated motions from an arbitrary number of composite images. The present invention includes image formation equations, the constrained least squares technique used to recover the component images, a novel method to estimate upper and lower bounds on the solution using min- and max-composites, and a motion refinement method.

公开(公告)号：US06993156B1

公开(公告)日：2006-01-31

申请号：US09504022

申请日：2000-02-18

申请人： Richard S. Szeliski ,  Nicholas P. Wilt

发明人： Richard S. Szeliski ,  Nicholas P. Wilt

IPC分类号： G06K9/00

CPC分类号： G06K9/00973 ,  G06K9/6203

摘要： The present invention is embodied in a system and method for statistically comparing a first set of digital data to at least a second set of digital data and matching the first set of digital data to appropriately corresponding portions of the second set of digital data. The first or the second set of digital data can be transformed during statistical analysis to enhance statistical analysis of the digital data.

摘要翻译： 本发明体现在用于将第一组数字数据与至少第二组数字数据统计比较并将第一组数字数据与第二组数字数据的适当对应部分匹配的系统和方法。 第一组或第二组数字数据可以在统计分析过程中进行变换，以增强数字数据的统计分析。

公开(公告)号：US06650774B1

公开(公告)日：2003-11-18

申请号：US09411619

申请日：1999-10-01

申请人： Richard S. Szeliski

发明人： Richard S. Szeliski

IPC分类号： G06K900

CPC分类号： G06T5/40 ,  G06T5/008 ,  G06T2207/20012 ,  G06T2207/20216

摘要： A system and method for improving the uniformity in exposure and tone of a digital image using a locally adapted histogram equalization approach. This approach involves first segmenting the digital image into a plurality of image patches. For each of these patches, a pixel brightness level histogram is created. The histogram for each patch is then optionally averaged with the histograms associated with a prescribed number of neighboring image patches. A normalized cumulative distribution function is generated for each patch based on the associated averaged histogram. This normalized-cumulative distribution function identifies a respective new pixel brightness level for each of the original pixel brightness levels. For each of the original pixel brightness levels, the 1s associated new pixel brightness levels from one or more of the image patches are blended. Preferably, this blending is accomplished using either a bilinear or biquadratic interpolator function. Finally, for each image patch, the original pixel brightness level of each pixel in the image patch is replaced with the blended pixel brightness level corresponding to that original brightness level. A further refinement can also be implemented to mitigate the effects of noise caused by areas of a single color in the scene depicted in patch. In one embodiment, this refinement entails employing a partially equalization approach. In another embodiment, the refinement entails limiting the gain exhibited by any of the blended pixel brightness levels associated with an image patch, in comparison to its associated original pixel brightness level, to a prescribed level.

摘要翻译： 一种用于使用局部适应的直方图均衡方法来改善数字图像的曝光和色调的均匀性的系统和方法。 该方法包括首先将数字图像分割成多个图像块。 对于每个这些补丁，创建像素亮度级别直方图。 然后可选地使用与规定数量的相邻图像块相关联的直方图平均每个贴片的直方图。 基于相关联的平均直方图为每个贴片生成归一化的累积分布函数。 该归一化累积分布函数识别每个原始像素亮度级别的相应新的像素亮度级别。 对于每个原始像素亮度级别，将来自一个或多个图像块的1s相关联的新像素亮度级别进行混合。 优选地，这种混合是使用双线性或双向内插函数完成的。 最后，对于每个图像补丁，图像补丁中每个像素的原始像素亮度水平被替换为与该原始亮度水平相对应的混合像素亮度水平。 还可以进一步改进以减轻由补丁中描绘的场景中的单一颜色的区域引起的噪声的影响。 在一个实施例中，这种细化需要采用部分均衡方法。 在另一个实施例中，细化需要将与其相关联的原始像素亮度水平相比较的与图像块相关联的任何混合像素亮度水平所显示的增益限制到规定水平。

公开(公告)号：US06600491B1

公开(公告)日：2003-07-29

申请号：US09643782

申请日：2000-08-22

申请人： Richard S. Szeliski ,  David Salesin ,  Arno Schödl

发明人： Richard S. Szeliski ,  David Salesin ,  Arno Schödl

IPC分类号： G06T1570

CPC分类号： G06T13/80

摘要： A system and process for generating a video animation from the frames of a video sprite with user-controlled motion is presented. An object is extracted from the frames of an input video and processed to generate a new video sequence or video sprite of that object. In addition, the translation velocity of the object for each frame is computed and associated with each frame in the newly generated video sprite. The system user causes a desired path to be generated for the object featured in the video sprite to follow in the video animation. Frames of the video sprite showing the object of interest are selected and inserted in a background image, or frame of a background video, along the prescribed path. The video sprite frames are selected by comparing a last-selected frame to the other video sprite frames, and selecting a video sprite frame that is identified in the comparison as corresponding to an acceptable transition from the last-selected frame. Each newly selected video sprite frame is inserted at a point along the prescribed path dictated by the velocity associated with the object in the last-inserted frame. The process of selecting, inserting and comparing video sprite frames to create successive frames of the video animation continues for as long as it is desired to produce new frames of the video animation.

摘要翻译： 提出了一种用于通过用户控制的运动从视频子画面的帧生成视频动画的系统和过程。 从输入视频的帧中提取对象并进行处理以产生该对象的新视频序列或视频子画面。 另外，每个帧的对象的平移速度被计算并且与新产生的视频子画面中的每帧相关联。 系统用户会为视频精灵中特征的对象生成所需的路径，以跟踪视频动画。 选择显示感兴趣对象的视频子画面的帧，并沿着规定路径插入背景图像或背景视频的帧中。 通过将最后选择的帧与其他视频子画面帧进行比较来选择视频子画面帧，并且选择在比较中识别的与从最后选择的帧可接受的转变相对应的视频子画面帧。 每个新选择的视频子画框被插入在由与最后插入的帧中的对象相关联的速度指定的规定路径的点处。 选择，插入和比较视频子画面帧以创建视频动画的连续帧的过程持续，只要期望产生视频动画的新帧。

公开(公告)号：US06246412B1

公开(公告)日：2001-06-12

申请号：US09099097

申请日：1998-06-18

申请人： Heung-Yeung Shum ,  Mei Han ,  Richard S. Szeliski

发明人： Heung-Yeung Shum ,  Mei Han ,  Richard S. Szeliski

IPC分类号： G06T1500

CPC分类号： G06T15/10

摘要： A system and process for refining a model of a 3D scene using one or more panoramic views of the scene. An image of a panoramic view is displayed on a screen and a previously constructed model of the 3D scene is projected onto the screen image. Once the model is projected, any portion thereof that is not aligned with its corresponding feature in the screen image is moved so as to be in alignment. Plane normals and line directions for previously modeled planes in the 3D scene are then estimated using, inter alia, the newly aligned lines of the previous model. There may also be new, unmodeled features appearing in the screen image. These features can also be modeled, if desired. Next, plane distances and vertex point locations of each plane in the 3D scene that is to be modeled are estimated. In general, this entails solving of a system of linear geometric constraint equations created from the aforementioned plane normals and line directions, and preferably, user-designated parameters associated with the geometry of the scene. If the initial model employed in the refinement process was constructed using similar methods, then it is preferred to include the associated constraint equations in the system of equations. The system of equations is solve using any of various methods and the refined model of the 3D scene is constructed. If additional panoramic views of the scene are available, the model can be refined even further using the just-described system and process.

摘要翻译： 一种使用场景的一个或多个全景图来精炼3D场景的模型的系统和过程。 将全景图像显示在屏幕上，将3D场景的先前构造的模型投影到屏幕图像上。 一旦模型投影，其与屏幕图像中其对应特征不对准的任何部分被移动以便对准。 然后使用特别是先前模型的新对齐的线来估计3D场景中先前建模的平面的平面法线和线方向。 屏幕图像中也可能出现新的未建模的功能。 如果需要，也可以对这些特征进行建模。 接下来，估计要被建模的3D场景中的每个平面的平面距离和顶点位置。 一般来说，这需要解决由上述平面法线和线方向创建的线性几何约束方程，并且优选地，与场景的几何形状相关联的用户指定的参数。 如果使用类似方法构建精化过程中使用的初始模型，则优选在方程组中包括相关约束方程。 使用各种方法中的任意一种求解方程组，并构建了3D场景的精细模型。 如果场景的其他全景视图可用，则可以使用刚刚描述的系统和过程进一步改进模型。

公开(公告)号：US06215496B1

公开(公告)日：2001-04-10

申请号：US09121797

申请日：1998-07-23

申请人： Richard S. Szeliski ,  Michael F. Cohen

发明人： Richard S. Szeliski ,  Michael F. Cohen

IPC分类号： G06F1500

CPC分类号： G06T15/04 ,  G06T15/10

摘要： A sprite data structure includes multiple pixels that each have conventional image information (e.g., color and transparency) relating to the appearance of the sprite. The data structure of each pixel includes a depth component or value representing a displacement of the pixel from a selected plane. In a sprite rendering process, the depth values of an input or source sprite are forward mapped (i.e., warped) to the depth values of an output or a destination sprite. Based upon the forward mapping of the depth values in the destination sprite, a backward mapping is performed on the image information from the source sprite to the destination sprite so that it can be rendered. This provides the destination sprite with parallax-based offsets that can create a very strong impression of three-dimensionality between and within the sprites.

摘要翻译： 子画面数据结构包括多个像素，每个像素具有与子画面的外观相关的常规图像信息（例如，颜色和透明度）。 每个像素的数据结构包括表示来自所选平面的像素的位移的深度分量或值。 在子画面渲染过程中，输入或源精灵的深度值被前向映射（即扭曲）到输出或目标精灵的深度值。 基于目标精灵中的深度值的前向映射，对从源精灵到目标精灵的图像信息执行反向映射，使得可以呈现。 这为目标精灵提供了基于视差的偏移，可以在精灵之间和之间产生非常强烈的三维立体感。