公开(公告)号：US07196722B2

公开(公告)日：2007-03-27

申请号：US09860962

申请日：2001-05-18

申请人： Patrick White ,  Brian Hunt ,  G. David Ripley

发明人： Patrick White ,  Brian Hunt ,  G. David Ripley

IPC分类号： H04N5/232 ,  H04N5/225

CPC分类号： H04N21/23406 ,  G11B27/034 ,  H04N5/23203 ,  H04N5/23206 ,  H04N7/17318 ,  H04N7/181 ,  H04N21/2187 ,  H04N21/234345 ,  H04N21/234354 ,  H04N21/23439 ,  H04N21/4312 ,  H04N21/4314 ,  H04N21/6125 ,  H04N21/6373 ,  H04N21/8126 ,  H04N21/84

摘要： Multiple streams of data are streamed to a user's terminal with images from different cameras. Low resolution thumbnail images tell the user what image streams are available. A focus stream provides high resolution images from a selected camera. A user can switch the focus stream to another stream by clicking on the associated thumbnail. The users can also be provided with a thumbnail of panoramic image. Other data streams sent to the user can contain (a) audio data, (b) interactivity markup data which describes regions of the image which provide interactivity opportunities such as hotspots, (c) presentation markup data which defines how data is presented on the user's screen, (d) a telemetry data stream which can be used for various statistical data. One data stream contains a low quality base image for each data stream which can be enhanced to form a high resolution focus image.

摘要翻译： 使用来自不同相机的图像将多个数据流流式传输到用户的终端。 低分辨率缩略图告诉用户什么图像流可用。 焦点流提供来自所选相机的高分辨率图像。 用户可以通过点击关联的缩略图将焦点流切换到另一个流。 还可以向用户提供全景图像的缩略图。 发送给用户的其他数据流可以包含（a）音频数据，（b）描述提供诸如热点之类交互机会的图像区域的交互性标记数据，（c）表示标记数据，其定义如何在用户的 屏幕，（d）可以用于各种统计数据的遥测数据流。 一个数据流包含每个数据流的低质量基本图像，其可被增强以形成高分辨率聚焦图像。

公开(公告)号：US06337683B1

公开(公告)日：2002-01-08

申请号：US09310715

申请日：1999-05-12

申请人： Scott Gilbert ,  David J. Kaiman ,  Michael C. Park ,  G. David Ripley

发明人： Scott Gilbert ,  David J. Kaiman ,  Michael C. Park ,  G. David Ripley

IPC分类号： G06T100

CPC分类号： H04N5/2628 ,  H04N5/23238 ,  H04N5/77 ,  H04N5/775 ,  H04N9/8047 ,  H04N9/8063 ,  H04N9/8205

摘要： Movement through multi-dimensional space is simulated using a series of panoramic images which are projected or displayed in sequence. The user's direction of view, that is the selected view window, is maintained as the series of images is projected or displayed. Motion in directions other than forward or reverse is simulated by utilizing “branch” points in the sequence. Each path from a branch point simulates motion in a different direction. Branch points are generally indicated to a viewer by visual indicators called “hot spots”; however, branch points may also be hidden and activated in response to the viewer's selected direction of view. If a branch point is indicated by a visual indicator, a user can select motion in a desired direction by clicking on a “hot spot”. In order to conserve storage space, the image representing each panorama can be stored in a compressed format. Only the portion of the panorama necessary to create a “view window” that is, the portion of the image displayed in response to the user's direction of view, is decompressed at view time. An index methodology is used to store the panoramic images. Use of the indexing methodology allows the images to be retrieved in both the forward and backward direction to simulate movement in either direction. Sound is provided in a special format, so that special effects can be provided based on the user's point of view and dependent upon the direction of motion selected by the user.

摘要翻译： 通过多维空间的运动是使用一系列全景图像进行模拟的，这些全景图像被依次投射或显示。 当投影或显示一系列图像时，维护用户的观看方向，即所选视图窗口。 通过利用序列中的“分支”点来模拟正向或反向以外的方向的运动。 来自分支点的每个路径模拟不同方向的运动。 分支点通常被称为“热点”的视觉指示给观察者; 然而，分支点也可以响应于观众的所选择的观看方向被隐藏和激活。 如果通过视觉指示器指示分支点，则用户可以通过点击“热点”来选择所需方向的运动。 为了节省存储空间，表示每个全景的图像可以以压缩格式存储。 只有创建“视窗”所必需的部分全景图像，就是在视图时解压缩响应于用户观看方向显示的图像部分。 索引方法用于存储全景图像。 使用索引方法允许在向前和向后方向上检索图像以模拟任一方向上的移动。 以特殊格式提供声音，使得可以基于用户的观点并且取决于用户选择的运动方向来提供特殊效果。

公开(公告)号：US06738073B2

公开(公告)日：2004-05-18

申请号：US10136659

申请日：2002-04-30

申请人： Michael C. Park ,  G. David Ripley

发明人： Michael C. Park ,  G. David Ripley

IPC分类号： G09G500

CPC分类号： G06T3/0012 ,  G06T5/50 ,  H04N5/232 ,  H04N5/23238 ,  H04N5/77 ,  H04N7/181 ,  H04N9/8047 ,  H04N9/806 ,  H04N9/8211 ,  H04N9/8227 ,  H04N9/8233 ,  H04N17/002

摘要： An improved surveillance system which includes a multi-lens camera system and a viewer. The camera system includes a plurality of single lens cameras each of which have a relatively wide angle lens. These single lens cameras simultaneously capture images that can be seamed into a panorama. The camera system also includes a high resolution camera (i.e. a camera with a telephoto lens) that can be pointed in a selected direction that is within the field of view of the other cameras. The system displays a view window into the panorama that is created from images captured by the wide angle lenses. The image from the high resolution camera is either superimposed on top of the panoramic image or it is displayed on a separate monitor. If it is displayed in the panorama, the higher solution image is positioned at the point in the panorama which is displaying the same area in space at a lower resolution. Thus an operator sees a relatively low resolution panorama; however, a selected portion of the panorama is displayed at a high resolution. An operator can point the high resolution camera toward any desired location, thereby providing an output which shows more detail in a selected area of the panorama.

摘要翻译： 一种改进的监视系统，其包括多镜头相机系统和观看者。 相机系统包括多个具有相对广角镜头的单透镜相机。 这些单镜头相机同时捕获可以缝合成全景的图像。 相机系统还包括可以指向在其它相机的视野范围内的所选方向的高分辨率相机（即，具有远摄镜头的相机）。 系统将视图窗口显示到由广角镜头捕获的图像创建的全景图中。 来自高分辨率相机的图像或者叠加在全景图像的顶部，或者显示在单独的显示器上。 如果在全景图中显示，则较高的解决方案图像位于全景图中以较低分辨率在空间中显示相同区域的点。 因此，操作者看到相对较低的分辨率全景; 然而，以高分辨率显示全景的所选部分。 操作员可以将高分辨率相机指向任何所需的位置，从而提供在全景图的选定区域中显示更多细节的输出。

公开(公告)号：US06690374B2

公开(公告)日：2004-02-10

申请号：US10228541

申请日：2002-08-27

申请人： Michael C. Park ,  Gwendolyn Hunt ,  G. David Ripley

发明人： Michael C. Park ,  Gwendolyn Hunt ,  G. David Ripley

IPC分类号： G06T1520

CPC分类号： G08B13/19628 ,  G08B13/19608 ,  G08B13/19626 ,  G08B13/19641 ,  G08B13/19693 ,  H04N5/232 ,  H04N5/23238 ,  H04N5/77 ,  H04N7/181 ,  H04N9/8047 ,  H04N9/806 ,  H04N9/8211 ,  H04N9/8227 ,  H04N9/8233

摘要： A surveillance system that includes a number of camera subsystems. Each camera subsystem includes a number of single lens cameras pointing in different directions which simultaneously capture images. Each camera subsystem covers a particular theater of interest. Each single lens camera captures an image of a particular region in a particular theater. When an object of interest is identified, the system can follow the object as it moves between regions and theaters in a facility. When an object is being followed, the system can provide a view of the object as it transitions between regions covered different single lens cameras in a particular camera subsystem and as it transitions between theaters covered by different camera subsystems.

摘要翻译： 包括多个摄像机子系统的监视系统。 每个相机子系统包括指向不同方向的多个单镜头相机，其同时捕获图像。 每个相机子系统覆盖特定的感兴趣的剧院。 每个单镜头相机捕获特定剧院中特定区域的图像。 当感兴趣的对象被识别时，系统可以跟随对象，因为它在设施中的区域和剧院之间移动。 当对象被跟踪时，系统可以提供对象的视图，因为它在覆盖特定照相机子系统中的不同单个镜头相机的区域之间转换，并且当它在由不同相机子系统覆盖的剧院之间转变时。

公开(公告)号：US06654019B2

公开(公告)日：2003-11-25

申请号：US10003399

申请日：2001-10-22

申请人： Scott Gilbert ,  David J. Kaiman ,  Michael C. Park ,  G. David Ripley

发明人： Scott Gilbert ,  David J. Kaiman ,  Michael C. Park ,  G. David Ripley

IPC分类号： G06T1300

CPC分类号： H04N5/2628 ,  H04N5/23238 ,  H04N5/77 ,  H04N5/775 ,  H04N9/8047 ,  H04N9/8063 ,  H04N9/8205

摘要： Movement through multi-dimensional space is simulated using a series of panoramic images which are projected or displayed in sequence. The user's direction of view, that is the selected view window, is maintained as the series of images is projected or displayed. Motion in directions other than forward or reverse is simulated by utilizing “branch” points in the sequence. Each path from a branch point simulates motion in a different direction. Branch points are generally indicated to a viewer by visual indicators called “hot spots”; however, branch points may also be hidden and activated in response to the viewer's selected direction of view. If a branch point is indicated by a visual indicator, a user can select motion in a desired direction by clicking on a “hot spot”. In order to conserve storage space, the image representing each panorama can be stored in a compressed format. Only the portion of the panorama necessary to create a “view window” that is, the portion of the image displayed in response to the user's direction of view, is decompressed at view time. An index methodology is used to store the panoramic images. Use of the indexing methodology allows the images to be retrieved in both the forward and backward direction to simulate movement in either direction. Sound is provided in a special format, so that special effects can be provided based on the user's point of view and dependent upon the direction of motion selected by the user.

摘要翻译： 通过多维空间的运动是使用一系列全景图像进行模拟的，这些全景图像被依次投射或显示。 当投影或显示一系列图像时，维护用户的观看方向，即所选视图窗口。 通过利用序列中的“分支”点来模拟正向或反向以外的方向的运动。 来自分支点的每个路径模拟不同方向的运动。 分支点通常被称为“热点”的视觉指示给观察者; 然而，分支点也可以响应于观众的所选择的观看方向被隐藏和激活。 如果通过视觉指示器指示分支点，则用户可以通过点击“热点”来选择所需方向上的运动。为了节省存储空间，可以以压缩格式存储表示每个全景的图像。 只有创建“视窗”所必需的部分全景图像，就是在视图时解压缩响应于用户观看方向显示的图像部分。 索引方法用于存储全景图像。 使用索引方法允许在向前和向后方向上检索图像以模拟任一方向上的移动。 以特殊格式提供声音，使得可以基于用户的观点并且取决于用户选择的运动方向来提供特殊效果。

公开(公告)号：US06323858B1

公开(公告)日：2001-11-27

申请号：US09338790

申请日：1999-06-23

申请人： Scott Gilbert ,  David J. Kaiman ,  Michael C. Park ,  G. David Ripley

发明人： Scott Gilbert ,  David J. Kaiman ,  Michael C. Park ,  G. David Ripley

IPC分类号： G06T1500

CPC分类号： H04N5/23238 ,  H04N5/232 ,  H04N5/77 ,  H04N7/181 ,  H04N9/8047 ,  H04N9/806 ,  H04N9/8211 ,  H04N9/8227 ,  H04N9/8233

摘要： The present invention provides a very flexible, digital system for capturing and storing panoramic images using progressive scan (that is, non interlaced) technology. The system includes a digital image input device and an associated control computer. Since the image capture device is digital it can be easily and flexibly controlled by software in the control computer. The image input device has six lenses positioned on the six faces of a cube. While the image input system can have other lens configurations, the use of six lenses in a cubic configuration is optimal for a system that is used to capture a spherical panorama. The six lenses simultaneously focuses different images on six CCDs (Charge Coupled Devices). The image input device also includes an embedded controller, and data compression circuitry. The embedded controller controls the exposure time of the CCDs (i.e. the effective aperture and effective shutter speed) and reads image data from the CCDs. The image data read from the CCDs is compressed, multiplexed, and sent to the control computer. The control computer stores the images in frames, each of which have one image from each of the six lenses. Each frame includes six images that were simultaneously recorded and any associated information, such as audio tracks, textual information, or environmental information such as GPS (Global Position System) data or artificial horizon data. The control computer includes a user interface which allows a user to specify control information such as frame rate, compression ratio, gain, etc. The control computer sends control information to the embedded controller which in turn controls the CCDs and the compression circuitry. The images can be sent from the control computer to a real time viewer so that a user can determine if the correct images are being captured. The images stored at the control computer are later seamed into panoramas and made into panoramic movies.