公开(公告)号：US20040196391A1

公开(公告)日：2004-10-07

申请号：US10407505

申请日：2003-04-04

Applicant: STMicroelectronics, Inc.

Inventor： George Q. Chen ,  Li Hong ,  Peter McGuinness

IPC: H04N005/262

CPC classification number: G06K9/209 ,  G06T5/003 ,  G06T5/50 ,  G06T15/20 ,  G06T2207/10028 ,  H04N5/2258 ,  H04N5/23229

Abstract: A compound camera system comprising component cameras that generate image data of an object and a processor that receives first image data from a first component camera and second image data from a second component camera and generates a virtual image. The processor projects virtual pixel data (u,v) to generate point data (x,y,z) located at depth, znullZ1, of a object plane of the object and projects the said point data (x,y,z) to generate first pixel data (u1,v1) located at a image plane of the first image. The processor also projects said point data (x,y,z) located at the depth, znullZ1, of the said object plane to generate second pixel data (u2,v2) located at the second image. The processor generates the virtual image by combining the color of first pixel data (u1,v1) and the color of second pixel data (u2,v2)

Abstract translation: 一种复合照相机系统，包括产生对象的图像数据的组件相机和从第一组件相机接收第一图像数据的处理器和来自第二组件相机的第二图像数据，并生成虚拟图像。 处理器投影虚拟像素数据（u，v）以生成位于物体的物平面深度z = Z1处的点数据（x，y，z），并投影所述点数据（x，y，z） 以产生位于第一图像的像平面处的第一像素数据（u1，v1）。 处理器还投影位于所述物体平面的深度z = Z1处的所述点数据（x，y，z），以产生位于第二图像处的第二像素数据（u2，v2）。 处理器通过组合第一像素数据（u1，v1）的颜色和第二像素数据（u2，v2）的颜色来生成虚拟图像，

公开(公告)号：US20030072483A1

公开(公告)日：2003-04-17

申请号：US09927558

申请日：2001-08-10

Applicant: STMicroelectronics, Inc.

Inventor： George Q. Chen

IPC: G06K009/00 ,  G06K009/64

CPC classification number: G06K9/32 ,  G06T7/596

Abstract: An image processing system recovers 3-D depth information for pixels of a base image representing a view of a scene. The system detects a plurality of pixels in a base image that represents a first view of a scene. The system the determines 3-D depth of the plurality of pixels in the base image by matching correspondence to a plurality of pixels in a plurality of images representing a plurality of views of the scene. The system then traces pixels in a virtual piecewise continuous depth surface by spatial propagation starting from the detected pixels in the base image by using the matching and corresponding plurality of pixels in the plurality of images to create the virtual piecewise continuous depth surface viewed from the base image, each successfully traced pixel being associated with a depth in the scene viewed from the base image.

Abstract translation: 图像处理系统恢复表示场景视图的基本图像的像素的3-D深度信息。 系统检测表示场景的第一视图的基本图像中的多个像素。 该系统通过与表示场景的多个视图的多个图像中的多个像素匹配对应来确定基本图像中的多个像素的3-D深度。 然后，该系统通过使用多个图像中的匹配和对应的多个像素从基底中检测到的像素开始，从虚拟的分段连续深度表面中追踪像素，从而从基底 图像，每个成功跟踪的像素与从基本图像观看的场景中的深度相关联。

公开(公告)号：US20040196379A1

公开(公告)日：2004-10-07

申请号：US10407490

申请日：2003-04-04

Applicant: STMicroelectronics, Inc.

Inventor： George Q. Chen ,  Li Hong ,  Peter McGuinness

IPC: H04N005/262

CPC classification number: H04N5/247 ,  G06K9/209 ,  G06T15/20 ,  G06T2200/21 ,  G06T2207/10052 ,  H04N5/23232

Abstract: A compound camera system for generating an enhanced virtual image having a large depth-of-field. The compound camera system comprises a plurality of component cameras for generating image data of an object and a data processor for generating the enhanced virtual image from the image data. The data processor generates the enhanced virtual image by generating a first component virtual image at a first depth plane, generating a second component virtual image at a second depth plane, and inserting first selected pixels from the first component virtual image into enhanced the virtual image and inserting second selected pixels from the second component virtual image into the enhanced virtual image.

Abstract translation: 一种复合照相机系统，用于产生具有较大景深的增强的虚像。 复合摄像机系统包括用于生成对象的图像数据的多个分量摄像机和用于从图像数据生成增强的虚像的数据处理器。 数据处理器通过在第一深度平面处产生第一分量虚拟图像来生成增强的虚拟图像，在第二深度平面处生成第二分量虚拟图像，并且将来自第一分量虚拟图像的第一选定像素插入增强的虚拟图像，以及 将第二选定像素从第二分量虚拟图像插入到增强的虚像中。

公开(公告)号：US20030095711A1

公开(公告)日：2003-05-22

申请号：US09993970

申请日：2001-11-16

Applicant: STMICROELECTRONICS, INC.

Inventor： Peter J. McGuinness ,  George Q. Chen ,  Clifford M. Stein ,  Kim C. Ng

IPC: G06K009/62

CPC classification number: G06T7/33

Abstract: An image processing system which processes, in real time, multiple images, which are different views of the same object, of video data in order to match features in the images to support 3 dimensional motion picture production. The different images are captured by multiple cameras, processed by digital processing equipment to identify features and perform preliminary, two-view feature matching. The image data and matched feature point definitions are communicated to an adjacent camera to support at least two image matching. The matched feature point data are then transferred to a central computer, which performs a multiple-view correspondence between all of the images.

Abstract translation: 一种图像处理系统，其实时地处理视频数据的同一对象的不同视图的多个图像，以便匹配图像中的特征以支持三维电影制作。 不同的图像由多个摄像机捕获，由数字处理设备处理以识别特征并执行初步的两视图特征匹配。 图像数据和匹配的特征点定义被传送到相邻的相机以支持至少两个图像匹配。 然后将匹配的特征点数据传送到中央计算机，其在所有图像之间执行多视图对应。