SYSTEM FOR BACKGROUND SUBTRACTION WITH 3D CAMERA
    1.
    发明申请
    SYSTEM FOR BACKGROUND SUBTRACTION WITH 3D CAMERA 有权
    背景技术3D摄像机系统

    公开(公告)号:US20140294288A1

    公开(公告)日:2014-10-02

    申请号:US14174498

    申请日:2014-02-06

    IPC分类号: G06T5/50 G06K9/00

    摘要: A system for background image subtraction includes a computing device coupled with a 3D video camera, a processor of the device programmed to receive a video feed from the camera containing images of one or more subject that include depth information. The processor, for an image: segments pixels and corresponding depth information into three different regions including foreground (FG), background (BG), and unclear (UC); categorizes UC pixels as FG or BG using a function that considers the color and background history (BGH) information associated with the UC pixels and the color and BGH information associated with pixels near the UC pixels; examines the pixels marked as FG and applies temporal and spatial filters to smooth boundaries of the FG regions; constructs a new image by overlaying the FG regions on top of a new background; displays a video feed of the new image in a display device; and continually maintains the BGH.

    摘要翻译: 用于背景图像减除的系统包括与3D摄像机耦合的计算设备,该设备的处理器被编程为从摄像机接收包含包括深度信息的一个或多个被摄体的图像的视频馈送。 用于图像的处理器:将像素和相应的深度信息分成三个不同的区域,包括前景(FG),背景(BG)和不清楚(UC); 使用考虑与UC像素相关联的颜色和背景历史(BGH)信息以及与UC像素附近的像素相关联的颜色和BGH信息的功能将UC像素分类为FG或BG; 检查标记为FG的像素,并应用时间和空间滤波器来平滑FG区域的边界; 通过在新背景之上覆盖FG区域来构建新图像; 在显示设备中显示新图像的视频馈送; 并不断维护BGH。

    SYSTEM AND METHOD FOR GENERATING A DEPTH MAP AND FUSING IMAGES FROM A CAMERA ARRAY
    2.
    发明申请
    SYSTEM AND METHOD FOR GENERATING A DEPTH MAP AND FUSING IMAGES FROM A CAMERA ARRAY 有权
    用于从摄像机阵列产生深度地图和融合图像的系统和方法

    公开(公告)号:US20130010073A1

    公开(公告)日:2013-01-10

    申请号:US13544795

    申请日:2012-07-09

    IPC分类号: H04N13/02

    摘要: A method, apparatus, system, and computer program product for of digital imaging. Multiple cameras comprising lenses and digital images sensors are used to capture multiple images of the same subject, and process the multiple images using difference information (e.g., an image disparity map, an image depth map, etc.). The processing commences by receiving a plurality of image pixels from at least one first image sensor, wherein the first image sensor captures a first image of a first color, receives a stereo image of the first color, and also receives other images of other colors. Having the stereo imagery, then constructing a disparity map and an associated depth map by searching for pixel correspondences between the first image and the stereo image. Using the constructed disparity map, captured images are converted into converted images, which are then combined with the first image, resulting in a fused multi-channel color image.

    摘要翻译: 一种用于数字成像的方法,装置,系统和计算机程序产品。 使用包括透镜和数字图像传感器的多个相机捕获同一被摄体的多个图像,并使用差分信息(例如,图像视差图,图像深度图等)处理多个图像。 处理开始于从至少一个第一图像传感器接收多个图像像素,其中第一图像传感器捕获第一颜色的第一图像,接收第一颜色的立体图像,并且还接收其它颜色的其他图像。 拥有立体图像,然后通过搜索第一图像和立体图像之间的像素对应度来构建视差图和相关联的深度图。 使用构造的视差图,将捕获的图像转换成转换的图像,然后将其与第一图像组合,得到融合的多通道彩色图像。

    System and method for generating a depth map and fusing images from a camera array
    3.
    发明授权
    System and method for generating a depth map and fusing images from a camera array 有权
    用于生成深度图并融合相机阵列的图像的系统和方法

    公开(公告)号:US09300946B2

    公开(公告)日:2016-03-29

    申请号:US13544795

    申请日:2012-07-09

    IPC分类号: H04N13/02 H04N13/00 G03B35/12

    摘要: A method, apparatus, system, and computer program product for of digital imaging. Multiple cameras comprising lenses and digital images sensors are used to capture multiple images of the same subject, and process the multiple images using difference information (e.g., an image disparity map, an image depth map, etc.). The processing commences by receiving a plurality of image pixels from at least one first image sensor, wherein the first image sensor captures a first image of a first color, receives a stereo image of the first color, and also receives other images of other colors. Having the stereo imagery, then constructing a disparity map and an associated depth map by searching for pixel correspondences between the first image and the stereo image. Using the constructed disparity map, captured images are converted into converted images, which are then combined with the first image, resulting in a fused multi-channel color image.

    摘要翻译: 一种用于数字成像的方法,装置,系统和计算机程序产品。 使用包括透镜和数字图像传感器的多个相机捕获同一被摄体的多个图像,并使用差分信息(例如,图像视差图,图像深度图等)处理多个图像。 处理开始于从至少一个第一图像传感器接收多个图像像素,其中第一图像传感器捕获第一颜色的第一图像,接收第一颜色的立体图像,并且还接收其它颜色的其他图像。 拥有立体图像,然后通过搜索第一图像和立体图像之间的像素对应度来构建视差图和相关联的深度图。 使用构造的视差图,将捕获的图像转换成转换的图像,然后将其与第一图像组合,得到融合的多通道彩色图像。

    Systems and methods for accurate user foreground video extraction
    4.
    发明授权
    Systems and methods for accurate user foreground video extraction 有权
    准确的用户前景视频提取的系统和方法

    公开(公告)号:US08818028B2

    公开(公告)日:2014-08-26

    申请号:US13083470

    申请日:2011-04-08

    IPC分类号: G06K9/00 H04N5/272

    CPC分类号: H04N5/272

    摘要: A color image and a depth image of a live video are received. Each of the color image and the depth image are processed to identify a foreground, background, and an unknown region band of the live video. The unknown region band may comprise pixels between the foreground and the background. Further processing is performed to segment the pixels of the unknown region band between the foreground and the background. As such, processing is performed on the unknown region band in order to provide an improved user foreground video.

    摘要翻译: 接收直播视频的彩色图像和深度图像。 处理彩色图像和深度图像中的每一个以识别实况视频的前景,背景和未知区域频带。 未知区域带可以包括前景和背景之间的像素。 执行进一步的处理以分割前景和背景之间的未知区域带的像素。 因此,为了提供改进的用户前景视频,对未知区域频带执行处理。

    Systems and methods for generating a virtual camera viewpoint for an image
    6.
    发明授权
    Systems and methods for generating a virtual camera viewpoint for an image 有权
    用于生成图像的虚拟相机视点的系统和方法

    公开(公告)号:US09053573B2

    公开(公告)日:2015-06-09

    申请号:US13098363

    申请日:2011-04-29

    IPC分类号: G06T15/20

    CPC分类号: G06T15/20 G06T15/205

    摘要: A color image and a depth image of a live video are received. A user is extracted from the information of the color image and the depth image. Spurious depth vales may be corrected. Points or pixels of an image as seen from a viewpoint of a reference camera at a reference camera location are mapped to points of the image as would be seen from a viewpoint of a virtual camera at a virtual camera location. As such, a transformed color image is generated. Disoccluded pixels may be processed to address any gaps within the transformed color image.

    摘要翻译: 接收直播视频的彩色图像和深度图像。 从彩色图像和深度图像的信息中提取用户。 杂散深度值可能会被纠正。 从参考摄像机位置处的参考摄像机的视点看到的图像的点或像素被映射到从虚拟摄像机位置处的虚拟摄像机的视点看到的图像的点。 因此,生成变换的彩色图像。 可以处理偏移像素以解决变换的彩色图像内的任何间隙。

    Systems and methods for illumination correction of an image
    7.
    发明授权
    Systems and methods for illumination correction of an image 有权
    图像照明校正的系统和方法

    公开(公告)号:US09008457B2

    公开(公告)日:2015-04-14

    申请号:US13149715

    申请日:2011-05-31

    IPC分类号: G06K9/00 G06T5/00

    CPC分类号: G06T5/008

    摘要: An RGB color image and an infrared intensity image of a live video are received. The RGB color image is converted to a colorspace image comprising a channel corresponding to a brightness value. Each pixel of the converted colorspace image is evaluated to determine whether the brightness channel of the pixel exceeds a threshold value. If the brightness channel of the pixel exceeds the threshold value, the infrared intensity value of a corresponding pixel from the infrared intensity image is mixed into the pixel's channel value that corresponds to brightness. The converted colorspace image is converted back to an RGB color image.

    摘要翻译: 接收实时视频的RGB彩色图像和红外强度图像。 RGB彩色图像被转换为​​包括对应于亮度值的通道的颜色空间图像。 评估转换的颜色空间图像的每个像素以确定像素的亮度通道是否超过阈值。 如果像素的亮度通道超过阈值,则来自红外线强度图像的相应像素的红外强度值被混合到与亮度对应的像素通道值中。 转换的颜色空间图像被转换回RGB彩色图像。

    SYSTEM FOR EXECUTING 3D PROPAGATION FOR DEPTH IMAGE-BASED RENDERING
    8.
    发明申请
    SYSTEM FOR EXECUTING 3D PROPAGATION FOR DEPTH IMAGE-BASED RENDERING 有权
    用于执行深度图像渲染的3D传播系统

    公开(公告)号:US20140293010A1

    公开(公告)日:2014-10-02

    申请号:US14171141

    申请日:2014-02-03

    IPC分类号: H04N13/04 H04N13/02

    摘要: A system is disclosed for executing depth image-based rendering of a 3D image by a computer having a processor and that is coupled with one or more color cameras and at least one depth camera. The color cameras and the depth camera are positionable at different arbitrary locations relative to a scene to be rendered. In some examples, the depth camera is a low resolution camera and the color cameras are high resolution. The processor is programmed to propagate depth information from the depth camera to an image plane of each color camera to produce a propagated depth image at each respective color camera, to enhance the propagated depth image at each color camera with the color and propagated depth information thereof to produce corresponding enhanced depth images, and to render a complete, viewable image from one or more enhanced depth images from the color cameras. The processor may be a graphics processing unit.

    摘要翻译: 公开了一种用于由具有处理器的计算机执行3D图像的深度基于图像的渲染并且与一个或多个彩色照相机和至少一个深度相机耦合的系统。 彩色相机和深度相机可以相对于要呈现的场景在不同的任意位置定位。 在一些示例中,深度相机是低分辨率相机,彩色相机是高分辨率的。 处理器被编程为将深度信息从深度摄像机传播到每个彩色摄像机的图像平面,以在每个相应的彩色摄像机处产生传播的深度图像,以增强每个彩色摄像机的彩色和传播深度信息的传播深度图像 以产生相应的增强深度图像,并且从彩色相机提供来自一个或多个增强深度图像的完整的可观看图像。 处理器可以是图形处理单元。

    SYSTEMS AND METHODS FOR ILLUMINATION CORRECTION OF AN IMAGE
    9.
    发明申请
    SYSTEMS AND METHODS FOR ILLUMINATION CORRECTION OF AN IMAGE 有权
    用于照片校正的图像的系统和方法

    公开(公告)号:US20110293179A1

    公开(公告)日:2011-12-01

    申请号:US13149715

    申请日:2011-05-31

    IPC分类号: G06K9/00

    CPC分类号: G06T5/008

    摘要: An RGB color image and an infrared intensity image of a live video are received. The RGB color image is converted to a colorspace image comprising a channel corresponding to a brightness value. Each pixel of the converted colorspace image is evaluated to determine whether the brightness channel of the pixel exceeds a threshold value. If the brightness channel of the pixel exceeds the threshold value, the infrared intensity value of a corresponding pixel from the infrared intensity image is mixed into the pixel's channel value that corresponds to brightness. The converted colorspace image is converted back to an RGB color image.

    摘要翻译: 接收实时视频的RGB彩色图像和红外强度图像。 RGB彩色图像被转换为​​包括对应于亮度值的通道的颜色空间图像。 评估转换的颜色空间图像的每个像素以确定像素的亮度通道是否超过阈值。 如果像素的亮度通道超过阈值,则来自红外线强度图像的相应像素的红外强度值被混合到与亮度对应的像素通道值中。 转换的颜色空间图像被转换回RGB彩色图像。

    SYSTEMS AND METHODS FOR GENERATING A VIRTUAL CAMERA VIEWPOINT FOR AN IMAGE
    10.
    发明申请
    SYSTEMS AND METHODS FOR GENERATING A VIRTUAL CAMERA VIEWPOINT FOR AN IMAGE 有权
    用于生成图像的虚拟摄像机视点的系统和方法

    公开(公告)号:US20110267348A1

    公开(公告)日:2011-11-03

    申请号:US13098363

    申请日:2011-04-29

    IPC分类号: G06T15/60 G06T15/00

    CPC分类号: G06T15/20 G06T15/205

    摘要: A color image and a depth image of a live video are received. A user is extracted from the information of the color image and the depth image. Spurious depth vales may be corrected. Points or pixels of an image as seen from a viewpoint of a reference camera at a reference camera location are mapped to points of the image as would be seen from a viewpoint of a virtual camera at a virtual camera location. As such, a transformed color image is generated. Disoccluded pixels may be processed to address any gaps within the transformed color image.

    摘要翻译: 接收直播视频的彩色图像和深度图像。 从彩色图像和深度图像的信息中提取用户。 杂散深度值可能会被纠正。 从参考摄像机位置处的参考摄像机的视点看到的图像的点或像素被映射到从虚拟摄像机位置处的虚拟摄像机的视点看到的图像的点。 因此,生成变换的彩色图像。 可以处理偏移像素以解决变换的彩色图像内的任何间隙。