System of lanes of processing units receiving instructions via shared memory units for data-parallel or task-parallel operations
    3.
    发明授权
    System of lanes of processing units receiving instructions via shared memory units for data-parallel or task-parallel operations 有权
    处理单元的通道系统通过用于数据并行或任务并行操作的共享存储器单元接收指令

    公开(公告)号:US08180998B1

    公开(公告)日:2012-05-15

    申请号:US12208231

    申请日:2008-09-10

    IPC分类号: G06F15/16

    摘要: A system for performing data-parallel operations and task-parallel operations. A first switch fabric node (SFN) includes first and second lane processing engines (LPEs). The first LPE includes a first set of lane processing units (LPUs) configured to perform data-parallel operations, where each LPU performs a set of operations, and each LPU uses a different set of data for the set of operations, and each LPU within the first set of LPUs uses a different set of data for the set of operations. The second LPE includes a second set of LPUs configured to perform task-parallel operations, where each LPU performs a different set of operations. A processing control engine (PCE) is configured to distribute instructions and data to the first LPE and the second LPE. Advantageously, data parallel operations and task parallel operations are able to be performed on the same processor simultaneously.

    摘要翻译: 用于执行数据并行操作和任务并行操作的系统。 第一交换机节点(SFN)包括第一和第二通道处理引擎(LPE)。 第一LPE包括配置成执行数据并行操作的第一组通道处理单元(LPU),其中每个LPU执行一组操作,并且每个LPU对于该组操作使用不同的一组数据,并且每个LPU在 第一组接口板使用不同的数据集作为该组操作。 第二LPE包括被配置为执行任务并行操作的第二组LPU,其中每个LPU执行不同的操作集合。 处理控制引擎(PCE)被配置为将指令和数据分发到第一LPE和第二LPE。 有利地,数据并行操作和任务并行操作能够同时在同一处理器上执行。

    SYSTEM AND METHOD FOR GENERATING A DEPTH MAP AND FUSING IMAGES FROM A CAMERA ARRAY
    4.
    发明申请
    SYSTEM AND METHOD FOR GENERATING A DEPTH MAP AND FUSING IMAGES FROM A CAMERA ARRAY 有权
    用于从摄像机阵列产生深度地图和融合图像的系统和方法

    公开(公告)号:US20130010073A1

    公开(公告)日:2013-01-10

    申请号:US13544795

    申请日:2012-07-09

    IPC分类号: H04N13/02

    摘要: A method, apparatus, system, and computer program product for of digital imaging. Multiple cameras comprising lenses and digital images sensors are used to capture multiple images of the same subject, and process the multiple images using difference information (e.g., an image disparity map, an image depth map, etc.). The processing commences by receiving a plurality of image pixels from at least one first image sensor, wherein the first image sensor captures a first image of a first color, receives a stereo image of the first color, and also receives other images of other colors. Having the stereo imagery, then constructing a disparity map and an associated depth map by searching for pixel correspondences between the first image and the stereo image. Using the constructed disparity map, captured images are converted into converted images, which are then combined with the first image, resulting in a fused multi-channel color image.

    摘要翻译: 一种用于数字成像的方法,装置,系统和计算机程序产品。 使用包括透镜和数字图像传感器的多个相机捕获同一被摄体的多个图像,并使用差分信息(例如,图像视差图,图像深度图等)处理多个图像。 处理开始于从至少一个第一图像传感器接收多个图像像素,其中第一图像传感器捕获第一颜色的第一图像,接收第一颜色的立体图像,并且还接收其它颜色的其他图像。 拥有立体图像,然后通过搜索第一图像和立体图像之间的像素对应度来构建视差图和相关联的深度图。 使用构造的视差图,将捕获的图像转换成转换的图像,然后将其与第一图像组合,得到融合的多通道彩色图像。

    SYSTEMS AND METHODS FOR ACCURATE USER FOREGROUND VIDEO EXTRACTION
    5.
    发明申请
    SYSTEMS AND METHODS FOR ACCURATE USER FOREGROUND VIDEO EXTRACTION 有权
    用于前置视频提取的系统和方法

    公开(公告)号:US20110249190A1

    公开(公告)日:2011-10-13

    申请号:US13083470

    申请日:2011-04-08

    IPC分类号: H04N9/64

    CPC分类号: H04N5/272

    摘要: A color image and a depth image of a live video are received. Each of the color image and the depth image are processed to identify a foreground, background, and an unknown region band of the live video. The unknown region band may comprise pixels between the foreground and the background. Further processing is performed to segment the pixels of the unknown region band between the foreground and the background. As such, processing is performed on the unknown region band in order to provide an improved user foreground video.

    摘要翻译: 接收直播视频的彩色图像和深度图像。 处理彩色图像和深度图像中的每一个以识别实况视频的前景,背景和未知区域频带。 未知区域带可以包括前景和背景之间的像素。 执行进一步的处理以分割前景和背景之间的未知区域带的像素。 因此,为了提供改进的用户前景视频,对未知区域频带执行处理。

    System and method for generating a depth map and fusing images from a camera array
    6.
    发明授权
    System and method for generating a depth map and fusing images from a camera array 有权
    用于生成深度图并融合相机阵列的图像的系统和方法

    公开(公告)号:US09300946B2

    公开(公告)日:2016-03-29

    申请号:US13544795

    申请日:2012-07-09

    IPC分类号: H04N13/02 H04N13/00 G03B35/12

    摘要: A method, apparatus, system, and computer program product for of digital imaging. Multiple cameras comprising lenses and digital images sensors are used to capture multiple images of the same subject, and process the multiple images using difference information (e.g., an image disparity map, an image depth map, etc.). The processing commences by receiving a plurality of image pixels from at least one first image sensor, wherein the first image sensor captures a first image of a first color, receives a stereo image of the first color, and also receives other images of other colors. Having the stereo imagery, then constructing a disparity map and an associated depth map by searching for pixel correspondences between the first image and the stereo image. Using the constructed disparity map, captured images are converted into converted images, which are then combined with the first image, resulting in a fused multi-channel color image.

    摘要翻译: 一种用于数字成像的方法,装置,系统和计算机程序产品。 使用包括透镜和数字图像传感器的多个相机捕获同一被摄体的多个图像,并使用差分信息(例如,图像视差图,图像深度图等)处理多个图像。 处理开始于从至少一个第一图像传感器接收多个图像像素,其中第一图像传感器捕获第一颜色的第一图像,接收第一颜色的立体图像,并且还接收其它颜色的其他图像。 拥有立体图像,然后通过搜索第一图像和立体图像之间的像素对应度来构建视差图和相关联的深度图。 使用构造的视差图,将捕获的图像转换成转换的图像,然后将其与第一图像组合,得到融合的多通道彩色图像。

    Systems and methods for accurate user foreground video extraction
    7.
    发明授权
    Systems and methods for accurate user foreground video extraction 有权
    准确的用户前景视频提取的系统和方法

    公开(公告)号:US08818028B2

    公开(公告)日:2014-08-26

    申请号:US13083470

    申请日:2011-04-08

    IPC分类号: G06K9/00 H04N5/272

    CPC分类号: H04N5/272

    摘要: A color image and a depth image of a live video are received. Each of the color image and the depth image are processed to identify a foreground, background, and an unknown region band of the live video. The unknown region band may comprise pixels between the foreground and the background. Further processing is performed to segment the pixels of the unknown region band between the foreground and the background. As such, processing is performed on the unknown region band in order to provide an improved user foreground video.

    摘要翻译: 接收直播视频的彩色图像和深度图像。 处理彩色图像和深度图像中的每一个以识别实况视频的前景,背景和未知区域频带。 未知区域带可以包括前景和背景之间的像素。 执行进一步的处理以分割前景和背景之间的未知区域带的像素。 因此,为了提供改进的用户前景视频,对未知区域频带执行处理。

    Systems and methods for generating a virtual camera viewpoint for an image
    8.
    发明授权
    Systems and methods for generating a virtual camera viewpoint for an image 有权
    用于生成图像的虚拟相机视点的系统和方法

    公开(公告)号:US09053573B2

    公开(公告)日:2015-06-09

    申请号:US13098363

    申请日:2011-04-29

    IPC分类号: G06T15/20

    CPC分类号: G06T15/20 G06T15/205

    摘要: A color image and a depth image of a live video are received. A user is extracted from the information of the color image and the depth image. Spurious depth vales may be corrected. Points or pixels of an image as seen from a viewpoint of a reference camera at a reference camera location are mapped to points of the image as would be seen from a viewpoint of a virtual camera at a virtual camera location. As such, a transformed color image is generated. Disoccluded pixels may be processed to address any gaps within the transformed color image.

    摘要翻译: 接收直播视频的彩色图像和深度图像。 从彩色图像和深度图像的信息中提取用户。 杂散深度值可能会被纠正。 从参考摄像机位置处的参考摄像机的视点看到的图像的点或像素被映射到从虚拟摄像机位置处的虚拟摄像机的视点看到的图像的点。 因此,生成变换的彩色图像。 可以处理偏移像素以解决变换的彩色图像内的任何间隙。

    Systems and methods for illumination correction of an image
    9.
    发明授权
    Systems and methods for illumination correction of an image 有权
    图像照明校正的系统和方法

    公开(公告)号:US09008457B2

    公开(公告)日:2015-04-14

    申请号:US13149715

    申请日:2011-05-31

    IPC分类号: G06K9/00 G06T5/00

    CPC分类号: G06T5/008

    摘要: An RGB color image and an infrared intensity image of a live video are received. The RGB color image is converted to a colorspace image comprising a channel corresponding to a brightness value. Each pixel of the converted colorspace image is evaluated to determine whether the brightness channel of the pixel exceeds a threshold value. If the brightness channel of the pixel exceeds the threshold value, the infrared intensity value of a corresponding pixel from the infrared intensity image is mixed into the pixel's channel value that corresponds to brightness. The converted colorspace image is converted back to an RGB color image.

    摘要翻译: 接收实时视频的RGB彩色图像和红外强度图像。 RGB彩色图像被转换为​​包括对应于亮度值的通道的颜色空间图像。 评估转换的颜色空间图像的每个像素以确定像素的亮度通道是否超过阈值。 如果像素的亮度通道超过阈值,则来自红外线强度图像的相应像素的红外强度值被混合到与亮度对应的像素通道值中。 转换的颜色空间图像被转换回RGB彩色图像。

    SYSTEM FOR EXECUTING 3D PROPAGATION FOR DEPTH IMAGE-BASED RENDERING
    10.
    发明申请
    SYSTEM FOR EXECUTING 3D PROPAGATION FOR DEPTH IMAGE-BASED RENDERING 有权
    用于执行深度图像渲染的3D传播系统

    公开(公告)号:US20140293010A1

    公开(公告)日:2014-10-02

    申请号:US14171141

    申请日:2014-02-03

    IPC分类号: H04N13/04 H04N13/02

    摘要: A system is disclosed for executing depth image-based rendering of a 3D image by a computer having a processor and that is coupled with one or more color cameras and at least one depth camera. The color cameras and the depth camera are positionable at different arbitrary locations relative to a scene to be rendered. In some examples, the depth camera is a low resolution camera and the color cameras are high resolution. The processor is programmed to propagate depth information from the depth camera to an image plane of each color camera to produce a propagated depth image at each respective color camera, to enhance the propagated depth image at each color camera with the color and propagated depth information thereof to produce corresponding enhanced depth images, and to render a complete, viewable image from one or more enhanced depth images from the color cameras. The processor may be a graphics processing unit.

    摘要翻译: 公开了一种用于由具有处理器的计算机执行3D图像的深度基于图像的渲染并且与一个或多个彩色照相机和至少一个深度相机耦合的系统。 彩色相机和深度相机可以相对于要呈现的场景在不同的任意位置定位。 在一些示例中,深度相机是低分辨率相机,彩色相机是高分辨率的。 处理器被编程为将深度信息从深度摄像机传播到每个彩色摄像机的图像平面,以在每个相应的彩色摄像机处产生传播的深度图像,以增强每个彩色摄像机的彩色和传播深度信息的传播深度图像 以产生相应的增强深度图像,并且从彩色相机提供来自一个或多个增强深度图像的完整的可观看图像。 处理器可以是图形处理单元。