公开(公告)号：US09679220B2

公开(公告)日：2017-06-13

申请号：US14700052

申请日：2015-04-29

Applicant: Nokia Corporation

Inventor： Krishna Annasagar Govindarao ,  Soumik Ukil ,  Veldandi Muninder

IPC: G06K9/00 ,  G06K9/68 ,  G06K9/46 ,  G06T1/00 ,  G06T9/40 ,  G06K9/32 ,  G06F17/30 ,  G06T7/00 ,  G06T7/11 ,  G06T7/162

CPC classification number: G06K9/469 ,  G06F17/30958 ,  G06K9/3233 ,  G06K2009/3291 ,  G06T1/0007 ,  G06T7/11 ,  G06T7/162 ,  G06T7/97 ,  G06T9/40 ,  G06T2207/10004 ,  G06T2207/10028 ,  G06T2207/20072

Abstract: In an example embodiment, a method, apparatus and computer program product are provided. The method includes facilitating receipt of an image of a scene and determining a graph based on connecting nodes of the image. The nodes are either pixels or superpixels of the image. The graph is determined by determining one or more connections of a node to one or more nodes belonging to a pre-defined image region around the node in the image. The connections are associated with edge weights that are determined based on at least one of similarity parameters and spatial distances between the node and the one or more nodes. The method includes determining disparity values at the nodes of the image based at least on performing tree based aggregation of a cost volume on the graph, where the cost volume is associated with the image and at least one view image of the scene.

公开(公告)号：US20150170371A1

公开(公告)日：2015-06-18

申请号：US14561002

申请日：2014-12-04

Applicant: Nokia Corporation

Inventor： Veldandi Muninder ,  Soumik Ukil ,  Krishna Annasagar Govindarao

IPC: G06T7/00 ,  H04N13/00 ,  G06T7/40

CPC classification number: G06T7/593 ,  G06T2207/10012 ,  G06T2207/10024 ,  H04N13/128 ,  H04N2013/0081

Abstract: In an example embodiment, a method, apparatus and computer program product are provided. The method includes facilitating receipt of primary depth map and plurality of color segments, the primary depth map associated with a first image and a second image that are stereoscopic pair of images of a scene, and the color segments associated with the first image. The method includes generating plurality of disparity planes based on the color segments and the primary depth map. The method includes determining aggregated cost volume between pixels of the first and second images for the disparity planes. The method includes assigning plane labels corresponding to the disparity planes to pixels of the first and second images based on the aggregated cost volume, an individual pixel being assigned a plane label. The method includes generating secondary depth map based on the plane labels assigned to the pixels of the first and second images.

Abstract translation: 在示例实施例中，提供了一种方法，装置和计算机程序产品。 该方法包括促进主要深度图和多个颜色段的接收，与第一图像相关联的主要深度图和作为场景的立体对图像的第二图像以及与第一图像相关联的颜色分段。 该方法包括基于颜色段和主深度图生成多个视差平面。 该方法包括确定视差平面的第一和第二图像的像素之间的聚合成本体积。 该方法包括基于聚合成本体积分配对应于视差平面的平面标签到第一和第二图像的像素，分配单个像素的平面标签。 该方法包括基于分配给第一和第二图像的像素的平面标签产生二次深度图。

公开(公告)号：US20150078669A1

公开(公告)日：2015-03-19

申请号：US14333857

申请日：2014-07-17

Applicant: Nokia Corporation

Inventor： Soumik Ukil ,  Veldandi Muninder ,  Krishna Annasagar Govindarao

IPC: G06K9/46 ,  G06K9/62

CPC classification number: G06K9/00208 ,  G06K9/00234 ,  G06K9/66 ,  G06T7/11 ,  G06T7/593 ,  G06T7/97 ,  G06T2207/10012

Abstract: In an example embodiment, a method, apparatus and computer program product are provided. The method includes facilitating receipt of a first image and a second image of a scene comprising one or more objects. The method includes detecting the objects in the first image by detecting object point of the objects in the first image. The method includes detecting the object points of the objects in the second image based on detection of the object points of the objects in the first image. Detection of an object point in the second image that corresponds to an object point of the first image comprises searching for the object point on an epipolar line in the second image corresponding to the object point of the first image. The method includes determining disparity values between the objects points in the first image and the object points in the second image.

Abstract translation: 在示例实施例中，提供了一种方法，装置和计算机程序产品。 该方法包括便利接收包含一个或多个对象的场景的第一图像和第二图像。 该方法包括通过检测第一图像中的对象的对象点来检测第一图像中的对象。 该方法包括：基于第一图像中对象的对象点的检测来检测第二图像中的对象的对象点。 对与第一图像的对象点对应的第二图像中的对象点的检测包括搜索对应于第一图像的对象点的第二图像中的核线上的对象点。 该方法包括确定第一图像中的对象点与第二图像中的对象点之间的视差值。

公开(公告)号：US09524556B2

公开(公告)日：2016-12-20

申请号：US14705348

申请日：2015-05-06

Applicant: Nokia Corporation

Inventor： Mithun Uliyar ,  Gururaj Gopal Putraya ,  Soumik Ukil ,  Basavaraja S V ,  Krishna Annasagar Govindarao ,  Veldandi Muninder

IPC: G06T7/00 ,  H04N13/02

CPC classification number: G06T7/0055 ,  G06T7/514 ,  G06T7/557 ,  G06T2200/21 ,  G06T2207/10052 ,  G06T2207/20228 ,  H04N13/111 ,  H04N13/214 ,  H04N13/232 ,  H04N13/271 ,  H04N2013/0081

Abstract: In an example embodiment, a method, apparatus and computer program product are provided. The method includes computing a first cost volume for a light-field image. A first depth map comprising depth information of the plurality of sub-images of the light-field image is computed based on the first cost volume. A first view image comprising reconstruction information is reconstructed based on the depth information of the plurality of sub-images. A second cost volume corresponding to the first cost volume is computed based on the reconstruction information. The second cost volume is filtered based on the first view image to generate an aggregated cost volume. A second depth map is generated based on the aggregated cost volume. The second depth map facilitates generation of a second view image that is associated with a resolution higher than a resolution of the first view image.

Abstract translation: 在示例实施例中，提供了一种方法，装置和计算机程序产品。 该方法包括计算光场图像的第一成本体积。 基于第一成本体积计算包括光场图像的多个子图像的深度信息的第一深度图。 基于多个子图像的深度信息来重构包括重建信息的第一视图图像。 基于重构信息计算与第一成本量对应的第二成本量。 基于第一视图图像来过滤第二成本量以生成聚合成本量。 基于聚合成本量生成第二个深度图。 第二深度图有助于产生与高于第一视图图像的分辨率的分辨率相关联的第二视图图像。

公开(公告)号：US09390508B2

公开(公告)日：2016-07-12

申请号：US14617348

申请日：2015-02-09

Applicant: Nokia Corporation

Inventor： Soumik Ukil ,  Veldandi Muninder ,  Krishna Annasagar Govindarao

IPC: G06K9/00 ,  G06T7/00

CPC classification number: G06T7/0075 ,  G06T7/593 ,  G06T2207/10012 ,  G06T2207/10024 ,  G06T2207/20072 ,  G06T2207/20076

Abstract: In an example embodiment a method, apparatus and computer program product are provided. The method includes facilitating receipt of a first and a second image. A first and a second aggregated cost volume associated with pixels of the first and the second images are determined for a plurality of disparity values. A first and a second disparity maps are generated based on the first and the second aggregated cost volume. A confidence map for disparity values of the first image is generated based on the first aggregated cost volume. One or more infinity regions in the first image are determined based on a number of confident pixels in color segments of the first image. A third disparity map is generated by determining filtered disparity values for the pixels of the first image where filtered disparity values for pixels of the one or more infinity regions are a pre-defined disparity value.

Abstract translation: 在示例实施例中，提供了一种方法，装置和计算机程序产品。 该方法包括促进第一和第二图像的接收。 针对多个视差值确定与第一和第二图像的像素相关联的第一和第二聚合成本音量。 基于第一和第二聚合成本量产生第一和第二视差图。 基于第一聚合成本体积生成第一图像的差异值的置信度图。 基于第一图像的颜色段中的可信像素的数量来确定第一图像中的一个或多个无穷大区域。 通过确定第一图像的像素的滤波视差值来生成第三视差图，其中一个或多个无限大区域的像素的滤波视差值是预定义的视差值。

公开(公告)号：US10091409B2

公开(公告)日：2018-10-02

申请号：US15540379

申请日：2015-12-02

Applicant: NOKIA CORPORATION

Inventor： Krishna Annasagar Govindarao ,  Soumik Ukil ,  Ravi Shenoy

IPC: H04N5/232 ,  G02B7/38 ,  H04N5/222

Abstract: In an example embodiment, method, apparatus and computer program product for improving image and video captures using depth maps of viewfinder depth map, are provided. The method includes facilitating receipt of a viewfinder depth map of a scene, the viewfinder depth map comprising depth information of a plurality of objects in the scene. One or more objects are selected from the plurality of objects based on depth information of the one or more objects in the viewfinder depth map. Two or more images of the scene are facilitated to be captured by at least adjusting focus of a camera corresponding to the depth information of the one or more objects that are selected. In an example, a method also includes facilitating capture of an image of the scene by at least adjusting focus of a camera corresponding to the depth information of the two or more objects that are selected.

公开(公告)号：US09591418B2

公开(公告)日：2017-03-07

申请号：US14391851

申请日：2013-02-21

Applicant: Nokia Corporation

Inventor： Ravi Shenoy ,  Soumik Ukil ,  Gururaj Putraya ,  Krishna Govindarao

IPC: H04R5/02 ,  H04R29/00 ,  H04S7/00 ,  G06F3/16

CPC classification number: H04R29/00 ,  G06F3/16 ,  H04S7/302

Abstract: A method, apparatus and computer program for: receiving a spatial audio input; determining a direction of interest from the spatial audio input; and generating a spatial audio output dependent on the spatial audio input and the direction of interest.

Abstract translation: 一种用于：接收空间音频输入的方法，装置和计算机程序; 从空间音频输入确定感兴趣的方向; 以及产生取决于空间音频输入和感兴趣方向的空间音频输出。

公开(公告)号：US20150248769A1

公开(公告)日：2015-09-03

申请号：US14617348

申请日：2015-02-09

Applicant: Nokia Corporation

Inventor： Soumik Ukil ,  Veldandi Muninder ,  Krishna Annasagar Govindarao

IPC: G06T7/00

CPC classification number: G06T7/0075 ,  G06T7/593 ,  G06T2207/10012 ,  G06T2207/10024 ,  G06T2207/20072 ,  G06T2207/20076

Abstract: In an example embodiment a method, apparatus and computer program product are provided. The method includes facilitating receipt of a first and a second image. A first and a second aggregated cost volume associated with pixels of the first and the second images are determined for a plurality of disparity values. A first and a second disparity maps are generated based on the first and the second aggregated cost volume. A confidence map for disparity values of the first image is generated based on the first aggregated cost volume. One or more infinity regions in the first image are determined based on a number of confident pixels in color segments of the first image. A third disparity map is generated by determining filtered disparity values for the pixels of the first image where filtered disparity values for pixels of the one or more infinity regions are a pre-defined disparity value.

Abstract translation: 在示例实施例中，提供了一种方法，装置和计算机程序产品。 该方法包括促进第一和第二图像的接收。 针对多个视差值确定与第一和第二图像的像素相关联的第一和第二聚合成本音量。 基于第一和第二聚合成本量产生第一和第二视差图。 基于第一聚合成本体积生成第一图像的差异值的置信度图。 基于第一图像的颜色段中的可信像素的数量来确定第一图像中的一个或多个无穷大区域。 通过确定第一图像的像素的滤波视差值来生成第三视差图，其中一个或多个无限大区域的像素的滤波视差值是预定义的视差值。

公开(公告)号：US20140086452A1

公开(公告)日：2014-03-27

申请号：US14028748

申请日：2013-09-17

Applicant: Nokia Corporation

Inventor： Soumik Ukil ,  Krishna Annasagar Govindarao ,  Ravi Shenoy

IPC: G06T7/20

CPC classification number: G06T7/20 ,  G06T2207/10016 ,  G06T2207/20068

Abstract: In an example embodiment a method, apparatus and computer program product are provided. The method includes facilitating selection of a region of interest (ROI) in a plurality of frames of a multimedia content. The ROI is associated with a motion of at least one object. An object mobility data matrix associated with the ROI is determined in the plurality of frames. The object mobility data matrix is indicative of a difference in motion of the at least one object in the plurality of frames. A projection of the object mobility data matrix is determined on a line. The motion of the at least one object in the ROI is determined across the plurality of frames to as a periodic motion or a non-periodic motion based on the projection of the object mobility data matrix.

Abstract translation: 在示例实施例中，提供了一种方法，装置和计算机程序产品。 该方法包括促进对多媒体内容的多个帧中的感兴趣区域（ROI）的选择。 ROI与至少一个对象的运动相关联。 在多个帧中确定与ROI相关联的对象移动数据矩阵。 目标移动性数据矩阵表示多个帧中的至少一个对象的运动差异。 在一行上确定目标移动数据矩阵的投影。 ROI中的至少一个对象的运动在多个帧之间被确定为基于目标移动性数据矩阵的投影的周期性运动或非周期运动。

公开(公告)号：US09269158B2

公开(公告)日：2016-02-23

申请号：US14028748

申请日：2013-09-17

Applicant: Nokia Corporation

Inventor： Soumik Ukil ,  Krishna Annasagar Govindarao ,  Ravi Shenoy

IPC: G06T7/20

CPC classification number: G06T7/20 ,  G06T2207/10016 ,  G06T2207/20068

Abstract: In an example embodiment a method, apparatus and computer program product are provided. The method includes facilitating selection of a region of interest (ROI) in a plurality of frames of a multimedia content. The ROI is associated with a motion of at least one object. An object mobility data matrix associated with the ROI is determined in the plurality of frames. The object mobility data matrix is indicative of a difference in motion of the at least one object in the plurality of frames. A projection of the object mobility data matrix is determined on a line. The motion of the at least one object in the ROI is determined across the plurality of frames to as a periodic motion or a non-periodic motion based on the projection of the object mobility data matrix.

Abstract translation: 在示例实施例中，提供了一种方法，装置和计算机程序产品。 该方法包括促进对多媒体内容的多个帧中的感兴趣区域（ROI）的选择。 ROI与至少一个对象的运动相关联。 在多个帧中确定与ROI相关联的对象移动数据矩阵。 目标移动性数据矩阵表示多个帧中的至少一个对象的运动差异。 在一行上确定目标移动数据矩阵的投影。 ROI中的至少一个对象的运动在多个帧之间被确定为基于目标移动性数据矩阵的投影的周期性运动或非周期运动。