公开(公告)号：US20150181124A1

公开(公告)日：2015-06-25

申请号：US14572033

申请日：2014-12-16

Applicant: Nokia Corporation

Inventor： Basavaraja S V ,  Mithun Uliyar ,  Gururaj Gopal Putraya

IPC: H04N5/232 ,  H04N13/00 ,  H04N13/02

CPC classification number: H04N5/23267 ,  G02B3/0006 ,  G02B27/0075 ,  G06T5/003 ,  G06T5/50 ,  G06T7/97 ,  G06T2207/10052 ,  H04N5/23212 ,  H04N5/23258 ,  H04N13/128 ,  H04N13/271

Abstract: In an example embodiment, a method, apparatus and computer program product are provided. The method includes facilitating receipt of a plurality of light-field images of a scene captured in a burst capture by a light-field camera. The method includes determining shifts between images of the plurality of light-field images, where the shifts between the images of the plurality of light-field images are associated with shake of the light-field camera while capturing the plurality of light-field images. The method includes generating a plurality of depth maps for the plurality of light-field images, and generating a set of view images of the scene based on the plurality of light-field images and the plurality of depth maps. The method includes generating a refocus image by combining the set of view images based at least on the shifts between the images of the plurality of light-field images.

Abstract translation: 在示例实施例中，提供了一种方法，装置和计算机程序产品。 该方法包括促进由光场照相机接收在突发捕获中捕获的场景的多个光场图像。 该方法包括确定多个光场图像的图像之间的偏移，其中在捕获多个光场图像的同时，多个光场图像的图像之间的偏移与光场照相机的抖动相关联。 该方法包括为多个光场图像生成多个深度图，并且基于多个光场图像和多个深度图生成场景的一组视图图像。 该方法包括至少基于多个光场图像的图像之间的偏移量组合该视点图像来生成再聚焦图像。

公开(公告)号：US20140147050A1

公开(公告)日：2014-05-29

申请号：US14077459

申请日：2013-11-12

Applicant: Nokia Corporation

Inventor： Basavaraja S V ,  Gururaj Gopal Putraya ,  Mithun Uliyar

IPC: G06T3/40 ,  G06K9/46 ,  G06T3/00

CPC classification number: G06T3/4053 ,  G06K9/46 ,  G06T3/0068 ,  G06T3/4007

Abstract: In an example embodiment a method, apparatus and computer program product are provided. The method includes facilitating receipt of a light-field image, determining one or more depth levels in the light-field image and generating a plurality of images from the light-field image. The method includes determining one or more registration matrices corresponding to the one or more depth levels between an image and one or more remaining images of the plurality of images. The method includes performing a super-resolution of the image and the one or more remaining images based on the one or more registration matrices to generate a super-resolved image of the image.

Abstract translation: 在示例实施例中，提供了一种方法，装置和计算机程序产品。 该方法包括促进光场图像的接收，确定光场图像中的一个或多个深度级并且从光场图像生成多个图像。 该方法包括确定与图像和多个图像中的一个或多个剩余图像之间的一个或多个深度级相对应的一个或多个注册矩阵。 该方法包括基于一个或多个注册矩阵来执行图像的超分辨率和一个或多个剩余图像，以生成图像的超分辨图像。

公开(公告)号：US20140028878A1

公开(公告)日：2014-01-30

申请号：US13950529

申请日：2013-07-25

Applicant: Nokia Corporation

Inventor： Basavaraja S. V. ,  Mithun Uliyar ,  Gururaj Gopal Putraya

IPC: H04N5/232 ,  G06T11/60

CPC classification number: H04N5/23232 ,  G06T3/4038 ,  G06T11/60

Abstract: In accordance with an example embodiment a method, apparatus and computer program product are provided. The method comprises receiving a first image of a scene, the first image comprising angular information associated with the scene. The first image has a first image resolution. A second image of the scene is received. The second image has a second image resolution, wherein the second image resolution is greater than the first image resolution. A pre-processed first image is generated based on the angular information and a selection of a first region of interest (ROI) in the first image. A processed first image of the scene is generated based on a processing of a second ROI in the pre-processed first image corresponding to the first ROI in the first image, and the second image. The processing is configured to render the second image resolution to the second ROI in the pre-processed first image.

Abstract translation: 根据示例实施例，提供了一种方法，装置和计算机程序产品。 该方法包括接收场景的第一图像，第一图像包括与场景相关联的角度信息。 第一个图像具有第一个图像分辨率。 接收到场景的第二个图像。 第二图像具有第二图像分辨率，其中第二图像分辨率大于第一图像分辨率。 基于角度信息和第一图像中的第一感兴趣区域（ROI）的选择来生成预处理的第一图像。 基于对应于第一图像中的第一ROI和第二图像的预处理的第一图像中的第二ROI的处理，生成场景的经处理的第一图像。 处理被配置为在预处理的第一图像中将第二图像分辨率呈现给第二ROI。

公开(公告)号：US09524556B2

公开(公告)日：2016-12-20

申请号：US14705348

申请日：2015-05-06

Applicant: Nokia Corporation

Inventor： Mithun Uliyar ,  Gururaj Gopal Putraya ,  Soumik Ukil ,  Basavaraja S V ,  Krishna Annasagar Govindarao ,  Veldandi Muninder

IPC: G06T7/00 ,  H04N13/02

CPC classification number: G06T7/0055 ,  G06T7/514 ,  G06T7/557 ,  G06T2200/21 ,  G06T2207/10052 ,  G06T2207/20228 ,  H04N13/111 ,  H04N13/214 ,  H04N13/232 ,  H04N13/271 ,  H04N2013/0081

Abstract: In an example embodiment, a method, apparatus and computer program product are provided. The method includes computing a first cost volume for a light-field image. A first depth map comprising depth information of the plurality of sub-images of the light-field image is computed based on the first cost volume. A first view image comprising reconstruction information is reconstructed based on the depth information of the plurality of sub-images. A second cost volume corresponding to the first cost volume is computed based on the reconstruction information. The second cost volume is filtered based on the first view image to generate an aggregated cost volume. A second depth map is generated based on the aggregated cost volume. The second depth map facilitates generation of a second view image that is associated with a resolution higher than a resolution of the first view image.

Abstract translation: 在示例实施例中，提供了一种方法，装置和计算机程序产品。 该方法包括计算光场图像的第一成本体积。 基于第一成本体积计算包括光场图像的多个子图像的深度信息的第一深度图。 基于多个子图像的深度信息来重构包括重建信息的第一视图图像。 基于重构信息计算与第一成本量对应的第二成本量。 基于第一视图图像来过滤第二成本量以生成聚合成本量。 基于聚合成本量生成第二个深度图。 第二深度图有助于产生与高于第一视图图像的分辨率的分辨率相关联的第二视图图像。

公开(公告)号：US20150350530A1

公开(公告)日：2015-12-03

申请号：US14726732

申请日：2015-06-01

Applicant: Nokia Corporation

Inventor： Krishna Annasagar GOVINDARAO ,  Gururaj Gopal Putraya ,  Ravi Shenoy ,  Mithun Uliyar

IPC: H04N5/232 ,  H04N5/225

CPC classification number: H04N5/23212 ,  H04N5/2259

Abstract: An apparatus including a first optical element, a second optical element and an image sensor. The first optical element is configured to focus light with first wavelengths on the second optical element, and the second optical element is invisible to light with second wavelengths and configured to relay an image containing lightfield information on the image sensor from light with the first wavelengths.

Abstract translation: 一种包括第一光学元件，第二光学元件和图像传感器的设备。 第一光学元件被配置为将具有第一波长的光聚焦在第二光学元件上，并且第二光学元件不可见以与第二波长一起点亮并且被配置为将第一波长的光中的包含光场信息的图像传送到图像传感器上。

公开(公告)号：US20150296319A1

公开(公告)日：2015-10-15

申请号：US14441322

申请日：2013-11-18

Applicant: NOKIA CORPORATION

Inventor： Ravi Shenoy ,  Pushkar Prasad Patwardhan ,  Gururaj Gopal Putraya

IPC: H04S7/00

CPC classification number: H04S7/302 ,  G06T7/557 ,  G10L2021/02166 ,  H04M3/568 ,  H04N7/15 ,  H04R3/005 ,  H04S2400/11 ,  H04S2400/13 ,  H04S2400/15 ,  H04S2420/01

Abstract: An apparatus comprising: a depth map estimator configured to determine, associated with at least one visual image, a depth map comprising at least one distance value in a direction relative to an apparatus; a direction of arrival estimator configured to determine, using at least two microphones, at least one audio source signal with a direction; and an audio signal processor configured to process the at least one audio source signal based on the at least one distance value in the direction of the at least one audio source signal.

Abstract translation: 一种装置，包括：深度图估计器，被配置为确定与至少一个视觉图像相关联的深度图，所述深度图包括在相对于装置的方向上的至少一个距离值; 配置为使用至少两个麦克风确定具有方向的至少一个音频源信号的到达方向估计器; 以及音频信号处理器，被配置为基于所述至少一个音频源信号的方向上的所述至少一个距离值来处理所述至少一个音频源信号。

公开(公告)号：US20130138657A1

公开(公告)日：2013-05-30

申请号：US13689084

申请日：2012-11-29

Applicant: NOKIA CORPORATION

Inventor： Krishna Annasagar Govindarao ,  Gururaj Gopal Putraya

IPC: G06F17/30

CPC classification number: G06F17/30707 ,  G06F17/3002 ,  G06K9/00295 ,  G06K9/6215 ,  G06K9/6232 ,  G06K9/627 ,  G06K9/6274

Abstract: In accordance with various example embodiments, methods, apparatuses, and computer program products are provided. A method comprises accessing a gallery comprising a plurality of classes, determining distances between classes of the plurality of classes, and determining thresholds for one or more classes of the gallery for classifying test objects in the classes, wherein threshold for a class is determined based on at least one distance of the class from at least one remaining class of the plurality of classes. The apparatus comprises at least one processor and at least one memory, configured to, cause the apparatus to perform accessing a gallery comprising a plurality of classes, determining distances between classes of the plurality of classes, and determining thresholds for classes of the gallery for classifying test objects in the classes, wherein threshold for a class is determined based on distances of the class from remaining classes of the gallery.

Abstract translation: 根据各种示例性实施例，提供了方法，装置和计算机程序产品。 一种方法包括访问包括多个类的库，确定多个类的类之间的距离，以及确定用于对类中的测试对象进行分类的画廊的一个或多个类的阈值，其中基于 该类别与多个类别中的至少一个剩余类别的至少一个距离。 所述设备包括至少一个处理器和至少一个存储器，其被配置为使得所述设备执行访问包括多个类别的库，确定所述多个类别的类别之间的距离，以及确定所述库的类别的阈值以进行分类 在类中测试对象，其中类的阈值基于类与图库的剩余类的距离来确定。

公开(公告)号：US09705595B2

公开(公告)日：2017-07-11

申请号：US14736340

申请日：2015-06-11

Applicant: Nokia Corporation

Inventor： Mithun Uliyar ,  Basavaraja Sv ,  Gururaj Gopal Putraya ,  Pushkar Prasad Patwardhan

IPC: H04N5/232 ,  H04B10/116 ,  H04N5/238 ,  H04N5/235

CPC classification number: H04B10/116 ,  H04N5/23212 ,  H04N5/2353 ,  H04N5/238

Abstract: A method, apparatus and computer program for controlling a digital microlens array camera to obtain a sequence of images each including microimages captured by respective microlenses; for determining in each of the images a set of diffused microimages in which an optical communication light source is diffused over each of the microimages of the set; and for decoding optically communicated information from the set.

公开(公告)号：US09202266B2

公开(公告)日：2015-12-01

申请号：US14138969

申请日：2013-12-23

Applicant: Nokia Corporation

Inventor： Krishna Annasagar Govindarao ,  Gururaj Gopal Putraya ,  Mithun Uliyar ,  Basavaraja S V

IPC: G06K9/40 ,  G06T5/00 ,  H04N5/367

CPC classification number: G06T5/005 ,  H04N5/3675

Abstract: In accordance with an example embodiment a method, apparatus and computer program product are provided. The method comprises determining a plurality of first pixels having resemblance with a second pixel associated with an image based on a depth information of the image. The method further comprises replacing the second pixel by at least one first pixel of the plurality of first pixels based on a determination that the at least one first pixel is not associated with the at least one image defect.

Abstract translation: 根据示例实施例，提供了一种方法，装置和计算机程序产品。 该方法包括基于图像的深度信息来确定具有与与图像相关联的第二像素相似的多个第一像素。 该方法还包括基于至少一个第一像素与至少一个图像缺陷不相关联的确定来将第二像素替换为多个第一像素中的至少一个第一像素。

公开(公告)号：US20150339824A1

公开(公告)日：2015-11-26

申请号：US14705348

申请日：2015-05-06

Applicant: Nokia Corporation

Inventor： Mithun Uliyar ,  Gururaj Gopal Putraya ,  Soumik Ukil ,  Basavaraja S V ,  Krishna Annasagar Govindarao ,  Veldandi Muninder

IPC: G06T7/00 ,  H04N13/02

CPC classification number: G06T7/0055 ,  G06T7/514 ,  G06T7/557 ,  G06T2200/21 ,  G06T2207/10052 ,  G06T2207/20228 ,  H04N13/111 ,  H04N13/214 ,  H04N13/232 ,  H04N13/271 ,  H04N2013/0081

Abstract: In an example embodiment, a method, apparatus and computer program product are provided. The method includes computing a first cost volume for a light-field image. A first depth map comprising depth information of the plurality of sub-images of the light-field image is computed based on the first cost volume. A first view image comprising reconstruction information is reconstructed based on the depth information of the plurality of sub-images. A second cost volume corresponding to the first cost volume is computed based on the reconstruction information. The second cost volume is filtered based on the first view image to generate an aggregated cost volume. A second depth map is generated based on the aggregated cost volume. The second depth map facilitates generation of a second view image that is associated with a resolution higher than a resolution of the first view image.

Abstract translation: 在示例实施例中，提供了一种方法，装置和计算机程序产品。 该方法包括计算光场图像的第一成本体积。 基于第一成本体积计算包括光场图像的多个子图像的深度信息的第一深度图。 基于多个子图像的深度信息来重构包括重建信息的第一视图图像。 基于重构信息计算与第一成本量对应的第二成本量。 基于第一视图图像来过滤第二成本量以生成聚合成本量。 基于聚合成本量生成第二个深度图。 第二深度图有助于产生与高于第一视图图像的分辨率的分辨率相关联的第二视图图像。