Method for processing a light field video based on the use of a super-rays representation

    公开(公告)号:US11195288B2

    公开(公告)日:2021-12-07

    申请号:US16764040

    申请日:2018-11-13

    Abstract: A method and device for processing a light field video is described. The light field video includes a set of image views per unit of time, the light field video being associated with a scene without cuts. In the method a first super-rays representation of reference image views at a given time is determined based on centroids. A second super-rays representation associated with corresponding views of a subsequent set of image views is next determined based on de-projection and re-projection of centroids. The displacement of centroids between the first and second super-rays is determined and then the determined displacement is applied to centroids of the second super-rays representation.

    Method and apparatus for estimating depth of unfocused plenoptic data

    公开(公告)号:US10510156B2

    公开(公告)日:2019-12-17

    申请号:US15531408

    申请日:2015-11-24

    Abstract: Methods and apparatus for estimating a depth of unfocused plenoptic data are suggested. The method includes: determining a level of homogeneity of micro-lens images of unfocused plenoptic data; determining pixels of the micro-lens images of the unfocused plenoptic unfocused plenoptic data which either have disparities equal to zero or belong to homogeneous areas as a function of the calculated level of homogeneity of the micro-lens images of the unfocused plenoptic data; and estimating the depth of the unfocused plenoptic data by a disparity estimation without considering the determined pixels. With the disclosure, by pre-processing the raw data, it can prevent any disparity estimation method to spend time on estimating disparities for: (i) pixels that are in focus, (ii) pixels that belong to homogenous areas of the scene.

    Method for processing a light field image delivering a super-rays representation of a light field image

    公开(公告)号:US11783489B2

    公开(公告)日:2023-10-10

    申请号:US17244706

    申请日:2021-04-29

    CPC classification number: G06T7/174 G06T7/11 G06T2207/10052

    Abstract: The present disclosure concerns a method for processing a light field image comprising a set of image views. The method is remarkable in that it comprises:



    selecting (101) a set of pixels, named centroids, within a given image view in said light field image, each centroid being associated with a unique label and a unique light ray;
    de-projecting said centroids, that delivers a set of points in a 3D space;
    re-projecting said points of said set of points in a 3D space in at least one other image view in said light field image, which is different from said reference view, that delivers a set of re-projected centroids; and
    determining (102), for each pixel, being associated with a light ray, within a neighborhood of a re-projected centroid, a label related to one of the centroids, said determining relying on a proximity criterion in term of color between pixels and centroids, and a proximity criterion in term of spatial distances between pixels and re-projected centroids; and
    updating (103), for a given centroid, a color value associated with said given centroid, and spatial coordinates of said given centroid within said given image view, wherein said updating comprises:
    de-projecting pixels in said at least one other image view that are associated with a same label of said given centroid, delivering a set of obtained points; and
    re-projecting said obtained points into said given image view, delivering a set of projected points; and
    averaging both color values associated with said projected points and spatial coordinates associated with said projected points for defining updated information related to said given centroid.

Patent Agency Ranking