Method for processing a light field video based on the use of a super-rays representation

    公开(公告)号:US11195288B2

    公开(公告)日:2021-12-07

    申请号:US16764040

    申请日:2018-11-13

    Abstract: A method and device for processing a light field video is described. The light field video includes a set of image views per unit of time, the light field video being associated with a scene without cuts. In the method a first super-rays representation of reference image views at a given time is determined based on centroids. A second super-rays representation associated with corresponding views of a subsequent set of image views is next determined based on de-projection and re-projection of centroids. The displacement of centroids between the first and second super-rays is determined and then the determined displacement is applied to centroids of the second super-rays representation.

    Method for processing a light field image delivering a super-rays representation of a light field image

    公开(公告)号:US11783489B2

    公开(公告)日:2023-10-10

    申请号:US17244706

    申请日:2021-04-29

    CPC classification number: G06T7/174 G06T7/11 G06T2207/10052

    Abstract: The present disclosure concerns a method for processing a light field image comprising a set of image views. The method is remarkable in that it comprises:



    selecting (101) a set of pixels, named centroids, within a given image view in said light field image, each centroid being associated with a unique label and a unique light ray;
    de-projecting said centroids, that delivers a set of points in a 3D space;
    re-projecting said points of said set of points in a 3D space in at least one other image view in said light field image, which is different from said reference view, that delivers a set of re-projected centroids; and
    determining (102), for each pixel, being associated with a light ray, within a neighborhood of a re-projected centroid, a label related to one of the centroids, said determining relying on a proximity criterion in term of color between pixels and centroids, and a proximity criterion in term of spatial distances between pixels and re-projected centroids; and
    updating (103), for a given centroid, a color value associated with said given centroid, and spatial coordinates of said given centroid within said given image view, wherein said updating comprises:
    de-projecting pixels in said at least one other image view that are associated with a same label of said given centroid, delivering a set of obtained points; and
    re-projecting said obtained points into said given image view, delivering a set of projected points; and
    averaging both color values associated with said projected points and spatial coordinates associated with said projected points for defining updated information related to said given centroid.

    METHOD FOR PROCESSING A LIGHT FIELD IMAGE DELIVERING A SUPER-RAYS REPRESENTATION OF A LIGHT FIELD IMAGE

    公开(公告)号:US20210248754A1

    公开(公告)日:2021-08-12

    申请号:US17244706

    申请日:2021-04-29

    Abstract: The present disclosure concerns a method for processing a light field image comprising a set of image views. The method is remarkable in that it comprises: selecting (101) a set of pixels, named centroids, within a given image view in said light field image, each centroid being associated with a unique label and a unique light ray; de-projecting said centroids, that delivers a set of points in a 3D space; re-projecting said points of said set of points in a 3D space in at least one other image view in said light field image, which is different from said reference view, that delivers a set of re-projected centroids; and determining (102), for each pixel, being associated with a light ray, within a neighborhood of a re-projected centroid, a label related to one of the centroids, said determining relying on a proximity criterion in term of color between pixels and centroids, and a proximity criterion in term of spatial distances between pixels and re-projected centroids; and updating (103), for a given centroid, a color value associated with said given centroid, and spatial coordinates of said given centroid within said given image view, wherein said updating comprises: de-projecting pixels in said at least one other image view that are associated with a same label of said given centroid, delivering a set of obtained points; and re-projecting said obtained points into said given image view, delivering a set of projected points; and averaging both color values associated with said projected points and spatial coordinates associated with said projected points for defining updated information related to said given centroid.

    Method for processing a light field image delivering a super-rays representation of a light field image

    公开(公告)号:US11024035B2

    公开(公告)日:2021-06-01

    申请号:US16466025

    申请日:2017-11-30

    Abstract: The present disclosure concerns a method for processing a light field image comprising a set of image views. The method is remarkable in that it comprises: selecting (101) a set of pixels, named centroids, within a given image view in said light field image, each centroid being associated with a unique label and a unique light ray; de-projecting said centroids, that delivers a set of points in a 3D space; re-projecting said points of said set of points in a 3D space in at least one other image view in said light field image, which is different from said reference view, that delivers a set of re-projected centroids; and determining (102), for each pixel, being associated with a light ray, within a neighborhood of a re-projected centroid, a label related to one of the centroids, said determining relying on a proximity criterion in term of color between pixels and centroids, and a proximity criterion in term of spatial distances between pixels and re-projected centroids; and updating (103), for a given centroid, a color value associated with said given centroid, and spatial coordinates of said given centroid within said given image view, wherein said updating comprises: de-projecting pixels in said at least one other image view that are associated with a same label of said given centroid, delivering a set of obtained points; and re-projecting said obtained points into said given image view, delivering a set of projected points; and averaging both color values associated with said projected points and spatial coordinates associated with said projected points for defining updated information related to said given centroid.

Patent Agency Ranking