-
1.
公开(公告)号:US11195288B2
公开(公告)日:2021-12-07
申请号:US16764040
申请日:2018-11-13
Applicant: InterDigital CE Patent Holdings
Inventor: Matthieu Hog , Neus Sabater , Christine Guillemot
Abstract: A method and device for processing a light field video is described. The light field video includes a set of image views per unit of time, the light field video being associated with a scene without cuts. In the method a first super-rays representation of reference image views at a given time is determined based on centroids. A second super-rays representation associated with corresponding views of a subsequent set of image views is next determined based on de-projection and re-projection of centroids. The displacement of centroids between the first and second super-rays is determined and then the determined displacement is applied to centroids of the second super-rays representation.
-
公开(公告)号:US10957021B2
公开(公告)日:2021-03-23
申请号:US16465094
申请日:2017-11-24
Applicant: INTERDIGITAL CE PATENT HOLDINGS
Inventor: Neus Sabater , Matthieu Hog , Guillaume Boisson
Abstract: A method for rendering an image, called a final image, from at least one image acquired by a camera array, is provided. According to such a method, the determination of a color value for at least one pixel of the final image, called a current pixel, comprises: for at least one initial image acquired by the camera array, obtaining a color value of a pixel associated with said current pixel within said at least one initial image, acquiring at least one color value called a real color value; computing at least one interpolated color value, from said at least one real color value; determining the color value for said current pixel, as a function of said at least one real color value and said at least one interpolated color value.
-
公开(公告)号:US10719948B2
公开(公告)日:2020-07-21
申请号:US15569737
申请日:2016-04-21
Applicant: InterDigital CE Patent Holdings, SAS
Inventor: Benoit Vandame , Neus Sabater , Olivier Bureller
IPC: G06K9/32 , G06T7/557 , G03B35/10 , H01L27/146 , H04N5/232 , H04N5/225 , H04N13/111 , H04N13/00
Abstract: An apparatus to process a lightfield image of a scene acquired with a lightfield acquisition device comprises means for obtaining a first focal stack and a second focal stack, each comprising images representative of the scene and obtained from a different part of the pixels of the lightfield image. A method of processing the lightfield content is also described.
-
公开(公告)号:US10510156B2
公开(公告)日:2019-12-17
申请号:US15531408
申请日:2015-11-24
Applicant: InterDigital CE Patent Holdings
Inventor: Mozhdeh Seifi , Neus Sabater , Valter Drazic
Abstract: Methods and apparatus for estimating a depth of unfocused plenoptic data are suggested. The method includes: determining a level of homogeneity of micro-lens images of unfocused plenoptic data; determining pixels of the micro-lens images of the unfocused plenoptic unfocused plenoptic data which either have disparities equal to zero or belong to homogeneous areas as a function of the calculated level of homogeneity of the micro-lens images of the unfocused plenoptic data; and estimating the depth of the unfocused plenoptic data by a disparity estimation without considering the determined pixels. With the disclosure, by pre-processing the raw data, it can prevent any disparity estimation method to spend time on estimating disparities for: (i) pixels that are in focus, (ii) pixels that belong to homogenous areas of the scene.
-
公开(公告)号:US12038966B2
公开(公告)日:2024-07-16
申请号:US16934636
申请日:2020-07-21
Applicant: INTERDIGITAL CE PATENT HOLDINGS
Inventor: Jurgen Stauder , Neus Sabater , Cedric Thebault
IPC: G06F16/51 , G06F16/583 , G06F18/22 , G06T7/60
CPC classification number: G06F16/51 , G06F16/583 , G06F16/5854 , G06F18/22 , G06T7/60 , G06T2207/10052
Abstract: A method and an apparatus for data retrieval in a lightfield database are described. An acquiring unit of the apparatus acquires a sample data. An operation unit determines a plurality of two-dimensional (2D) images from each 4D lightfield data of the lightfield database, and match the sample data with the determined 2D images according to geometrical parameters of the sample data and geometrical parameters of the 2D images. One of the 2D images is selected as a target image based on the matching result, and the 4D lightfield from which the target image is determined is retrieved.
-
公开(公告)号:US11783489B2
公开(公告)日:2023-10-10
申请号:US17244706
申请日:2021-04-29
Applicant: InterDigital CE Patent Holdings, SAS
Inventor: Matthieu Hog , Neus Sabater , Christine Guillemot
CPC classification number: G06T7/174 , G06T7/11 , G06T2207/10052
Abstract: The present disclosure concerns a method for processing a light field image comprising a set of image views. The method is remarkable in that it comprises:
selecting (101) a set of pixels, named centroids, within a given image view in said light field image, each centroid being associated with a unique label and a unique light ray;
de-projecting said centroids, that delivers a set of points in a 3D space;
re-projecting said points of said set of points in a 3D space in at least one other image view in said light field image, which is different from said reference view, that delivers a set of re-projected centroids; and
determining (102), for each pixel, being associated with a light ray, within a neighborhood of a re-projected centroid, a label related to one of the centroids, said determining relying on a proximity criterion in term of color between pixels and centroids, and a proximity criterion in term of spatial distances between pixels and re-projected centroids; and
updating (103), for a given centroid, a color value associated with said given centroid, and spatial coordinates of said given centroid within said given image view, wherein said updating comprises:
de-projecting pixels in said at least one other image view that are associated with a same label of said given centroid, delivering a set of obtained points; and
re-projecting said obtained points into said given image view, delivering a set of projected points; and
averaging both color values associated with said projected points and spatial coordinates associated with said projected points for defining updated information related to said given centroid.-
7.
公开(公告)号:US11257236B2
公开(公告)日:2022-02-22
申请号:US17261375
申请日:2019-07-17
Applicant: InterDigital CE Patent Holdings, SAS
Inventor: Frederic Babon , Neus Sabater , Matthieu Hog , Didier Doyen , Guillaume Boisson
IPC: G06T7/557
Abstract: A method is proposed for estimating a depth for pixels in a matrix of M images. Such method comprises, at least for one set of N images among the M images, 2
-
公开(公告)号:US20240098235A1
公开(公告)日:2024-03-21
申请号:US18272472
申请日:2022-01-11
Applicant: InterDigital CE Patent Holdings, SAS
Inventor: Neus Sabater , Julia Navarro , Julien Fleureau , Guillaume Boisson
IPC: H04N13/161 , H04N13/139 , H04N13/156 , H04N13/194
CPC classification number: H04N13/161 , H04N13/139 , H04N13/156 , H04N13/194 , H04N2013/0081
Abstract: Methods and devices for generated multiplane images from a representation of a 3D scene are disclosed. When an MPI is generated by the system, an image of the accumulation of the alpha values is computed. A convolutional networked is trained with a penalization function that penalizes MPIs with high values of accumulated alpha according to a parameter selected or trained to reduce the redundancy of information between layers of the MPI. When generating a MPI from a subset of the views of a new captured 3D scene, a first MPI is generated with the trained CNN with the associated parameter. An error is calculated between the other views and corresponding synthesized with the first MPI. This error is used to modify the parameter. Then, a second MPI is generated with the trained CNN with the new parameter.
-
9.
公开(公告)号:US20230410320A1
公开(公告)日:2023-12-21
申请号:US18240856
申请日:2023-08-31
Applicant: InterDigital CE Patent Holdings, SAS
Inventor: Matthieu Hog , Neus Sabater , Christine Guillemot
CPC classification number: G06T7/174 , G06T2207/10052 , G06T7/11
Abstract: An apparatus and method for processing a light field comprising a plurality of views of a 3D scene includes obtaining a super-ray representation for the light field, wherein the super-ray representation comprises a plurality of super-rays, wherein each super-ray groups pixels corresponding to a set of light rays having a similar color from each of the plurality of views, and wherein the set of light rays for each super-ray originates from one area of the 3D scene; and processing the light field by processing the super-ray representation for the light field, wherein processing the light field comprises at least one of editing the light field, segmenting the light field, and refocusing the light field.
-
10.
公开(公告)号:US10762689B2
公开(公告)日:2020-09-01
申请号:US16170608
申请日:2018-10-25
Applicant: INTERDIGITAL CE PATENT HOLDINGS
Inventor: Neus Sabater , Erik Reinhard , Matthieu Hog , Elena Garces
Abstract: Selecting at least one surface in a light field, such as a light field associated with multiple views corresponding to different view points of a same scene, may include displaying one of the multiple views as a reference view, selecting at least one surface in the reference view, identifying a set of pixels belonging to the selected surface, which are occluded in the reference view but visible in at least one of the multiple views, projecting the set of pixels into the reference view on the basis of a value of the pixels of the set in the view or views in which they are visible in order to form an upgraded reference view, displaying the upgraded reference view, and updating the selected surface in the upgraded reference view.
-
-
-
-
-
-
-
-
-