公开(公告)号：US11615547B2

公开(公告)日：2023-03-28

申请号：US16877471

申请日：2020-05-18

Applicant: SHANGHAITECH UNIVERSITY

Inventor： Yingliang Zhang ,  Guli Zhang ,  Zhiru Shi

IPC: G06T7/557 ,  G06F17/18 ,  G06K9/62 ,  G06N3/08 ,  G06T15/50

Abstract: A light field image processing method is disclosed for removing occluding foreground and blurring uninterested objects, by differentiating objects located at different depths of field and objects belonging to distinct categories, to create see-through effects. In various embodiments, the image processing method may blur a background object behind a specified object of interest. The image processing method may also at least partially remove from the rendered image any occluding object that may prevent a viewer from viewing the object of interest. The image processing method may further blur areas of the rendered image that represent an object in the light field other than the object of interest. The method includes steps of constructing a light field weight function comprising a depth component and a semantic component, where the weight function assigns a ray in the light field with a weight; and conducting light field rendering using the weight function.

公开(公告)号：US11410459B2

公开(公告)日：2022-08-09

申请号：US16894032

申请日：2020-06-05

Applicant: SHANGHAITECH UNIVERSITY

Inventor： Zhiru Shi ,  Minye Wu ,  Wenguang Ma ,  Jingyi Yu

IPC: H04N5/225 ,  G06V20/64 ,  H04N13/00 ,  G06V40/16 ,  H04N13/282

Abstract: A method of detecting and recognizing faces using a light field camera array is provided. The method includes capturing multi-view color images using the light field camera array; obtaining a depth map; conducting light field rendering using a weight function comprising a depth component and a sematic component, where the weight function assigns a ray in the light field with a weight; and detecting and recognizing a face.

公开(公告)号：US11153606B2

公开(公告)日：2021-10-19

申请号：US16891622

申请日：2020-06-03

Applicant: SHANGHAITECH UNIVERSITY

Inventor： Zhiru Shi ,  Qiang Hu

IPC: H04N19/597 ,  H04N19/167 ,  H04N19/172 ,  G06K9/00

Abstract: A method of perceptual video coding based on face detection is provided. The method includes calculating a bit allocation scheme for coding a light field video based on a saliency map of the face, calculating an LCU level Lagrange multiplier for coding a light field video based on a saliency map of the face and calculating an LCU level quantization parameter for coding a light field video based on a saliency map of the face.

公开(公告)号：US11861840B2

公开(公告)日：2024-01-02

申请号：US17219555

申请日：2021-03-31

Applicant: SHANGHAITECH UNIVERSITY

Inventor： Ziran Xing ,  Zhiru Shi ,  Yi Ma ,  Jingyi Yu

IPC: G06T7/11 ,  G06T7/162 ,  G06T7/187 ,  G06T7/50

CPC classification number: G06T7/11 ,  G06T7/162 ,  G06T7/187 ,  G06T7/50 ,  G06T2207/10028

Abstract: According to some embodiments, an imaging processing method for extracting a plurality of planar surfaces from a depth map includes computing a depth change indication map (DCI) from a depth map in accordance with a smoothness threshold. The imaging processing method further includes recursively extracting a plurality of planar region from the depth map, wherein the size of each planar region is dynamically adjusted according to the DCI. The imaging processing method further includes clustering the extracted planar regions into a plurality of groups in accordance with a distance function; and growing each group to generate pixel-wise segmentation results and inlier points statistics simultaneously.

公开(公告)号：US20210073443A1

公开(公告)日：2021-03-11

申请号：US17099445

申请日：2020-11-16

Applicant: SHANGHAITECH UNIVERSITY

Inventor： Zhiru Shi ,  Ziran Xing

IPC: G06F30/20 ,  G06F17/16

Abstract: A method for approximately solving a consensus set maximization (“CSM”) problem for a dataset is disclosed. The method comprises relaxing a maximum fitting residual constraint in the CSM problem to an average error bounded constraint; defining a plurality of decision problems related to the relaxed CSM problem; solving each decision problem by defining an optimization problem; and selecting a consensus size for the CSM problem based on solutions to the decision problems.

公开(公告)号：US11880964B2

公开(公告)日：2024-01-23

申请号：US17074123

申请日：2020-10-19

Applicant: SHANGHAITECH UNIVERSITY

Inventor： Minye Wu ,  Zhiru Shi ,  Jingyi Yu

IPC: H04N5/225 ,  G06T5/50 ,  G06T7/593 ,  G06T7/557

CPC classification number: G06T5/50 ,  G06T7/557 ,  G06T7/596 ,  G06T2200/21 ,  G06T2207/10052

Abstract: A method of processing light field images for separating a transmitted layer from a reflection layer. The method comprises capturing a plurality of views at a plurality of viewpoints with different polarization angles; obtaining an initial disparity estimation for a first view using SIFT-flow, and warping the first view to a reference view; optimizing an objective function comprising a transmitted layer and a secondary layer using an Augmented Lagrange Multiplier (ALM) with Alternating Direction Minimizing (ADM) strategy; updating the disparity estimation for the first view; repeating the steps of optimizing the objective function and updating the disparity estimation until the change in the objective function between two consecutive iterations is below a threshold; and separating the transmitted layer and the secondary layer using the disparity estimation for the first view.