-
公开(公告)号:US11412136B2
公开(公告)日:2022-08-09
申请号:US16704982
申请日:2019-12-05
Applicant: Samsung Electronics Co., Ltd.
Inventor: Hamid R. Sheikh , Youngjun Yoo , John Seokjun Lee , Michael O. Polley
Abstract: A method includes, in a first mode, positioning first and second tiltable image sensor modules of an image sensor array of an electronic device so that a first optical axis of the first tiltable image sensor module and a second optical axis of the second tiltable image sensor module are substantially perpendicular to a surface of the electronic device, and the first and second tiltable image sensor modules are within a thickness profile of the electronic device. The method also includes, in a second mode, tilting the first and second tiltable image sensor modules so that the first optical axis of the first tiltable image sensor module and the second optical axis of the second tiltable image sensor module are not perpendicular to the surface of the electronic device, and at least part of the first and second tiltable image sensor modules are no longer within the thickness profile of the electronic device.
-
公开(公告)号:US20250166129A1
公开(公告)日:2025-05-22
申请号:US18516277
申请日:2023-11-21
Applicant: Samsung Electronics Co., Ltd.
Inventor: Gunawath Dilshan Godaliyadda , Abhiram Gnanasambandam , John Seokjun Lee , Hamid R. Sheikh , Michael O. Polley
IPC: G06T5/50 , G06T7/00 , H04N5/265 , H04N23/667 , H04N23/80
Abstract: A method includes obtaining, using a multi-mode image sensor, first image frames and second image frames. The first image frames include image data having a first bit depth, and the second image frames include image data having a second bit depth smaller than the first bit depth. The first image frames are captured using two or more exposure times, and the second image frames are captured using at least one exposure time shorter than the two or more exposure times. At least one of the second image frames is captured in between each consecutive pair of the first image frames. The method also includes providing at least the first image frames to a multi-frame processing (MFP) pipeline and processing at least the first image frames using the MFP pipeline to generate an output image.
-
公开(公告)号:US20220337747A1
公开(公告)日:2022-10-20
申请号:US17810213
申请日:2022-06-30
Applicant: Samsung Electronics Co., Ltd.
Inventor: Hamid R. Sheikh , Youngjun Yoo , John Seokjun Lee , Michael O. Polley
Abstract: A method for operating an electronic device includes capturing, by an image sensor module, a stream from a pixel array. The method also includes processing, by the image sensor module, the stream to generate a preview stream and a full frame stream. The method further includes compressing, by the image sensor module, the preview stream using a first compression and the full frame stream using a second compression. In addition, the method includes outputting, by the image sensor module, the compressed preview stream and the compressed full frame stream.
-
公开(公告)号:US20220303495A1
公开(公告)日:2022-09-22
申请号:US17591040
申请日:2022-02-02
Applicant: Samsung Electronics Co., Ltd.
Inventor: Gyeongmin Choe , Yingmao Li , John Seokjun Lee , Hamid R. Sheikh , Michael O. Polley
Abstract: An apparatus includes at least one processing device configured to obtain input frames from a video. The at least one processing device is also configured to generate a forward flow from a first input frame to a second input frame and a backward flow from the second input frame to the first input frame. The at least one processing device is further configured to generate an occlusion map at an interpolated frame coordinate using the forward flow and the backward flow. The at least one processing device is also configured to generate a consistency map at the interpolated frame coordinate using the forward flow and the backward flow. In addition, the at least one processing device is configured to perform blending using the occlusion map and the consistency map to generate an interpolated frame at the interpolated frame coordinate.
-
公开(公告)号:US20220012903A1
公开(公告)日:2022-01-13
申请号:US16946956
申请日:2020-07-13
Applicant: Samsung Electronics Co., Ltd.
Inventor: Kushal K. Vyas , Yingmao Li , Chenchi Luo , George Q. Chen , Hamid R. Sheikh , Youngjun Yoo , Michael O. Polley
Abstract: A method includes obtaining, using at least one processor, an input image frame. The method also includes identifying, using the at least one processor, one or more regions of the input image frame containing redundant information. In addition, the method includes performing, using the at least one processor, an image processing task using the input image frame. The image processing task is guided based on the one or more identified regions of the input image frame. The method may further include obtaining, using the at least one processor, a coarse depth map associated with the input image frame. Performing the image processing task may include refining the coarse depth map to produce a refined depth map, where the refining of the coarse depth map is guided based on the one or more identified regions of the input image frame.
-
6.
公开(公告)号:US12192673B2
公开(公告)日:2025-01-07
申请号:US17591350
申请日:2022-02-02
Applicant: Samsung Electronics Co., Ltd.
Inventor: Gyeongmin Choe , Yingmao Li , John Seokjun Lee , Hamid R. Sheikh , Michael O. Polley
IPC: H04N7/01 , G06T1/00 , G06T3/18 , G06T5/50 , G06T7/207 , H04N1/32 , H04N19/139 , H04N19/577
Abstract: A method includes obtaining multiple video frames. The method also includes determining whether a bi-directional optical flow between the multiple video frames satisfies an image quality criterion for bi-directional consistency. The method further includes identifying a non-linear curve based on pixel coordinate values from at least two of the video frames. The at least two video frames include first and second video frames. The method also includes generating interpolated video frames between the first and second video frames by applying non-linear interpolation based on the non-linear curve. In addition, the method includes outputting the interpolated video frames for presentation.
-
公开(公告)号:US11532091B2
公开(公告)日:2022-12-20
申请号:US16946956
申请日:2020-07-13
Applicant: Samsung Electronics Co., Ltd.
Inventor: Kushal Kardam Vyas , Yingmao Li , Chenchi Luo , George Q. Chen , Hamid R. Sheikh , Youngjun Yoo , Michael O. Polley
Abstract: A method includes obtaining, using at least one processor, an input image frame. The method also includes identifying, using the at least one processor, one or more regions of the input image frame containing redundant information. In addition, the method includes performing, using the at least one processor, an image processing task using the input image frame. The image processing task is guided based on the one or more identified regions of the input image frame. The method may further include obtaining, using the at least one processor, a coarse depth map associated with the input image frame. Performing the image processing task may include refining the coarse depth map to produce a refined depth map, where the refining of the coarse depth map is guided based on the one or more identified regions of the input image frame.
-
公开(公告)号:US12200398B2
公开(公告)日:2025-01-14
申请号:US17591040
申请日:2022-02-02
Applicant: Samsung Electronics Co., Ltd.
Inventor: Gyeongmin Choe , Yingmao Li , John Seokjun Lee , Hamid R. Sheikh , Michael O. Polley
IPC: H04N7/01 , G06T1/00 , G06T3/18 , G06T5/50 , G06T7/207 , H04N1/32 , H04N19/139 , H04N19/577
Abstract: An apparatus includes at least one processing device configured to obtain input frames from a video. The at least one processing device is also configured to generate a forward flow from a first input frame to a second input frame and a backward flow from the second input frame to the first input frame. The at least one processing device is further configured to generate an occlusion map at an interpolated frame coordinate using the forward flow and the backward flow. The at least one processing device is also configured to generate a consistency map at the interpolated frame coordinate using the forward flow and the backward flow. In addition, the at least one processing device is configured to perform blending using the occlusion map and the consistency map to generate an interpolated frame at the interpolated frame coordinate.
-
9.
公开(公告)号:US20220301184A1
公开(公告)日:2022-09-22
申请号:US17591350
申请日:2022-02-02
Applicant: Samsung Electronics Co., Ltd.
Inventor: Gyeongmin Choe , Yingmao Li , John Seokjun Lee , Hamid R. Sheikh , Michael O. Polley
IPC: G06T7/207 , H04N19/577 , H04N19/139
Abstract: A method includes obtaining multiple video frames. The method also includes determining whether a bi-directional optical flow between the multiple video frames satisfies an image quality criterion for bi-directional consistency. The method further includes identifying a non-linear curve based on pixel coordinate values from at least two of the video frames. The at least two video frames include first and second video frames. The method also includes generating interpolated video frames between the first and second video frames by applying non-linear interpolation based on the non-linear curve. In addition, the method includes outputting the interpolated video frames for presentation.
-
公开(公告)号:US20210281813A1
公开(公告)日:2021-09-09
申请号:US16811585
申请日:2020-03-06
Applicant: Samsung Electronics Co., Ltd.
Inventor: Kushal K. Vyas , Yingmao Li , Chenchi Luo , George Q. Chen , Hamid R. Sheikh , Youngjun Yoo , Michael O. Polley
IPC: H04N13/128 , G06T3/40 , G06T5/00 , G06T5/50
Abstract: A method includes obtaining, using at least one processor, first and second input image frames, where the first and second input image frames are associated with first and second image planes, respectively. The method also includes obtaining, using the at least one processor, a depth map associated with the first input image frame. The method further includes producing another version of the depth map by performing one or more times: (a) projecting, using the at least one processor, the first input image frame to the second image plane in order to produce a projected image frame using (i) the depth map and (ii) information identifying a conversion from the first image plane to the second image plane and (b) adjusting, using the at least one processor, at least one of the depth map and the information identifying the conversion from the first image plane to the second image plane.
-
-
-
-
-
-
-
-
-