-
公开(公告)号:US20220286611A1
公开(公告)日:2022-09-08
申请号:US17194102
申请日:2021-03-05
发明人: Eliad Tsairi , Ron Gaizman , Maksym Aslianskyi , Aviel Simchi , Raveh Ben Simon
IPC分类号: H04N5/232
摘要: Digital image stabilization (DIS) may be implemented in image capture devices to address some or all above problems of local stabilization and in-frame distortions alone or in combination with electronic image stabilization (EIS) to reduce artifacts, shake leftovers, and other problems resulting from insufficient global stabilization. DIS may use image sensor motion data derived from image-based information, such as motion vectors between frames, to modify captured image data to generate corrected image frames having improved global stabilization and reduced distortion artifacts and shake leftovers resulting from camera motion. The image sensor motion data may be used in combination with non-image sensor motion data, such as data from a gyroscope an optical image stabilization (OIS) device, a magnetometer, an accelerometer, and/or auto-focus (AF) feedback to perform image stabilization. Image sensor motion data may be used to determine a translation (e.g., a three-dimensional displacement) motion of the image capture device.
-
公开(公告)号:US11277562B2
公开(公告)日:2022-03-15
申请号:US16995546
申请日:2020-08-17
发明人: Young Hoon Kang , Hee Jun Park , Tauseef Kazi , Ron Gaizman , Eran Pinhasov , Meir Tzur
摘要: Techniques and systems are provided for machine-learning based image stabilization. In some examples, a system obtains a sequence of frames captured by an image capture device during a period of time, and collects motion sensor measurements calculated by a motion sensor associated with the image capture device based on movement of the image capture device during the period of time. The system generates, using a deep learning network and the motion sensor measurements, parameters for counteracting motions in one or more frames in the sequence of frames, the motions resulting from the movement of the image capture device during the period of time. The system then adjusts the one or more frames in the sequence of frames according to the parameters to generate one or more adjusted frames having a reduction in at least some of the motions in the one or more frames.
-
公开(公告)号:US10771698B2
公开(公告)日:2020-09-08
申请号:US16120037
申请日:2018-08-31
发明人: Young Hoon Kang , Hee Jun Park , Tauseef Kazi , Ron Gaizman , Eran Pinhasov , Meir Tzur
摘要: Techniques and systems are provided for machine-learning based image stabilization. In some examples, a system obtains a sequence of frames captured by an image capture device during a period of time, and collects motion sensor measurements calculated by a motion sensor associated with the image capture device based on movement of the image capture device during the period of time. The system generates, using a deep learning network and the motion sensor measurements, parameters for counteracting motions in one or more frames in the sequence of frames, the motions resulting from the movement of the image capture device during the period of time. The system then adjusts the one or more frames in the sequence of frames according to the parameters to generate one or more adjusted frames having a reduction in at least some of the motions in the one or more frames.
-
公开(公告)号:US20230412922A1
公开(公告)日:2023-12-21
申请号:US18051727
申请日:2022-11-01
发明人: Eliad Tsairi , Ron Gaizman
CPC分类号: H04N23/6812 , H04N23/684 , H04N23/632
摘要: This disclosure provides systems, methods, and devices for image processing that support improved image quality from reduced artifacts and wobbles. In a first aspect, a method of image processing includes receiving motion data regarding movement of a mobile device; determining a first image sensor configuration based on the motion data; and configuring an image sensor with the first image sensor configuration. Other aspects and features are also claimed and described.
-
公开(公告)号:US11711613B2
公开(公告)日:2023-07-25
申请号:US17241742
申请日:2021-04-27
发明人: Shang-Chih Chuang , Ron Gaizman , Pradeep Veeramalla , Shizhong Liu , Weiliang Liu , Xiaoyun Jiang , Narayana Karthik Ravirala , Jiafu Luo , Srinath Anekere Narayan , Wei Zou
IPC分类号: H04N23/68
CPC分类号: H04N23/689 , H04N23/6812
摘要: Image frames for computational photography may be corrected, such as through rolling shutter correction (RSC), prior to fusion of the image frames to reduce wobble and jitter artifacts present in a video sequence of HDR-enhanced image frames. First and second motion data regarding motion of the image capture device may be determined for times corresponding to the capturing of the first and second image frames, respectively. The rolling shutter correction (RSC) may be applied to the first and second image frames based on both the first and second motion data. The corrected first and second image frames may then be aligned and fused to obtain a single output image frame with higher dynamic range than either of the first or second image frames.
-
公开(公告)号:US12052497B2
公开(公告)日:2024-07-30
申请号:US16847488
申请日:2020-04-13
发明人: Ron Gaizman , Eliad Tsairi , Meir Tzur , Maksym Aslianskyi
IPC分类号: H04N23/68
CPC分类号: H04N23/6811 , H04N23/6812
摘要: Example are described for combining optical image stabilization and electronic image stabilization for capture and processing of frames for video. An example device configured to perform electronic image stabilization in light of optical image stabilization performed may include a memory and one or more processors. The one or more processors may be configured to obtain optical image stabilization (OIS) information for OIS performed during capture of a sequence of frames by an image sensor and determine an electronic image stabilization (EIS) filter based on the OIS information. The one or more processors may also be configured to obtain camera position information, and the EIS filter may also be based on the camera position information. The one or more processors may also configure an image signal processor to perform EIS based on the EIS filter.
-
公开(公告)号:US11825207B1
公开(公告)日:2023-11-21
申请号:US17734950
申请日:2022-05-02
发明人: Narayana Karthik Ravirala , Chanchal Raj , Shizhong Liu , Weiliang Liu , Ron Gaizman , Lianming Shi
IPC分类号: H04N23/73 , H04N23/741 , H04N5/14
CPC分类号: H04N23/73 , H04N5/144 , H04N23/741
摘要: The present disclosure generally relates to exposure control for image capture devices. One example method generally includes receiving sensor data indicating a movement associated with an image capture device capturing a first frame and a second frame, wherein the first frame is associated with a higher exposure setting as compared to the second frame; predicting, based on the sensor data, a shift for aligning one or more features of the first frame and one or more features of the second frame; applying the shift to align the one or more features of the first frame and the one or more features of second frame; and generating a frame output at least in part by combining at least a portion of the first frame with at least a portion of the second frame.
-
公开(公告)号:US20220345605A1
公开(公告)日:2022-10-27
申请号:US17241742
申请日:2021-04-27
发明人: Shang-Chih Chuang , Ron Gaizman , Pradeep Veeramalla , Shizhong Liu , Weiliang Liu , Xiaoyun Jiang , Narayana Karthik Ravirala , Jiafu Luo , Srinath Anekere Narayan , Wei Zou
IPC分类号: H04N5/232
摘要: Image frames for computational photography may be corrected, such as through rolling shutter correction (RSC), prior to fusion of the image frames to reduce wobble and jitter artifacts present in a video sequence of HDR-enhanced image frames. First and second motion data regarding motion of the image capture device may be determined for times corresponding to the capturing of the first and second image frames, respectively. The rolling shutter correction (RSC) may be applied to the first and second image frames based on both the first and second motion data. The corrected first and second image frames may then be aligned and fused to obtain a single output image frame with higher dynamic range than either of the first or second image frames.
-
-
-
-
-
-
-