-
公开(公告)号:US20230412922A1
公开(公告)日:2023-12-21
申请号:US18051727
申请日:2022-11-01
Applicant: QUALCOMM Incorporated
Inventor: Eliad Tsairi , Ron Gaizman
CPC classification number: H04N23/6812 , H04N23/684 , H04N23/632
Abstract: This disclosure provides systems, methods, and devices for image processing that support improved image quality from reduced artifacts and wobbles. In a first aspect, a method of image processing includes receiving motion data regarding movement of a mobile device; determining a first image sensor configuration based on the motion data; and configuring an image sensor with the first image sensor configuration. Other aspects and features are also claimed and described.
-
公开(公告)号:US11711613B2
公开(公告)日:2023-07-25
申请号:US17241742
申请日:2021-04-27
Applicant: QUALCOMM Incorporated
Inventor: Shang-Chih Chuang , Ron Gaizman , Pradeep Veeramalla , Shizhong Liu , Weiliang Liu , Xiaoyun Jiang , Narayana Karthik Ravirala , Jiafu Luo , Srinath Anekere Narayan , Wei Zou
IPC: H04N23/68
CPC classification number: H04N23/689 , H04N23/6812
Abstract: Image frames for computational photography may be corrected, such as through rolling shutter correction (RSC), prior to fusion of the image frames to reduce wobble and jitter artifacts present in a video sequence of HDR-enhanced image frames. First and second motion data regarding motion of the image capture device may be determined for times corresponding to the capturing of the first and second image frames, respectively. The rolling shutter correction (RSC) may be applied to the first and second image frames based on both the first and second motion data. The corrected first and second image frames may then be aligned and fused to obtain a single output image frame with higher dynamic range than either of the first or second image frames.
-
公开(公告)号:US12223663B2
公开(公告)日:2025-02-11
申请号:US17240837
申请日:2021-04-26
Applicant: QUALCOMM Incorporated
Inventor: Mark Gintsburg , Nir Strauss , Ron Gaizman , Eran Pinhasov , Yuri Dolgin , Victor Pinto
Abstract: Techniques and systems are provided for processing one or more frames or images. For instance, a process for determining exposure for one or more frames includes obtaining a motion map for one or more frames. The process includes determining, based on the motion map, motion associated with the one or more frames of a scene. The motion corresponds to movement of one or more objects in the scene relative to a camera used to capture the one or more frames. The process includes determining, based on the determined motion, a number of frames and an exposure for capturing the number of frames. The process further includes sending a request to capture the number of frames using the determined exposure duration.
-
公开(公告)号:US20220286611A1
公开(公告)日:2022-09-08
申请号:US17194102
申请日:2021-03-05
Applicant: QUALCOMM Incorporated
Inventor: Eliad Tsairi , Ron Gaizman , Maksym Aslianskyi , Aviel Simchi , Raveh Ben Simon
IPC: H04N5/232
Abstract: Digital image stabilization (DIS) may be implemented in image capture devices to address some or all above problems of local stabilization and in-frame distortions alone or in combination with electronic image stabilization (EIS) to reduce artifacts, shake leftovers, and other problems resulting from insufficient global stabilization. DIS may use image sensor motion data derived from image-based information, such as motion vectors between frames, to modify captured image data to generate corrected image frames having improved global stabilization and reduced distortion artifacts and shake leftovers resulting from camera motion. The image sensor motion data may be used in combination with non-image sensor motion data, such as data from a gyroscope an optical image stabilization (OIS) device, a magnetometer, an accelerometer, and/or auto-focus (AF) feedback to perform image stabilization. Image sensor motion data may be used to determine a translation (e.g., a three-dimensional displacement) motion of the image capture device.
-
公开(公告)号:US12052497B2
公开(公告)日:2024-07-30
申请号:US16847488
申请日:2020-04-13
Applicant: QUALCOMM Incorporated
Inventor: Ron Gaizman , Eliad Tsairi , Meir Tzur , Maksym Aslianskyi
IPC: H04N23/68
CPC classification number: H04N23/6811 , H04N23/6812
Abstract: Example are described for combining optical image stabilization and electronic image stabilization for capture and processing of frames for video. An example device configured to perform electronic image stabilization in light of optical image stabilization performed may include a memory and one or more processors. The one or more processors may be configured to obtain optical image stabilization (OIS) information for OIS performed during capture of a sequence of frames by an image sensor and determine an electronic image stabilization (EIS) filter based on the OIS information. The one or more processors may also be configured to obtain camera position information, and the EIS filter may also be based on the camera position information. The one or more processors may also configure an image signal processor to perform EIS based on the EIS filter.
-
公开(公告)号:US11825207B1
公开(公告)日:2023-11-21
申请号:US17734950
申请日:2022-05-02
Applicant: QUALCOMM Incorporated
Inventor: Narayana Karthik Ravirala , Chanchal Raj , Shizhong Liu , Weiliang Liu , Ron Gaizman , Lianming Shi
IPC: H04N23/73 , H04N23/741 , H04N5/14
CPC classification number: H04N23/73 , H04N5/144 , H04N23/741
Abstract: The present disclosure generally relates to exposure control for image capture devices. One example method generally includes receiving sensor data indicating a movement associated with an image capture device capturing a first frame and a second frame, wherein the first frame is associated with a higher exposure setting as compared to the second frame; predicting, based on the sensor data, a shift for aligning one or more features of the first frame and one or more features of the second frame; applying the shift to align the one or more features of the first frame and the one or more features of second frame; and generating a frame output at least in part by combining at least a portion of the first frame with at least a portion of the second frame.
-
公开(公告)号:US20220345605A1
公开(公告)日:2022-10-27
申请号:US17241742
申请日:2021-04-27
Applicant: QUALCOMM Incorporated
Inventor: Shang-Chih Chuang , Ron Gaizman , Pradeep Veeramalla , Shizhong Liu , Weiliang Liu , Xiaoyun Jiang , Narayana Karthik Ravirala , Jiafu Luo , Srinath Anekere Narayan , Wei Zou
IPC: H04N5/232
Abstract: Image frames for computational photography may be corrected, such as through rolling shutter correction (RSC), prior to fusion of the image frames to reduce wobble and jitter artifacts present in a video sequence of HDR-enhanced image frames. First and second motion data regarding motion of the image capture device may be determined for times corresponding to the capturing of the first and second image frames, respectively. The rolling shutter correction (RSC) may be applied to the first and second image frames based on both the first and second motion data. The corrected first and second image frames may then be aligned and fused to obtain a single output image frame with higher dynamic range than either of the first or second image frames.
-
公开(公告)号:US20240373128A1
公开(公告)日:2024-11-07
申请号:US18724917
申请日:2021-12-31
Applicant: QUALCOMM Incorporated
Inventor: Eliad Tsairi , Ron Gaizman , Yu-Chen Hsu , Xiongfei Yu
IPC: H04N23/68 , H04N23/611
Abstract: The present disclosure provides systems, apparatus, methods, and computer-readable media that support adapting image processing based on the user activity performed while recording an image. In a first aspect, a method of image processing may include determining a type of activity based on sensor data, such as motion sensors and/or image sensor data. The type of activity may be provided to an image processing algorithm, such as an image/video stabilization algorithm, which adapts based on the activity type. For example, a rolling shutter correction may have a strength factor that is adapted to lower values when the type of activity is a panning motion when faces are present in the frame. As another example, another image stabilization (IS) algorithm such as an electronic image stabilization (EIS) algorithm may have adaptive behavior adjusted based on the type of activity. Other aspects and features are also claimed and described.
-
公开(公告)号:US11277562B2
公开(公告)日:2022-03-15
申请号:US16995546
申请日:2020-08-17
Applicant: QUALCOMM Incorporated
Inventor: Young Hoon Kang , Hee Jun Park , Tauseef Kazi , Ron Gaizman , Eran Pinhasov , Meir Tzur
Abstract: Techniques and systems are provided for machine-learning based image stabilization. In some examples, a system obtains a sequence of frames captured by an image capture device during a period of time, and collects motion sensor measurements calculated by a motion sensor associated with the image capture device based on movement of the image capture device during the period of time. The system generates, using a deep learning network and the motion sensor measurements, parameters for counteracting motions in one or more frames in the sequence of frames, the motions resulting from the movement of the image capture device during the period of time. The system then adjusts the one or more frames in the sequence of frames according to the parameters to generate one or more adjusted frames having a reduction in at least some of the motions in the one or more frames.
-
公开(公告)号:US10771698B2
公开(公告)日:2020-09-08
申请号:US16120037
申请日:2018-08-31
Applicant: QUALCOMM Incorporated
Inventor: Young Hoon Kang , Hee Jun Park , Tauseef Kazi , Ron Gaizman , Eran Pinhasov , Meir Tzur
Abstract: Techniques and systems are provided for machine-learning based image stabilization. In some examples, a system obtains a sequence of frames captured by an image capture device during a period of time, and collects motion sensor measurements calculated by a motion sensor associated with the image capture device based on movement of the image capture device during the period of time. The system generates, using a deep learning network and the motion sensor measurements, parameters for counteracting motions in one or more frames in the sequence of frames, the motions resulting from the movement of the image capture device during the period of time. The system then adjusts the one or more frames in the sequence of frames according to the parameters to generate one or more adjusted frames having a reduction in at least some of the motions in the one or more frames.
-
-
-
-
-
-
-
-
-