-
公开(公告)号：US09706123B2
公开(公告)日：2017-07-11
申请号：US15218405
申请日：2016-07-25
Applicant: Apple Inc.
Inventor： Sebastien X. Beysserie , Damien J. Thivent , Jianping Zhou , Rudolph van der Merwe , Jason Klivington , Xiaoxing Li , Anders Holtsberg , Martin Lindberg , George E. Williams
CPC classification number: H04N5/23267 , G06T5/003 , G06T2207/10016 , G06T2207/20201 , H04N5/23254
Abstract: Techniques to permit a digital image capture device to stabilize a video stream in real-time (during video capture operations) are presented. In general, techniques are disclosed for stabilizing video images using an overscan region and a look-ahead technique enabled by buffering a number of video input frames before generating a first stabilized video output frame. (Capturing a larger image than is displayed creates a buffer of pixels around the edge of an image; overscan is the term given to this buffer of pixels.) More particularly, techniques are disclosed for buffering an initial number of input frames so that a “current” frame can use motion data from both “past” and “future” frames to adjust the strength of a stabilization metric value so as to keep the current frame within its overscan. This look-ahead and look-behind capability permits a smoother stabilizing regime with fewer abrupt adjustments.
-
公开(公告)号：US09596411B2
公开(公告)日：2017-03-14
申请号：US14864709
申请日：2015-09-24
Applicant: Apple Inc.
Inventor： Damien J. Thivent , George E. Williams , Jianping Zhou , Richard L. Baer , Rolf Toft , Sebastien X. Beysserie
CPC classification number: H04N5/23287 , G06T5/20 , H04N5/2254 , H04N5/23254 , H04N5/23258 , H04N5/23267 , H04N5/2328
Abstract: Techniques to improve a digital image capture device's ability to stabilize a video stream are presented. According to some embodiments, improved stabilization of captured video frames is provided by intelligently harnessing the complementary effects of both optical image stabilization (OIS) and electronic image stabilization (EIS). In particular, OIS may be used to remove intra-frame motion blur that is typically lower in amplitude and dominates with longer integration times, while EIS may be used to remove residual unwanted frame-to-frame motion that is typically larger in amplitude. The techniques disclosed herein may also leverage information provided from the image capture device's OIS system to perform improved motion blur-aware video stabilization strength modulation, which permits better video stabilization performance in low light conditions, where integration times tend to be longer, thus leading to a greater amount of motion blurring in the output stabilized video.
Abstract translation: 介绍了提高数字图像采集设备稳定视频流能力的技术。 根据一些实施例，通过智能地利用光学图像稳定（OIS）和电子图像稳定（EIS）的补充效果来提供捕获的视频帧的改进的稳定性。 特别地，OIS可以用于去除通常在幅度上较低的帧内运动模糊并且以更长的积分时间为主，而EIS可用于去除通常较大振幅的残留的不希望的帧到帧运动。 本文公开的技术还可以利用从图像捕获设备的OIS系统提供的信息来执行改进的运动模糊感知视频稳定强度调制，其允许在低光条件下更好的视频稳定性能，其中集成时间趋于更长，从而导致 输出稳定视频中的运动模糊量更大。
-
公开(公告)号：US20160360111A1
公开(公告)日：2016-12-08
申请号：US14864709
申请日：2015-09-24
Applicant: Apple Inc.
Inventor： Damien J. Thivent , George E. Williams , Jianping Zhou , Richard L. Baer , Rolf Toft , Sebastien X. Beysserie
CPC classification number: H04N5/23287 , G06T5/20 , H04N5/2254 , H04N5/23254 , H04N5/23258 , H04N5/23267 , H04N5/2328
Abstract: Techniques to improve a digital image capture device's ability to stabilize a video stream are presented. According to some embodiments, improved stabilization of captured video frames is provided by intelligently harnessing the complementary effects of both optical image stabilization (OIS) and electronic image stabilization (EIS). In particular, OIS may be used to remove intra-frame motion blur that is typically lower in amplitude and dominates with longer integration times, while EIS may be used to remove residual unwanted frame-to-frame motion that is typically larger in amplitude. The techniques disclosed herein may also leverage information provided from the image capture device's OIS system to perform improved motion blur-aware video stabilization strength modulation, which permits better video stabilization performance in low light conditions, where integration times tend to be longer, thus leading to a greater amount of motion blurring in the output stabilized video.
Abstract translation: 介绍了提高数字图像采集设备稳定视频流能力的技术。 根据一些实施例，通过智能地利用光学图像稳定（OIS）和电子图像稳定（EIS）的补充效果来提供捕获的视频帧的改进的稳定性。 特别地，OIS可以用于去除通常在幅度上较低的帧内运动模糊并且以更长的积分时间为主，而EIS可用于去除通常较大振幅的残留的不希望的帧到帧运动。 本文公开的技术还可以利用从图像捕获设备的OIS系统提供的信息来执行改进的运动模糊感知视频稳定强度调制，其允许在低光条件下更好的视频稳定性能，其中集成时间趋于更长，从而导致 输出稳定视频中的运动模糊量更大。
-
公开(公告)号：US20140363096A1
公开(公告)日：2014-12-11
申请号：US13911793
申请日：2013-06-06
Applicant: Apple Inc.
Inventor： Jianping Zhou , Paul Hubel , Marius Tico , Anita Nariani Schulze , Rolf Toft
IPC: G06T7/00
CPC classification number: G06T7/0028 , G06T7/33 , G06T2207/10016 , G06T2207/20016
Abstract: Systems, methods, and computer readable media to improve image stabilization operations are described. A novel approach to pixel-based registration of non-reference images to a reference frame in a set of commonly captured images is disclosed which makes use of pyramid decomposition to more efficiently detect corners. The disclosed pixel-based registration operation may also be combined with motion sensor data-based registration approaches to register non-reference images with respect to the reference frame. When the registered non-reference images are combined with the pre-selected reference image, the resulting image is a quality stabilized image.
Abstract translation: 描述了用于改善图像稳定操作的系统，方法和计算机可读介质。 公开了一种将非参考图像基于像素的注册到一组共同拍摄的图像中的参考帧的新颖方法，其利用金字塔分解来更有效地检测角落。 所公开的基于像素的注册操作还可以与基于运动传感器数据的注册方法组合以便相对于参考帧来注册非参考图像。 当登记的非参考图像与预先选择的参考图像组合时，所得图像是质量稳定图像。
-
公开(公告)号：US20130329063A1
公开(公告)日：2013-12-12
申请号：US13630961
申请日：2012-09-28
Applicant: APPLE INC.
Inventor： Jianping Zhou
IPC: H04N5/217
CPC classification number: H04N5/23254 , H04N5/217 , H04N5/23258 , H04N5/23267
Abstract: A method for reducing noise in a sequence of frames may include generating a transformed frame from an input frame according to a perspective transform of a transform matrix, wherein the transform matrix corrects for motion associated with input frame. A determination may be made to identify pixels in the transformed frame that have a difference with corresponding pixels in a neighboring frame below a threshold. An output frame may be generated by adjusting pixels in the transformed frame that are identified to have the difference with the corresponding pixels in the neighboring frame below the threshold.
Abstract translation: 用于减少帧序列中的噪声的方法可以包括根据变换矩阵的透视变换从输入帧生成变换帧，其中变换矩阵校正与输入帧相关联的运动。 可以确定识别与低于阈值的相邻帧中的相应像素有差异的变换帧中的像素。 可以通过调整被识别为与阈值以下的相邻帧中的相应像素具有差异的变换帧中的像素来生成输出帧。
-
Patent Agency Ranking
公开(公告)号：US12063441B1
公开(公告)日：2024-08-13
申请号：US17024429
申请日：2020-09-17
Applicant: Apple Inc.
Inventor： Abhishek Dhanda , Jianping Zhou , Kevin A Gross , Santiago Alban
IPC: H04N23/68 , G06F3/04883 , H04N23/63
CPC classification number: H04N23/687 , G06F3/04883 , H04N23/632 , H04N23/6812 , H04N23/683
Abstract: Various embodiments include implementing optical image stabilization (OIS) in a camera module. For example, a controller may control an actuator of the camera module to move a lens group and/or an image sensor of the camera module to provide OIS movement. In various embodiments, OIS movement control is implemented according to a region-based blur reduction model that effects a greater reduction in blur associated with a target region of an image sensor, relative to one or more other regions of the image sensor.
-
公开(公告)号：US11277553B2
公开(公告)日：2022-03-15
申请号：US16891434
申请日：2020-06-03
Applicant: Apple Inc.
Inventor： Jianping Zhou , Sebastien Beysserie , Jozef Kruger
Abstract: Techniques are described for automatically selecting between multiple image capture subsystems with overlapping fields of view but different optical properties. A selection may be made by estimating a plurality of operational characteristics of an image capture event, and, based on those estimates, selecting a primary image capture subsystem for the image capture event. For example, in a device such as a cellphone comprising two capture subsystems, each subsystem including a lens system and sensor system where each subsystem has a different fixed optical zoom parameter, a subsystem can be chosen based on a combination of desired zoom value, estimated focus distance, and estimated scene brightness.
-
公开(公告)号：US20200296270A1
公开(公告)日：2020-09-17
申请号：US16891434
申请日：2020-06-03
Applicant: Apple Inc.
Inventor： Jianping Zhou , Sebastien Beysserie , Jozef Kruger
Abstract: Techniques are described for automatically selecting between multiple image capture subsystems with overlapping fields of view but different optical properties. A selection may be made by estimating a plurality of operational characteristics of an image capture event, and, based on those estimates, selecting a primary image capture subsystem for the image capture event. For example, in a device such as a cellphone comprising two capture subsystems, each subsystem including a lens system and sensor system where each subsystem has a different fixed optical zoom parameter, a subsystem can be chosen based on a combination of desired zoom value, estimated focus distance, and estimated scene brightness.
-
公开(公告)号：US20170359494A1
公开(公告)日：2017-12-14
申请号：US15617918
申请日：2017-06-08
Applicant: Apple Inc.
Inventor： Jianping Zhou , Sebastien Beysserie , Jozef Kruger
Abstract: Techniques are described for automatically selecting between multiple image capture subsystems with overlapping fields of view but different optical properties. A selection may be made by estimating a plurality of operational characteristics of an image capture event, and, based on those estimates, selecting a primary image capture subsystem for the image capture event. For example, in a device such as a cellphone comprising two capture subsystems, each subsystem including a lens system and sensor system where each subsystem has a different fixed optical zoom parameter, a subsystem can be chosen based on a combination of desired zoom value, estimated focus distance, and estimated scene brightness.
-
公开(公告)号：US09674438B2
公开(公告)日：2017-06-06
申请号：US14467998
申请日：2014-08-25
Applicant: Apple Inc.
Inventor： Jianping Zhou , Sebastien X. Beysserie
IPC: H04N5/232
CPC classification number: H04N5/23254 , H04N5/23258 , H04N5/23267
Abstract: Techniques to improve a digital image capture device's ability to stabilize a video stream in low light capture conditions are presented. In general, techniques are disclosed for stabilizing video images using an overscan region and a look-ahead technique enabled by buffering a number of video input frames before generating a first stabilized video output frame. More particularly, techniques are disclosed for buffering an initial number of input frames so that a “current” frame can use time stamped image capture device motion data from both “past” and “future” frames to adjust the strength of a stabilization metric value so as to keep the current frame within its overscan. The calculated adjustments to the strength of the stabilization metric value for a particular frame may be limited to a target max strength value that is determined based, at least in part, on an estimated amount of motion blur in the current frame.
-
-
-
-
-
-
-
-
-
Search Results
44
records
(took 0.017 seconds)
