-
公开(公告)号：US09426409B2
公开(公告)日：2016-08-23
申请号：US14613133
申请日：2015-02-03
Applicant: Apple Inc.
Inventor： Sebastien X. Beysserie , Jason Klivington , Rolf Toft , Frank Doepke
Abstract: Traditionally, time-lapse videos are constructed from images captured at time intervals called “temporal points of interests” or “temporal POIs.” Disclosed herein are systems and methods of constructing improved, motion-stabilized time-lapse videos using temporal points of interest and image similarity comparisons. According to some embodiments, a “burst” of images may be captured, centered around the aforementioned temporal points of interest. Then, each burst sequence of images may be analyzed, e.g., by performing an image similarity comparison between each image in the burst sequence and the image selected at the previous temporal point of interest. Selecting the image from a given burst that is most similar to the previous selected image, while minimizing the amount of motion with the previous selected image, allows the system to improve the quality of the resultant time-lapse video by discarding “outlier” or other undesirable images captured in the burst sequence and motion stabilizing the selected image.
Abstract translation: 传统上，延时视频是从被称为“时间兴趣点”或“时间POI”的时间间隔捕获的图像构成的。这里公开了使用时间兴趣点构建改进的，运动稳定的延时视频的系统和方法， 图像相似性比较。 根据一些实施例，可以以上述时间兴趣点为中心捕获图像的“突发”。 然后，可以例如通过在突发序列中的每个图像和在先前的时间点选择的图像之间执行图像相似性比较来分析图像的每个突发序列。 选择与先前选择的图像最相似的给定脉冲串中的图像，同时使用先前选择的图像最小化运动量，允许系统通过丢弃“异常值”或其他信号来提高合成的延时视频的质量 在突发序列中捕获的不期望的图像和稳定所选择的图像的运动。
-
22.发明授权Video rolling shutter correction for lens movement in optical image stabilization cameras 有权视频滚动快门校正用于光学防抖相机中的镜头移动公开(公告)号：US09357132B2
公开(公告)日：2016-05-31
申请号：US14547107
申请日：2014-11-18
Applicant: Apple Inc.
Inventor： Damien J. Thivent , Rolf Toft , Jianping Zhou
CPC classification number: H04N5/23287 , G02B27/646 , H04N5/2254 , H04N5/2257 , H04N5/23274
Abstract: In some embodiments, a method for compensating for lens motion includes estimating a starting position of a lens assembly associated with captured pixel data. The captured pixel data is captured from an image sensor. In some embodiments, the method further includes calculating from the starting position and position data received from the one or more position sensors lens movement associated with the captured pixel data. The lens movement is mapped into pixel movement associated with the captured pixel data. A transform matrix is adjusted to reflect at least the pixel movement. A limit factor associated with the position data is calculated. The captured pixel data is recalculated using the transform matrix and the limit factor.
Abstract translation: 在一些实施例中，用于补偿透镜运动的方法包括估计与捕获的像素数据相关联的透镜组件的起始位置。 从图像传感器捕获捕获的像素数据。 在一些实施例中，该方法还包括从与所捕获的像素数据相关联的一个或多个位置传感器透镜运动接收到的起始位置和位置数据进行计算。 透镜移动被映射到与捕获的像素数据相关联的像素运动。 调整变换矩阵以至少反映像素运动。 计算与位置数据相关联的极限因子。 使用变换矩阵和极限因子重新计算捕获的像素数据。
-
公开(公告)号：US20160094801A1
公开(公告)日：2016-03-31
申请号：US14613133
申请日：2015-02-03
Applicant: Apple Inc.
Inventor： Sebastien X. Beysserie , Jason Klivington , Rolf Toft , Frank Doepke
Abstract: Traditionally, time-lapse videos are constructed from images captured at time intervals called “temporal points of interests” or “temporal POIs.” Disclosed herein are systems and methods of constructing improved, motion-stabilized time-lapse videos using temporal points of interest and image similarity comparisons. According to some embodiments, a “burst” of images may be captured, centered around the aforementioned temporal points of interest. Then, each burst sequence of images may be analyzed, e.g., by performing an image similarity comparison between each image in the burst sequence and the image selected at the previous temporal point of interest. Selecting the image from a given burst that is most similar to the previous selected image, while minimizing the amount of motion with the previous selected image, allows the system to improve the quality of the resultant time-lapse video by discarding “outlier” or other undesirable images captured in the burst sequence and motion stabilizing the selected image.
Abstract translation: 传统上，延时视频是从被称为“时间兴趣点”或“时间POI”的时间间隔捕获的图像构成的。这里公开了使用时间兴趣点构建改进的，运动稳定的延时视频的系统和方法， 图像相似性比较。 根据一些实施例，可以以上述时间兴趣点为中心捕获图像的“突发”。 然后，可以例如通过在突发序列中的每个图像和在先前的时间点选择的图像之间执行图像相似性比较来分析图像的每个突发序列。 选择与先前选择的图像最相似的给定脉冲串中的图像，同时使用先前选择的图像最小化运动量，允许系统通过丢弃“异常值”或其他信号来提高合成的延时视频的质量 在突发序列中捕获的不期望的图像和稳定所选择的图像的运动。
-
公开(公告)号：US20150348242A1
公开(公告)日：2015-12-03
申请号：US14502887
申请日：2014-09-30
Applicant: Apple Inc.
Inventor： Claus Molgaard , Marius Tico , Rolf Toft , Paul M. Hubel
CPC classification number: H04N5/23277 , G06T5/002 , G06T5/003 , G06T5/50 , G06T7/20 , G06T7/254 , G06T11/60 , G06T2207/10004 , G06T2207/10144 , G06T2207/20221 , H04N5/23229 , H04N5/23254 , H04N5/23267 , H04N5/2355 , H04N5/2356 , H04N5/35581 , H04N5/3597 , H04N5/91
Abstract: Techniques to capture and fuse short- and long-exposure images of a scene from a stabilized image capture device are disclosed. More particularly, the disclosed techniques use not only individual pixel differences between co-captured short- and long-exposure images, but also the spatial structure of occluded regions in the long-exposure images (e.g., areas of the long-exposure image(s) exhibiting blur due to scene object motion). A novel device used to represent this feature of the long-exposure image is a “spatial difference map.” Spatial difference maps may be used to identify pixels in the short- and long-exposure images for fusion and, in one embodiment, may be used to identify pixels from the short-exposure image(s) to filter post-fusion so as to reduce visual discontinuities in the output image.
Abstract translation: 公开了从稳定的图像捕获装置捕捉和融合场景的短曝光和长曝光图像的技术。 更具体地，所公开的技术不仅使用共同拍摄的短曝光图像和长曝光图像之间的单独像素差异，而且使用长曝光图像中的遮挡区域的空间结构（例如，长曝光图像的区域 ）呈现由于场景物体运动造成的模糊）。 用于表示长曝光图像的该特征的新型装置是“空间差异图”。空间差异图可以用于识别用于融合的短曝光图像和长曝光图像中的像素，并且在一个实施例中可以是 用于识别来自短曝光图像的像素以过滤融合后的图像，以减少输出图像中的视觉不连续性。
-
公开(公告)号：US20140267802A1
公开(公告)日：2014-09-18
申请号：US13909700
申请日：2013-06-04
Applicant: Apple Inc.
Inventor： Todd Sachs , Marius Tico , Rolf Toft , Paul Hubel , George Williams
CPC classification number: H04N5/23267 , H04N5/23254 , H04N5/23258 , H04N5/2356
Abstract: Techniques are disclosed for selectively capturing, retaining, and combining multiple sub-exposure images or brackets to yield a final image having diminished motion-induced blur and good noise characteristics. More specifically, after or during the capture of N brackets, the M best may be identified for combining into a single output image, (N>M). As used here, the term “best” means those brackets that exhibit the least amount of relative motion with respect to one another—with one caveat: integer pixel shifts may be preferred over sub-pixel shifts.
Abstract translation: 公开了用于选择性地捕获，保留和组合多个次曝光图像或括号以产生具有减小的运动引起的模糊和良好噪声特性的最终图像的技术。 更具体地说，在捕获N个括号之后或期间，可以识别M最佳以组合成单个输出图像（N> M）。 如这里所使用的，术语“最佳”是指相对于彼此表现出最小量的相对运动的括号 - 一个值得注意的是：整数像素偏移可能优于子像素位移。
-
Patent Agency Ranking
公开(公告)号：US10277820B2
公开(公告)日：2019-04-30
申请号：US16030632
申请日：2018-07-09
Applicant: Apple Inc.
Inventor： Claus Molgaard , Marius Tico , Rolf Toft , Paul M. Hubel
IPC: H04N5/232 , G06T5/00 , G06T11/60 , H04N5/91 , G06T5/50 , G06T7/20 , H04N5/235 , H04N5/355 , G06T7/254 , H04N5/359
Abstract: Techniques to capture and fuse short- and long-exposure images of a scene from a stabilized image capture device are disclosed. More particularly, the disclosed techniques use not only individual pixel differences between co-captured short- and long-exposure images, but also the spatial structure of occluded regions in the long-exposure images (e.g., areas of the long-exposure image(s) exhibiting blur due to scene object motion). A novel device used to represent this feature of the long-exposure image is a “spatial difference map.” Spatial difference maps may be used to identify pixels in the short-and long-exposure images for fusion and, in one embodiment, may be used to identify pixels from the short-exposure image(s) to filter post-fusion so as to reduce visual discontinuities in the output image.
-
公开(公告)号：US09843730B2
公开(公告)日：2017-12-12
申请号：US15587617
申请日：2017-05-05
Applicant: Apple Inc.
Inventor： Claus Molgaard , Marius Tico , Rolf Toft , Paul M. Hubel
CPC classification number: H04N5/23277 , G06T5/002 , G06T5/003 , G06T5/50 , G06T7/20 , G06T7/254 , G06T11/60 , G06T2207/10004 , G06T2207/10144 , G06T2207/20221 , H04N5/23229 , H04N5/23254 , H04N5/23267 , H04N5/2355 , H04N5/2356 , H04N5/35581 , H04N5/3597 , H04N5/91
Abstract: Techniques to capture and fuse short- and long-exposure images of a scene from a stabilized image capture device are disclosed. More particularly, the disclosed techniques use not only individual pixel differences between co-captured short- and long-exposure images, but also the spatial structure of occluded regions in the long-exposure images (e.g., areas of the long-exposure image(s) exhibiting blur due to scene object motion). A novel device used to represent this feature of the long-exposure image is a “spatial difference map.” Spatial difference maps may be used to identify pixels in the short- and long-exposure images for fusion and, in one embodiment, may be used to identify pixels from the short-exposure image(s) to filter post-fusion so as to reduce visual discontinuities in the output image.
-
公开(公告)号：US09681050B2
公开(公告)日：2017-06-13
申请号：US15154659
申请日：2016-05-13
Applicant: Apple Inc.
Inventor： Claus Molgaard , Marius Tico , Rolf Toft , Paul M. Hubel
IPC: H04N5/228 , H04N5/232 , G06T5/00 , G06T11/60 , H04N5/91 , G06T5/50 , G06T7/20 , H04N5/235 , H04N5/355 , G06T7/254
CPC classification number: H04N5/23277 , G06T5/002 , G06T5/003 , G06T5/50 , G06T7/20 , G06T7/254 , G06T11/60 , G06T2207/10004 , G06T2207/10144 , G06T2207/20221 , H04N5/23229 , H04N5/23254 , H04N5/23267 , H04N5/2355 , H04N5/2356 , H04N5/35581 , H04N5/3597 , H04N5/91
Abstract: Techniques to capture and fuse short- and long-exposure images of a scene from a stabilized image capture device are disclosed. More particularly, the disclosed techniques use not only individual pixel differences between co-captured short- and long-exposure images, but also the spatial structure of occluded regions in the long-exposure images (e.g., areas of the long-exposure image(s) exhibiting blur due to scene object motion). A novel device used to represent this feature of the long-exposure image is a “spatial difference map.” Spatial difference maps may be used to identify pixels in the short-and long-exposure images for fusion and, in one embodiment, may be used to identify pixels from the short-exposure image(s) to filter post-fusion so as to reduce visual discontinuities in the output image.
-
公开(公告)号：US09596411B2
公开(公告)日：2017-03-14
申请号：US14864709
申请日：2015-09-24
Applicant: Apple Inc.
Inventor： Damien J. Thivent , George E. Williams , Jianping Zhou , Richard L. Baer , Rolf Toft , Sebastien X. Beysserie
CPC classification number: H04N5/23287 , G06T5/20 , H04N5/2254 , H04N5/23254 , H04N5/23258 , H04N5/23267 , H04N5/2328
Abstract: Techniques to improve a digital image capture device's ability to stabilize a video stream are presented. According to some embodiments, improved stabilization of captured video frames is provided by intelligently harnessing the complementary effects of both optical image stabilization (OIS) and electronic image stabilization (EIS). In particular, OIS may be used to remove intra-frame motion blur that is typically lower in amplitude and dominates with longer integration times, while EIS may be used to remove residual unwanted frame-to-frame motion that is typically larger in amplitude. The techniques disclosed herein may also leverage information provided from the image capture device's OIS system to perform improved motion blur-aware video stabilization strength modulation, which permits better video stabilization performance in low light conditions, where integration times tend to be longer, thus leading to a greater amount of motion blurring in the output stabilized video.
Abstract translation: 介绍了提高数字图像采集设备稳定视频流能力的技术。 根据一些实施例，通过智能地利用光学图像稳定（OIS）和电子图像稳定（EIS）的补充效果来提供捕获的视频帧的改进的稳定性。 特别地，OIS可以用于去除通常在幅度上较低的帧内运动模糊并且以更长的积分时间为主，而EIS可用于去除通常较大振幅的残留的不希望的帧到帧运动。 本文公开的技术还可以利用从图像捕获设备的OIS系统提供的信息来执行改进的运动模糊感知视频稳定强度调制，其允许在低光条件下更好的视频稳定性能，其中集成时间趋于更长，从而导致 输出稳定视频中的运动模糊量更大。
-
公开(公告)号：US20160360111A1
公开(公告)日：2016-12-08
申请号：US14864709
申请日：2015-09-24
Applicant: Apple Inc.
Inventor： Damien J. Thivent , George E. Williams , Jianping Zhou , Richard L. Baer , Rolf Toft , Sebastien X. Beysserie
CPC classification number: H04N5/23287 , G06T5/20 , H04N5/2254 , H04N5/23254 , H04N5/23258 , H04N5/23267 , H04N5/2328
Abstract: Techniques to improve a digital image capture device's ability to stabilize a video stream are presented. According to some embodiments, improved stabilization of captured video frames is provided by intelligently harnessing the complementary effects of both optical image stabilization (OIS) and electronic image stabilization (EIS). In particular, OIS may be used to remove intra-frame motion blur that is typically lower in amplitude and dominates with longer integration times, while EIS may be used to remove residual unwanted frame-to-frame motion that is typically larger in amplitude. The techniques disclosed herein may also leverage information provided from the image capture device's OIS system to perform improved motion blur-aware video stabilization strength modulation, which permits better video stabilization performance in low light conditions, where integration times tend to be longer, thus leading to a greater amount of motion blurring in the output stabilized video.
Abstract translation: 介绍了提高数字图像采集设备稳定视频流能力的技术。 根据一些实施例，通过智能地利用光学图像稳定（OIS）和电子图像稳定（EIS）的补充效果来提供捕获的视频帧的改进的稳定性。 特别地，OIS可以用于去除通常在幅度上较低的帧内运动模糊并且以更长的积分时间为主，而EIS可用于去除通常较大振幅的残留的不希望的帧到帧运动。 本文公开的技术还可以利用从图像捕获设备的OIS系统提供的信息来执行改进的运动模糊感知视频稳定强度调制，其允许在低光条件下更好的视频稳定性能，其中集成时间趋于更长，从而导致 输出稳定视频中的运动模糊量更大。
-
-
-
-
-
-
-
-
-
Search Results
32
records
(took 0.039 seconds)
