-
公开(公告)号:US11488374B1
公开(公告)日:2022-11-01
申请号:US16578825
申请日:2019-09-23
申请人: Apple Inc.
发明人: Wei Sun , Jun Hu , Marius Tico , Xuemei Zhang
摘要: The disclosure pertains to techniques for image processing. One such technique comprises a method for image selection, comprising obtaining a sequence of images, detecting one or more objects in one or more images of the sequence of images, determining a location for each detected object in the one or more images, determining a trajectory for each detected object based on a determined location for each respective detected object in two or more images of the sequence of images, determining a trajectory waypoint score for the trajectory of each detected object, determining a set of selected images based on an aggregation of trajectory waypoint scores for each detected object in each respective image, and outputting the set of selected images for presentation.
-
公开(公告)号:US20170358094A1
公开(公告)日:2017-12-14
申请号:US15620131
申请日:2017-06-12
申请人: Apple Inc.
发明人: Wei Sun , Jun Hu , Tongbo Chen
CPC分类号: G06T7/194 , G06T7/11 , G06T7/174 , G06T2207/10148 , G06T2207/20028
摘要: Adaptive focus sweep (AFS) techniques for image processing are described. For one technique, an AFS logic/module can obtain an AFS representing a scene, where the AFS is a sequence of images representing the scene that includes: (i) a first image representing the scene captured at a first focus position; and (ii) a second image representing the scene captured at a second focus position that differs from the first focus position. The first focus position can be associated with a first depth of field (DOField) that is determined based on an autofocus technique. The second focus position can be associated with a second DOField, where the second focus position is at least two DOFields away from the first focus position. The AFS logic/module can detect a foreground of the scene in the first image based on information acquired from the first and second images. Other embodiments are described.
-
公开(公告)号:US09262684B2
公开(公告)日:2016-02-16
申请号:US13911740
申请日:2013-06-06
申请人: Apple Inc.
发明人: Marius Tico , Jianping Zhou , Anita Nariani Schulze , Rolf Toft , Paul Hubel , Wei Sun
CPC分类号: G06K9/46 , G06K9/6201 , G06T5/003 , G06T5/10 , G06T2207/10016 , G06T2207/10144 , G06T2207/20016 , G06T2207/20201 , G06T2207/20208 , G06T2207/20221 , H04N5/23267
摘要: Systems, methods, and computer readable media to improve image stabilization operations are described. Novel approaches for fusing non-reference images with a pre-selected reference frame in a set of commonly captured images are disclosed. The fusing approach may use a soft transition by using a weighted average for ghost/non-ghost pixels to avoid sudden transition between neighborhood and almost similar pixels. Additionally, the ghost/non-ghost decision can be made based on a set of neighboring pixels rather than independently for each pixel. An alternative approach may involve performing a multi-resolution decomposition of all the captured images, using temporal fusion, spatio-temporal fusion, or combinations thereof, at each level and combining the different levels to generate an output image.
摘要翻译: 描述了用于改善图像稳定操作的系统,方法和计算机可读介质。 公开了一组用于将非参考图像与一组普通捕获图像中的预选参考帧融合的新方法。 融合方法可以通过使用重影/非重像素的加权平均值来使用软转换,以避免邻域和几乎相似像素之间的突然过渡。 此外,可以基于一组相邻像素而不是针对每个像素独立地进行重影/非重影决定。 替代方法可以包括在每个级别上使用时间融合,时空融合或其组合执行所有捕获图像的多分辨率分解,并组合不同的级别以生成输出图像。
-
公开(公告)号:US10897558B1
公开(公告)日:2021-01-19
申请号:US16566017
申请日:2019-09-10
申请人: Apple Inc.
发明人: Wei Sun , Philip G. Lee , Gregory Guyomarc'h , Frederic Cao
摘要: This disclosure relates to the lightweight and efficient synthesis of shallow depth of field (SDOF) renderings. According to some embodiments, coarse focus information and semantic segmentation information may be leveraged to generate SDOF renderings in a “live preview” or “streaming” mode. Semantic segmentation may be defined as a process of creating a mask over an image, wherein pixels are segmented into a predefined set of semantic classes. Segmentations may include as many classes as are desired by a given implementation (e.g., a ‘foreground’ class and a ‘background’ class). In some embodiments, the rendering of synthetic SDOF images according to the techniques described herein may be completed using only a single camera of a device and without the use of dedicated depth-sensing technology (e.g., structured light cameras, stereo cameras, time-of-flight cameras, etc.), thereby allowing the SDOF rendering process to operate in a fashion that is not unduly time-, processing-, and/or power-intensive.
-
公开(公告)号:US20140363087A1
公开(公告)日:2014-12-11
申请号:US13911740
申请日:2013-06-06
申请人: Apple Inc.
发明人: Marius Tico , Jianping Zhou , Anita Nariani Schulze , Rolf Toft , Paul Hubel , Wei Sun
CPC分类号: G06K9/46 , G06K9/6201 , G06T5/003 , G06T5/10 , G06T2207/10016 , G06T2207/10144 , G06T2207/20016 , G06T2207/20201 , G06T2207/20208 , G06T2207/20221 , H04N5/23267
摘要: Systems, methods, and computer readable media to improve image stabilization operations are described. Novel approaches for fusing non-reference images with a pre-selected reference frame in a set of commonly captured images are disclosed. The fusing approach may use a soft transition by using a weighted average for ghost/non-ghost pixels to avoid sudden transition between neighborhood and almost similar pixels. Additionally, the ghost/non-ghost decision can be made based on a set of neighboring pixels rather than independently for each pixel. An alternative approach may involve performing a multi-resolution decomposition of all the captured images, using temporal fusion, spatio-temporal fusion, or combinations thereof, at each level and combining the different levels to generate an output image.
摘要翻译: 描述了用于改善图像稳定操作的系统,方法和计算机可读介质。 公开了一组用于将非参考图像与一组普通捕获图像中的预选参考帧融合的新方法。 融合方法可以通过使用重影/非重像素的加权平均值来使用软转换,以避免邻域和几乎相似像素之间的突然过渡。 此外,可以基于一组相邻像素而不是针对每个像素独立地进行重影/非重影决定。 替代方法可以包括在每个级别上使用时间融合,时空融合或其组合执行所有捕获图像的多分辨率分解,并组合不同的级别以生成输出图像。
-
-
-
-