Highlight recovery techniques for shallow depth of field rendering

    公开(公告)号:US10992845B1

    公开(公告)日:2021-04-27

    申请号:US16565965

    申请日:2019-09-10

    Applicant: Apple Inc.

    Abstract: This disclosure relates to techniques for synthesizing out of focus blurring effects in digital images. Cameras having wide aperture lenses typically capture images with a shallow depth of field (SDOF). SDOF cameras are often used in portrait photography, since they emphasize subjects, while deemphasizing the background via blurring. Simulating this kind of blurring using a large depth of field (LDOF) camera may require a large amount of computational resources, i.e., to simulate the physical effects of using a wide aperture lens, while constructing a synthetic SDOF image. Moreover, cameras having smaller lens apertures, such as those in mobile phones, may not have the ability to accurately estimate or recreate the true color of clipped background light sources. Described herein are techniques to synthesize out of focus background blurring effects that attempt to reproduce accurate light intensity and color values for clipped background light sources in images captured by LDOF cameras.

    Gesture mapping for image filter input parameters
    2.
    发明授权
    Gesture mapping for image filter input parameters 有权
    图像滤波器输入参数的手势映射

    公开(公告)号:US09531947B2

    公开(公告)日:2016-12-27

    申请号:US14268041

    申请日:2014-05-02

    Applicant: Apple Inc.

    Abstract: This disclosure pertains to systems, methods, and computer readable medium for mapping particular user interactions, e.g., gestures, to the input parameters of various image processing routines, e.g., image filters, in a way that provides a seamless, dynamic, and intuitive experience for both the user and the software developer. Such techniques may handle the processing of both “relative” gestures, i.e., those gestures having values dependent on how much an input to the device has changed relative to a previous value of the input, and “absolute” gestures, i.e., those gestures having values dependent only on the instant value of the input to the device. Additionally, inputs to the device beyond user-input gestures may be utilized as input parameters to one or more image processing routines. For example, the device's orientation, acceleration, and/or position in three-dimensional space may be used as inputs to particular image processing routines.

    Abstract translation: 本公开涉及用于将特定用户交互(例如,手势)映射到各种图像处理例程的输入参数(例如,图像过滤器)的系统,方法和计算机可读介质,以提供无缝,动态和直观的体验 用于用户和软件开发人员。 这样的技术可以处理“相对”手势的处理,即,具有取决于设备的输入相对于输入的先前值有多少变化的值的手势以及具有“绝对”手势的手势 值仅依赖于设备输入的即时值。 此外,超出用户输入手势的设备的输入可以用作一个或多个图像处理例程的输入参数。 例如,设备在三维空间中的取向,加速度和/或位置可以用作特定图像处理例程的输入。

    Gesture Mapping For Image Filter Input Parameters

    公开(公告)号:US20200379634A1

    公开(公告)日:2020-12-03

    申请号:US16998590

    申请日:2020-08-20

    Applicant: Apple Inc.

    Abstract: This disclosure pertains to systems, methods, and computer readable medium for mapping particular user interactions, e.g., gestures, to the input parameters of various image processing routines, e.g., image filters, in a way that provides a seamless, dynamic, and intuitive experience for both the user and the software developer. Such techniques may handle the processing of both “relative” gestures, i.e., those gestures having values dependent on how much an input to the device has changed relative to a previous value of the input, and “absolute” gestures, i.e., those gestures having values dependent only on the instant value of the input to the device. Additionally, inputs to the device beyond user-input gestures may be utilized as input parameters to one or more image processing routines. For example, the device's orientation, acceleration, and/or position in three-dimensional space may be used as inputs to particular image processing routines.

    Robust Use of Semantic Segmentation in Shallow Depth of Field Rendering

    公开(公告)号:US20200082535A1

    公开(公告)日:2020-03-12

    申请号:US16566155

    申请日:2019-09-10

    Applicant: Apple Inc.

    Abstract: This disclosure relates to techniques for the robust usage of semantic segmentation information in image processing techniques, e.g., shallow depth of field (SDOF) renderings. Semantic segmentation may be defined as a process of creating a mask over an image, wherein pixels are segmented into a predefined set of semantic classes. Segmentations may be binary (e.g., a ‘person pixel’ or a ‘non-person pixel’) or multi-class (e.g., a pixel may be labelled as: ‘person,’ ‘dog,’ ‘cat,’ etc.). As semantic segmentation techniques grow in accuracy and adoption, it is becoming increasingly important to develop methods of utilizing such segmentations and developing flexible techniques for integrating segmentation information into existing computer vision applications, such as synthetic SDOF renderings, to yield improved results in a wide range of image capture scenarios. In some embodiments, a refinement operation may be employed on a camera device's initial depth, disparity and/or blur estimates that leverages semantic segmentation information.

    Disabling Access Point Notifications
    5.
    发明申请
    Disabling Access Point Notifications 审中-公开
    禁用接入点通知

    公开(公告)号:US20160219555A1

    公开(公告)日:2016-07-28

    申请号:US15003065

    申请日:2016-01-21

    Applicant: Apple Inc.

    Inventor: Alexandre Naaman

    CPC classification number: H04W68/02 H04W4/027 H04W48/08 H04W48/14

    Abstract: Disabling wireless access point notifications is described. In some implementations, wireless access point notifications on a mobile device can be disabled when movement of the mobile device is detected. In some implementations, wireless access point notifications on a mobile device can be re-enabled when the mobile device detects that the mobile device has been stationary for a specified period of time following movement of the mobile device. In some implementations, wireless access point notifications can be disabled on a per access point basis.

    Abstract translation: 描述禁用无线接入点通知。 在一些实施方式中,当检测到移动设备的移动时,可以禁用移动设备上的无线接入点通知。 在一些实施方式中,当移动设备检测到移动设备在移动设备移动之后指定的时间段内已经静止时,可以重新启用移动设备上的无线接入点通知。 在一些实现中,可以在每个接入点的基础上禁用无线接入点通知。

    Disabling access point notifications
    6.
    发明授权
    Disabling access point notifications 有权
    禁用接入点通知

    公开(公告)号:US09247393B2

    公开(公告)日:2016-01-26

    申请号:US14182099

    申请日:2014-02-17

    Applicant: Apple Inc.

    Inventor: Alexandre Naaman

    CPC classification number: H04W68/02 H04W4/027 H04W48/08 H04W48/14

    Abstract: Disabling wireless access point notifications is described. In some implementations, wireless access point notifications on a mobile device can be disabled when movement of the mobile device is detected. In some implementations, wireless access point notifications on a mobile device can be re-enabled when the mobile device detects that the mobile device has been stationary for a specified period of time following movement of the mobile device. In some implementations, wireless access point notifications can be disabled on a per access point basis.

    Abstract translation: 描述禁用无线接入点通知。 在一些实施方式中,当检测到移动设备的移动时,可以禁用移动设备上的无线接入点通知。 在一些实施方式中,当移动设备检测到移动设备在移动设备移动之后指定的时间段内已经静止时,可以重新启用移动设备上的无线接入点通知。 在一些实现中,可以在每个接入点的基础上禁用无线接入点通知。

    GESTURE MAPPING FOR IMAGE FILTER INPUT PARAMETERS

    公开(公告)号:US20170083218A1

    公开(公告)日:2017-03-23

    申请号:US15366469

    申请日:2016-12-01

    Applicant: Apple Inc.

    Abstract: This disclosure pertains to systems, methods, and computer readable medium for mapping particular user interactions, e.g., gestures, to the input parameters of various image processing routines, e.g., image filters, in a way that provides a seamless, dynamic, and intuitive experience for both the user and the software developer. Such techniques may handle the processing of both “relative” gestures, i.e., those gestures having values dependent on how much an input to the device has changed relative to a previous value of the input, and “absolute” gestures, i.e., those gestures having values dependent only on the instant value of the input to the device. Additionally, inputs to the device beyond user-input gestures may be utilized as input parameters to one or more image processing routines. For example, the device's orientation, acceleration, and/or position in three-dimensional space may be used as inputs to particular image processing routines.

    Automatic Determination of a Region of Influence
    8.
    发明申请
    Automatic Determination of a Region of Influence 审中-公开
    自动确定影响区域

    公开(公告)号:US20160358309A1

    公开(公告)日:2016-12-08

    申请号:US15173002

    申请日:2016-06-03

    Applicant: Apple Inc.

    Abstract: Embodiments are directed toward systems and methods segment an input image for performance of a warp kernel that executes by a graphics processing unit (GPU) the warp kernel on an array of dummy data, wherein cells of the array are populated with data representing the cells' respective locations within the array, determine, from an output array obtained from execution of the warp kernel on the dummy data, a segmentation size, and build by the GPU an output image from the input image by executing the warp kernel on the input image according to the segmentation size.

    Abstract translation: 实施例针对系统和方法来分割输入图像,以执行由图形处理单元(GPU)在虚拟数据阵列上执行经线核的warp内核,其中阵列的单元用表示单元格的数据填充, 在阵列内的各个位置,根据虚拟数据上的经线核心执行获得的输出数组,确定分割大小,并由GPU根据输入图像执行输出图像的输出图像,由输入图像构建输出图像, 到分割大小。

    GESTURE MAPPING FOR IMAGE FILTER INPUT PARAMETERS
    9.
    发明申请
    GESTURE MAPPING FOR IMAGE FILTER INPUT PARAMETERS 审中-公开
    图像滤波器输入参数的映射映射

    公开(公告)号:US20140240539A1

    公开(公告)日:2014-08-28

    申请号:US14268041

    申请日:2014-05-02

    Applicant: Apple Inc.

    Abstract: This disclosure pertains to systems, methods, and computer readable medium for mapping particular user interactions, e.g., gestures, to the input parameters of various image processing routines, e.g., image filters, in a way that provides a seamless, dynamic, and intuitive experience for both the user and the software developer. Such techniques may handle the processing of both “relative” gestures, i.e., those gestures having values dependent on how much an input to the device has changed relative to a previous value of the input, and “absolute” gestures, i.e., those gestures having values dependent only on the instant value of the input to the device. Additionally, inputs to the device beyond user-input gestures may be utilized as input parameters to one or more image processing routines. For example, the device's orientation, acceleration, and/or position in three-dimensional space may be used as inputs to particular image processing routines.

    Abstract translation: 本公开涉及用于将特定用户交互(例如,手势)映射到各种图像处理例程的输入参数(例如,图像过滤器)的系统,方法和计算机可读介质,以提供无缝,动态和直观的体验 用于用户和软件开发人员。 这样的技术可以处理“相对”手势的处理,即,具有取决于设备的输入相对于输入的先前值有多少变化的值的手势以及具有“绝对”手势的手势 值仅依赖于设备输入的即时值。 此外,超出用户输入手势的设备的输入可以用作一个或多个图像处理例程的输入参数。 例如,设备在三维空间中的取向,加速度和/或位置可以用作特定图像处理例程的输入。

    Disabling Access Point Notifications
    10.
    发明申请
    Disabling Access Point Notifications 审中-公开
    禁用接入点通知

    公开(公告)号:US20140162699A1

    公开(公告)日:2014-06-12

    申请号:US14182099

    申请日:2014-02-17

    Applicant: Apple Inc.

    Inventor: Alexandre Naaman

    CPC classification number: H04W68/02 H04W4/027 H04W48/08 H04W48/14

    Abstract: Disabling wireless access point notifications is described. In some implementations, wireless access point notifications on a mobile device can be disabled when movement of the mobile device is detected. In some implementations, wireless access point notifications on a mobile device can be re-enabled when the mobile device detects that the mobile device has been stationary for a specified period of time following movement of the mobile device. In some implementations, wireless access point notifications can be disabled on a per access point basis.

    Abstract translation: 描述禁用无线接入点通知。 在一些实施方式中,当检测到移动设备的移动时,可以禁用移动设备上的无线接入点通知。 在一些实施方式中,当移动设备检测到移动设备在移动设备移动之后指定的时间段内已经静止时,可以重新启用移动设备上的无线接入点通知。 在一些实现中,可以在每个接入点的基础上禁用无线接入点通知。

Patent Agency Ranking