Saliency of an object for image processing operations

    公开(公告)号:US11308345B2

    公开(公告)日:2022-04-19

    申请号:US16848315

    申请日:2020-04-14

    Applicant: Apple Inc.

    Abstract: Various methods for utilizing a saliency heatmaps are described. The methods include obtaining image data corresponding to an image of a scene, obtaining a saliency heatmap for the image of the scene based on a saliency network, wherein the saliency heatmap indicates a likelihood of saliency for a corresponding portion of the scene, and manipulating the image data based on the saliency heatmap. In embodiments, the saliency heatmap may be produced using a trained machine learning model. The saliency heatmap may be used for various image processing tasks, such as determining which portion(s) of a scene to base an image capture device's autofocus, auto exposure, and/or white balance operations upon. According to some embodiments, one or more bounding boxes may be generated based on the saliency heatmap, e.g., using an optimization operation, which bounding box(es) may be used to assist or enhance the performance of various image processing tasks.

    Saliency of an Object for Image Processing Operations

    公开(公告)号:US20200380289A1

    公开(公告)日:2020-12-03

    申请号:US16848315

    申请日:2020-04-14

    Applicant: Apple Inc.

    Abstract: Various methods for utilizing a saliency heatmaps are described. The methods include obtaining image data corresponding to an image of a scene, obtaining a saliency heatmap for the image of the scene based on a saliency network, wherein the saliency heatmap indicates a likelihood of saliency for a corresponding portion of the scene, and manipulating the image data based on the saliency heatmap. In embodiments, the saliency heatmap may be produced using a trained machine learning model. The saliency heatmap may be used for various image processing tasks, such as determining which portion(s) of a scene to base an image capture device's autofocus, auto exposure, and/or white balance operations upon. According to some embodiments, one or more bounding boxes may be generated based on the saliency heatmap, e.g., using an optimization operation, which bounding box(es) may be used to assist or enhance the performance of various image processing tasks.

    Saliency of an Object for Image Processing Operations

    公开(公告)号:US20220237887A1

    公开(公告)日:2022-07-28

    申请号:US17659377

    申请日:2022-04-15

    Applicant: Apple Inc.

    Abstract: Various methods for utilizing a saliency heatmaps are described. The methods include obtaining image data corresponding to an image of a scene, obtaining a saliency heatmap for the image of the scene based on a saliency network, wherein the saliency heatmap indicates a likelihood of saliency for a corresponding portion of the scene, and manipulating the image data based on the saliency heatmap. In embodiments, the saliency heatmap may be produced using a trained machine learning model. The saliency heatmap may be used for various image processing tasks, such as determining which portion(s) of a scene to base an image capture device's autofocus, auto exposure, and/or white balance operations upon. According to some embodiments, one or more bounding boxes may be generated based on the saliency heatmap, e.g., using an optimization operation, which bounding box(es) may be used to assist or enhance the performance of various image processing tasks.

    Smart Cropping of Images
    5.
    发明申请

    公开(公告)号:US20210398333A1

    公开(公告)日:2021-12-23

    申请号:US16906722

    申请日:2020-06-19

    Applicant: Apple Inc.

    Abstract: Devices, methods, and non-transitory program storage devices are disclosed to provide for automatic cropping of images, given a requested target dimensions and/or aspect ratio, e.g., by using saliency maps to identify the parts of the image containing the most important content—and ensuring that such content is, if possible, included in a determined cropped region from the image. In particular, the devices, methods, and non-transitory program storage devices disclosed herein may: define a first region of interest (ROI) in a given image that is most essential to include in an automatically-determined cropped region; define a second ROI in the given image that would be preferable to include in the automatically-determined cropped region; and then determine a cropped region from the given image, based on the requested target dimensions and/or aspect ratio, that attempts to maximize an amount of overlap between the determined cropped region and the first and/or second ROIs.

    Saliency of an object for image processing operations

    公开(公告)号:US11663806B2

    公开(公告)日:2023-05-30

    申请号:US17659377

    申请日:2022-04-15

    Applicant: Apple Inc.

    CPC classification number: G06V10/255 G06F18/214 G06V10/462 G06V20/64

    Abstract: Various methods for utilizing a saliency heatmaps are described. The methods include obtaining image data corresponding to an image of a scene, obtaining a saliency heatmap for the image of the scene based on a saliency network, wherein the saliency heatmap indicates a likelihood of saliency for a corresponding portion of the scene, and manipulating the image data based on the saliency heatmap. In embodiments, the saliency heatmap may be produced using a trained machine learning model. The saliency heatmap may be used for various image processing tasks, such as determining which portion(s) of a scene to base an image capture device's autofocus, auto exposure, and/or white balance operations upon. According to some embodiments, one or more bounding boxes may be generated based on the saliency heatmap, e.g., using an optimization operation, which bounding box(es) may be used to assist or enhance the performance of various image processing tasks.

Patent Agency Ranking