公开(公告)号：US11935285B1

公开(公告)日：2024-03-19

申请号：US15995909

申请日：2018-06-01

Applicant: Apple Inc.

Inventor： Frederic Cao ,  Philip G. Lee

IPC: G06V20/10 ,  G06T5/20 ,  G06T5/50 ,  G06T5/00

CPC classification number: G06V20/10 ,  G06T5/20 ,  G06T5/50 ,  G06T5/73 ,  G06T5/92 ,  G06T2207/10024 ,  G06T2207/20201 ,  G06T2207/20208

Abstract: This disclosure relates to techniques for synthesizing out of focus highlighting effects in images in real-time. Digital single-lens reflex (DSLR) cameras and other cameras having wide aperture lenses typically capture images with a shallow depth of field (SDOF). So-called SDOF photography may be particularly fit for portrait photography, since it nicely emphasizes the subject, while essentially deemphasizing the background via blurring. Simulating this kind of blurring, particularly around background light sources, using a comparatively larger depth of field (LDOF) camera, may require a high dynamic range (HDR) image capture system, to accurately determine the color of background light sources, which are prone to saturation. However, small form-factor cameras having smaller lens apertures may not have the bandwidth or processing power to process full HDR images in real time. Thus, described herein are techniques to synthesize color accurate, out-of-focus background highlight regions in real-time for images captured by LDOF cameras.

公开(公告)号：US11100620B2

公开(公告)日：2021-08-24

申请号：US16121389

申请日：2018-09-04

Applicant: Apple Inc.

Inventor： Touraj Tajbakhsh ,  Chihsin Wu ,  Frederic Cao

IPC: G06T5/00 ,  H04N9/64 ,  G06T7/90

Abstract: Embodiments relate to hue preservation post processing for highlight recovery of an input image. Intensity values for multiple color channels of a plurality of color channels of a pixel of the input image is determined using corresponding ratios of target hues for the plurality of color channels of the pixel, wherein the pixel has at least one color channel with an intensity above a predetermined threshold. A hue preserved value for a color channel of the plurality of color channels of the pixel is determined using intensity values determined for the plurality of color channels of the pixel and the target hues. A recovered version of the input image is generated by adjusting hue information of the pixel, using the hue preserved value for the channel of the plurality of color channels of the pixel.

公开(公告)号：US10762692B2

公开(公告)日：2020-09-01

申请号：US16563335

申请日：2019-09-06

Applicant: Apple Inc.

Inventor： Yury Degtyarev ,  Frederic Cao ,  Garrett M. Johnson

IPC: G06T15/50 ,  G06T15/04 ,  G06T17/20 ,  G06T5/00 ,  G06F3/0482

Abstract: Embodiments of the present disclosure can provide systems, methods, and computer-readable medium for providing virtual lighting adjustments to image data. A number of source images may be generated to individually depict solid colors of a color space (e.g., RGB color space). Virtual lighting adjustments associated with a virtual lighting mode may be applied to each source image to generate a corresponding target image. The source images and the target images may be utilized to train a model to identify pixel modifications to be applied to image data. The modifications may be associated with a virtual lighting mode. Subsequently, a user may obtain image data (e.g., an image or video) select a virtual lighting mode via an image data processing application. The previously trained model may be utilized to modify the image to apply the virtual lighting effects associated with the selected virtual lighting mode.

公开(公告)号：US10528243B2

公开(公告)日：2020-01-07

申请号：US15728147

申请日：2017-10-09

Applicant: Apple Inc.

Inventor： Behkish J. Manzari ,  Marek Bereza ,  Jeffrey A. Brasket ,  Frederic Cao ,  Alan C. Dye ,  Elliott Harris ,  Cyrus Daniel Irani ,  Jonathan P. Ive ,  Garrett Johnson ,  Emilie Kim ,  Joseph A. Malia ,  Grant Paul ,  Pavel Pivonka ,  Billy Sorrentino, III ,  Andre Souza Dos Santos

IPC: G06F3/0484 ,  H04N5/232 ,  G06F3/0488 ,  H04N5/247 ,  G06F3/0482 ,  G06F3/0481

Abstract: The present disclosure generally relates to user interfaces. In some examples, the electronic device provides for transitioning between simulated lighting effects. In some examples, the electronic device applies a simulated lighting effect to an image. In some examples, the electronic device provides user interfaces for applying a filter to an image. In some examples, the electronic device provides for a reduced filter interface. In some examples, the electronic device provides a visual aid displayed in a viewfinder.

公开(公告)号：US11204692B2

公开(公告)日：2021-12-21

申请号：US16733718

申请日：2020-01-03

Applicant: Apple Inc.

Inventor： Behkish J. Manzari ,  Marek Bereza ,  Jeffrey A. Brasket ,  Frederic Cao ,  Alan C. Dye ,  Elliott Harris ,  Cyrus Daniel Irani ,  Jonathan P. Ive ,  Garrett Johnson ,  Emilie Kim ,  Joseph A. Malia ,  Grant Paul ,  Pavel Pivonka ,  Billy Sorrentino, III ,  Andre Souza Dos Santos

IPC: H04N5/232 ,  G06F3/0484 ,  G06F3/0488 ,  H04N5/247 ,  G06F3/0482 ,  G06F3/0481

Abstract: The present disclosure generally relates to user interfaces. In some examples, the electronic device provides for transitioning between simulated lighting effects. In some examples, the electronic device applies a simulated lighting effect to an image. In some examples, the electronic device provides user interfaces for applying a filter to an image. In some examples, the electronic device provides for a reduced filter interface. In some examples, the electronic device provides a visual aid displayed in a viewfinder.

公开(公告)号：US20210342989A1

公开(公告)日：2021-11-04

申请号：US17373362

申请日：2021-07-12

Applicant: Apple Inc.

Inventor： Touraj Tajbakhsh ,  Chihsin Wu ,  Frederic Cao

IPC: G06T5/00 ,  H04N9/64 ,  G06T7/90

Abstract: Embodiments relate to hue preservation post processing for highlight recovery of an input image. Intensity values for multiple color channels of a plurality of color channels of a pixel of the input image is determined using corresponding ratios of target hues for the plurality of color channels of the pixel, wherein the pixel has at least one color channel with an intensity above a predetermined threshold. A hue preserved value for a color channel of the plurality of color channels of the pixel is determined using intensity values determined for the plurality of color channels of the pixel and the target hues. A recovered version of the input image is generated by adjusting hue information of the pixel, using the hue preserved value for the channel of the plurality of color channels of the pixel.

公开(公告)号：US20200082607A1

公开(公告)日：2020-03-12

申请号：US16563335

申请日：2019-09-06

Applicant: Apple Inc.

Inventor： Yury Degtyarev ,  Frederic Cao ,  Garrett M. Johnson

IPC: G06T15/50 ,  G06T15/04 ,  G06T17/20 ,  G06T5/00

Abstract: Embodiments of the present disclosure can provide systems, methods, and computer-readable medium for providing virtual lighting adjustments to image data. A number of source images may be generated to individually depict solid colors of a color space (e.g., RGB color space). Virtual lighting adjustments associated with a virtual lighting mode may be applied to each source image to generate a corresponding target image. The source images and the target images may be utilized to train a model to identify pixel modifications to be applied to image data. The modifications may be associated with a virtual lighting mode. Subsequently, a user may obtain image data (e.g., an image or video) select a virtual lighting mode via an image data processing application. The previously trained model may be utilized to modify the image to apply the virtual lighting effects associated with the selected virtual lighting mode.

公开(公告)号：US20200074601A1

公开(公告)日：2020-03-05

申请号：US16121389

申请日：2018-09-04

Applicant: Apple Inc.

Inventor： Touraj Tajbakhsh ,  Chihsin Wu ,  Frederic Cao

IPC: G06T5/00 ,  H04N9/64 ,  G06T7/90

Abstract: Embodiments relate to hue preservation post processing for highlight recovery of an input image. Intensity values for multiple color channels of a plurality of color channels of a pixel of the input image is determined using corresponding ratios of target hues for the plurality of color channels of the pixel, wherein the pixel has at least one color channel with an intensity above a predetermined threshold. A hue preserved value for a color channel of the plurality of color channels of the pixel is determined using intensity values determined for the plurality of color channels of the pixel and the target hues. A recovered version of the input image is generated by adjusting hue information of the pixel, using the hue preserved value for the channel of the plurality of color channels of the pixel.

公开(公告)号：US20190080508A1

公开(公告)日：2019-03-14

申请号：US16032418

申请日：2018-07-11

Applicant: Apple Inc.

Inventor： Garrett Johnson ,  Chong Chen ,  Frederic Cao

IPC: G06T15/50 ,  G06T5/00 ,  G06T5/20 ,  G06K9/00

Abstract: Embodiments of the present disclosure can provide systems, methods, and computer-readable medium for providing virtual lighting adjustments to image data. A user interface for presenting and/or modifying image data may be provided via an electronic device. User input may be received that indicates a selection of a virtual lighting mode. Landmark points corresponding to a set of pixels of the image data may be identified based, at least in part, on depth measurement values of the set of pixels. One or more masks may be generated from the landmark points. One or more virtual lighting adjustments associated with the selected virtual lighting mode may be made to the image data using these masks (or the landmark points and an implied geometry of the landmark points). The adjusted/modified image may be presented to the user via the user interface at the electronic device.