-
公开(公告)号:US20220398779A1
公开(公告)日:2022-12-15
申请号:US17805056
申请日:2022-06-02
Applicant: Apple Inc.
Inventor: Miguel Angel Lopez Alvarez , Yonghui Zhao
Abstract: Devices, methods, and non-transitory program storage devices (NPSDs) are disclosed to compensate for the predicted color changes experienced by camera modules after certain amounts of time of real world use. Such color changes may be caused by prolonged exposure of optical components of the camera module to one or more of: solar radiation, high temperature conditions, or high humidity conditions, each of which may, over time, induce deviation in the color response of optical components of the camera module. The techniques disclosed herein may first characterize such predicted optical change to components over time based on particular environmental conditions, and then implement one or more time-varying color models to compensate for predicted changes to the camera module's color calibration values due to the characterized optical change. In some embodiments, optical changes in other types of components, e.g., display devices, caused by prolonged environmental stresses may also be modeled and compensated.
-
公开(公告)号:US20240357069A1
公开(公告)日:2024-10-24
申请号:US18583722
申请日:2024-02-21
Applicant: Apple Inc.
Inventor: Renbo Cao , Yonghui Zhao , Christian I Moore
IPC: H04N13/324 , G02B27/01 , H04N13/344 , H04N23/745
CPC classification number: H04N13/324 , G02B27/0172 , H04N13/344 , H04N23/745 , G02B2027/0134 , G02B2027/0138
Abstract: A head-mounted device is provided that includes one or more image sensors configured to capture a video feed, one or more motion sensors configured to detect motion, and control circuitry configured to analyze a lighting condition of the captured video feed and to perform auto white balancing operations on the captured video feed. An update frequency or a color adaptation speed of the auto white balancing operations can be determined based on the lighting condition and the detected motion. The color adaptation speed of the auto white balancing operations can be adjusted only in response to detecting, using the one or more motion sensors, an amount of motion exceeding a threshold.
-
公开(公告)号:US11935322B1
公开(公告)日:2024-03-19
申请号:US17369416
申请日:2021-07-07
Applicant: Apple Inc.
Inventor: Renbo Cao , Christophe Seyve , Yonghui Zhao
IPC: G06V40/16 , G06V10/20 , G06V10/26 , G06V10/766
CPC classification number: G06V40/16 , G06V10/255 , G06V10/26 , G06V10/766
Abstract: Devices, methods, and non-transitory program storage devices are disclosed to: obtain an input image; identify a first face in the input image; divide the first face into a plurality of regions; identify obstructions in one or more of the plurality of regions; select a subset of regions, based on the identified obstructions; and determine a white point for the first face based, at least in part, on the selected subset of regions. In some embodiments, obstructions may be identified using a face obstruction detection model (e.g., a logistic regression model trained based on a large dataset of annotated facial images with and without obstructions). The identified obstructions may comprise, e.g., facial hair, head hair, glasses, a facial covering, a head covering, a face mask, or clothing. In some embodiments, a white balancing operation may be performed on the input image based, at least in part, on the determined white point.
-
公开(公告)号:US20240406334A1
公开(公告)日:2024-12-05
申请号:US18613004
申请日:2024-03-21
Applicant: Apple Inc.
Inventor: Renbo Cao , Yonghui Zhao , Yingjun Bai , Xuemei Zhang
Abstract: An electronic device is provided that includes one or more image sensors configured to capture a video feed, an image signal processor configured to perform color correction on the captured video feed based on a brightness level computed from the captured video feed and/or based on a color temperature or illuminant type of the lighting in the captured video feed to generate a corresponding color corrected video feed using a first chromatic adaptation model that is adapted to an immersive viewing condition, and one or more displays configured to output the color corrected video feed. The electronic device can further include a recording pipeline configured to record a version of the captured video feed and can share or transmit the recorded content to an external device. The external device can display the recorded content using a second chromatic adaptation model that is adapted to a non-immersive viewing condition.
-
公开(公告)号:US20240388683A1
公开(公告)日:2024-11-21
申请号:US18583729
申请日:2024-02-21
Applicant: Apple Inc.
Inventor: Renbo Cao , Yonghui Zhao , Yingjun Bai , Christophe Seyve , Henryk K. Blasinski
IPC: H04N13/133 , H04N13/15 , H04N13/161 , H04N13/167 , H04N13/339
Abstract: An apparatus can include a first image sensor having a first field of view (FOV) and configured to capture a first image, a second image sensor having a second FOV and configured to capture a second image, an image statistics collection subsystem configured to gather first image statistics information associated with the first image and to gather second image statistics information associated with the second image, a disparity detection subsystem configured to compare the first image statistics information with the second image statistics information, and image signal processing blocks configured to synchronize processing of the first and second images based on the comparison of the first image statistics information with the second image statistics information. Processing of the first and second images can involve using one or more combined image signal processing control parameters based on image statistics information within an overlapping FOV and/or a within a total FOV.
-
公开(公告)号:US10043484B2
公开(公告)日:2018-08-07
申请号:US15275225
申请日:2016-09-23
Applicant: Apple Inc.
Inventor: D. Amnon Silverstein , Xuemei Zhang , Yingjun Bai , Brandon J. Corey , Yonghui Zhao
IPC: G09G5/06
Abstract: Displaying wide-gamut images as intended on color-managed wide-gamut display systems while rendering a visually consistent image when rendered on targeted narrow-gamut display systems (regardless of whether the narrow-gamut displays are color-managed). Images represented in accordance with this disclosure are referred to as a dual-target images (DTI): one target being the image's original wide-gamut color space, the other target being a specified narrow-gamut color space. The novel representational scheme retains narrow-gamut rendering for those colors in a wide-gamut image that are within the targeted narrow-gamut color space, transitioning to wide-gamut rendering for those colors in the wide-gamut image that are outside the targeted narrow-gamut color space. This approach minimizes pixel clipping when rendering a wide-gamut image for a narrow-gamut display, while allowing the original wide-gamut pixel values to be recovered when rendering for a wide-gamut display.
-
公开(公告)号:US20170098428A1
公开(公告)日:2017-04-06
申请号:US15275225
申请日:2016-09-23
Applicant: Apple Inc.
Inventor: D. Amnon Silverstein , Xuemei Zhang , Yingjun Bai , Brandon J. Corey , Yonghui Zhao
CPC classification number: G09G5/06 , G09G2320/0666 , G09G2340/06
Abstract: In general, techniques are disclosed for displaying wide-gamut images as intended on color-managed wide-gamut display systems while rendering a visually consistent image when rendered on targeted narrow-gamut display systems (regardless of whether the narrow-gamut displays are color-managed). For this reason, an image represented in accordance with this disclosure is referred to as a dual-target image (DTI): one target being the image's original wide-gamut color space, the other target being a specified narrow-gamut color space. The novel representational scheme described herein retains narrow-gamut rendering for those colors in a wide-gamut image that are within the targeted narrow-gamut color space, transitioning to wide-gamut rendering for those colors in the wide-gamut image that are outside the targeted narrow-gamut color space. This approach minimizes pixel clipping when rendering a wide-gamut image for a narrow-gamut display, while allowing the original wide-gamut pixel values to be recovered when rendering for a wide-gamut display.
-
公开(公告)号:US20180070068A1
公开(公告)日:2018-03-08
申请号:US15697228
申请日:2017-09-06
Applicant: Apple Inc.
Inventor: Yonghui Zhao , Xuemei Zhang , Yingjun Bai , Gregory Guyomarc'h , Kosta Dabov
CPC classification number: H04N9/735 , H04N5/23212 , H04N5/2357 , H04N5/3572 , H04N5/367 , H04N9/045 , H04N9/68
Abstract: Techniques for auto white balancing of captured images based on detection of flicker in ambient light is described. When flicker is detected in ambient light during an image capture event, and the flicker is unchanging during the image capture event, a white point of image data may be estimated according to a first technique. When flicker is detected in ambient light during an image capture event, and the flicker is changing during the image capture event, a white point of image data may be estimated according to a second technique. When flicker is not detected, a white point of image data may be estimated according to a third technique. Image data may be color corrected based on the estimated white point.
-
公开(公告)号:US11816866B2
公开(公告)日:2023-11-14
申请号:US17805056
申请日:2022-06-02
Applicant: Apple Inc.
Inventor: Miguel Angel Lopez Alvarez , Yonghui Zhao
CPC classification number: G06T7/80 , H04N9/646 , H04N17/002 , H04N23/10 , H04N23/81 , H04N23/88 , G06T2207/10024
Abstract: Devices, methods, and non-transitory program storage devices (NPSDs) are disclosed to compensate for the predicted color changes experienced by camera modules after certain amounts of time of real world use. Such color changes may be caused by prolonged exposure of optical components of the camera module to one or more of: solar radiation, high temperature conditions, or high humidity conditions, each of which may, over time, induce deviation in the color response of optical components of the camera module. The techniques disclosed herein may first characterize such predicted optical change to components over time based on particular environmental conditions, and then implement one or more time-varying color models to compensate for predicted changes to the camera module's color calibration values due to the characterized optical change. In some embodiments, optical changes in other types of components, e.g., display devices, caused by prolonged environmental stresses may also be modeled and compensated.
-
公开(公告)号:US10602111B2
公开(公告)日:2020-03-24
申请号:US15697228
申请日:2017-09-06
Applicant: Apple Inc.
Inventor: Yonghui Zhao , Xuemei Zhang , Yingjun Bai , Gregory Guyomarc'h , Kosta Dabov
Abstract: Techniques for auto white balancing of captured images based on detection of flicker in ambient light is described. When flicker is detected in ambient light during an image capture event, and the flicker is unchanging during the image capture event, a white point of image data may be estimated according to a first technique. When flicker is detected in ambient light during an image capture event, and the flicker is changing during the image capture event, a white point of image data may be estimated according to a second technique. When flicker is not detected, a white point of image data may be estimated according to a third technique. Image data may be color corrected based on the estimated white point.
-
-
-
-
-
-
-
-
-