公开(公告)号：US11689826B2

公开(公告)日：2023-06-27

申请号：US17377308

申请日：2021-07-15

Applicant: Apple Inc.

Inventor： Guy Cote ,  D. Amnon Silverstein ,  Suk Hwan Lim ,  Sheng Lin ,  Haitao Guo

IPC: H04N5/217 ,  H04N25/67

CPC classification number: H04N25/67

Abstract: The present disclosure generally relates to systems and methods for image data processing. In certain embodiments, an image processing pipeline may be configured to receive a frame of the image data having a plurality of pixels acquired using a digital image sensor. The image processing pipeline may then be configured to determine a first plurality of correction factors that may correct each pixel in the plurality of pixels for fixed pattern noise. The first plurality of correction factors may be determined based at least in part on fixed pattern noise statistics that correspond to the frame of the image data. After determining the first plurality of correction factors, the image processing pipeline may be configured to configured to apply the first plurality of correction factors to the plurality of pixels, thereby reducing the fixed pattern noise present in the plurality of pixels.

公开(公告)号：US10764588B2

公开(公告)日：2020-09-01

申请号：US16100310

申请日：2018-08-10

Applicant: Apple Inc.

Inventor： Xiang Fu ,  Linfeng Guo ,  Haiyan He ,  Wei Li ,  Xu Gang Zhao ,  Hao Pan ,  Xiaohua Yang ,  Krishnakanth Rapaka ,  Munehiro Nakazato ,  Haitao Guo

IPC: H04N19/176 ,  H04N19/126 ,  G06T7/13 ,  G06N3/08

Abstract: Techniques are disclosed for coding image data adaptively at different levels of downscaling. Such techniques may involve partitioning input data into pixel blocks for coding and performing content analysis on the pixel blocks. The pixel blocks may be input to block coders that operate at different pixel block sizes, which may code the pixel blocks input to them at their respective sizes. Except when a block coder operates at the partitioning size, block coders that operate at different pixel block sizes may perform downscaling of the pixel blocks to match their size with the block coders' respective coding size. A block decoder may invert the coding operations performed by the block coders, decoding coded image data at respective pixel block sizes, then upscaling decoded image data obtained therefrom to a common pixel block size. Image reconstruction may synthesize a resultant image from the decode pixel block data output by the decoders. Quality enhancements may be added by neural network processing systems that have been trained to other segmented images.

公开(公告)号：US10271054B2

公开(公告)日：2019-04-23

申请号：US14631394

申请日：2015-02-25

Applicant: Apple Inc.

Inventor： Kenneth I. Greenebaum ,  Haitao Guo ,  Hao Pan ,  Guy Cote ,  Andrew Bai

IPC: G06F3/14 ,  G06T5/00 ,  G09G3/20 ,  G09G5/00 ,  G09G5/02 ,  G09G5/10 ,  H04N1/60 ,  H04N1/64 ,  H04N5/20 ,  H04N5/50 ,  H04N9/64 ,  H04N9/67 ,  H04N19/14 ,  H04N19/17 ,  H04N19/30 ,  H04N19/33 ,  H04N19/44 ,  H04N19/52 ,  H04N19/86 ,  H04N19/98 ,  H04N19/136 ,  H04N19/184 ,  H04N19/186 ,  H04N19/169 ,  H04N19/176 ,  H04N19/182 ,  H04N5/235 ,  H04N19/172 ,  H04N19/102 ,  H04N19/137 ,  H04N19/177 ,  H04N21/422 ,  H04N21/431 ,  H04N19/124 ,  H04N19/154 ,  H04N19/463 ,  H04N21/4223 ,  H04N21/44 ,  H04N21/4402 ,  H04N21/442 ,  H04N21/485

Abstract: Adaptive video processing for a target display panel may be implemented in or by a decoding/display pipeline associated with the target display panel. The adaptive video processing methods may take into account video content, display characteristics, and environmental conditions including but not limited to ambient lighting and viewer location when processing and rendering video content for a target display panel in an ambient setting or environment. The display-side adaptive video processing methods may use this information to adjust one or more video processing functions as applied to the video data to render video for the target display panel that is adapted to the display panel according to the ambient viewing conditions.

公开(公告)号：US10212429B2

公开(公告)日：2019-02-19

申请号：US14631401

申请日：2015-02-25

Applicant: Apple Inc.

Inventor： Haitao Guo ,  Hao Pan ,  Guy Cote ,  Andrew Bai

IPC: H04N11/02 ,  H04N19/14 ,  G06T5/00 ,  G09G3/20 ,  G09G5/00 ,  H04N1/60 ,  H04N5/50 ,  H04N9/64 ,  H04N9/67 ,  H04N19/136 ,  H04N19/184 ,  H04N19/186 ,  H04N19/169 ,  H04N19/44 ,  H04N19/30 ,  H04N19/33 ,  H04N19/176 ,  H04N19/182 ,  H04N19/52 ,  G06F3/14 ,  G09G5/02 ,  G09G5/10 ,  H04N1/64 ,  H04N5/20 ,  H04N5/235 ,  H04N19/172 ,  H04N19/102 ,  H04N19/137 ,  H04N19/177 ,  H04N21/422 ,  H04N21/431 ,  H04N19/124 ,  H04N19/154 ,  H04N19/17 ,  H04N19/98 ,  H04N19/86 ,  H04N19/463 ,  H04N21/4223 ,  H04N21/44 ,  H04N21/4402 ,  H04N21/442 ,  H04N21/485

Abstract: Video processing techniques and pipelines that support capture, distribution, and display of high dynamic range (HDR) image data to both HDR-enabled display devices and display devices that do not support HDR imaging. A sensor pipeline may generate standard dynamic range (SDR) data from HDR data captured by a sensor using tone mapping, for example local tone mapping. Information used to generate the SDR data may be provided to a display pipeline as metadata with the generated SDR data. If a target display does not support HDR imaging, the SDR data may be directly rendered by the display pipeline. If the target display does support HDR imaging, then an inverse mapping technique may be applied to the SDR data according to the metadata to render HDR data for display. Information used in performing color gamut mapping may also be provided in the metadata and used to recover clipped colors for display.

公开(公告)号：US10205967B2

公开(公告)日：2019-02-12

申请号：US15070620

申请日：2016-03-15

Applicant: Apple Inc.

Inventor： Hao Pan ,  Yingjun Bai ,  Xuemei Zhang ,  Haitao Guo ,  Munehiro Nakazato ,  Xiaohua Yang

IPC: H04N19/86 ,  H04N19/12 ,  H04N19/156 ,  H04N19/186 ,  H04N19/44

Abstract: This disclosure relates to a wide gamut encoder capable of receiving a wide gamut color image in accordance with a wide gamut standard. The encoder can encode one or more wide gamut color image pixel values into portions of narrow gamut encoding elements for transmission to a video encoder. The encoder can implement an advanced extended YCC format that is backward compatible with a P3 color gamut.

公开(公告)号：US20180348885A1

公开(公告)日：2018-12-06

申请号：US16055994

申请日：2018-08-06

Applicant: Apple Inc.

Inventor： Feng Tang ,  Chong Chen ,  Haitao Guo ,  Xiaojin Shi ,  Thorsten Gernoth

IPC: G06F3/01 ,  G06K9/00 ,  G06F3/03 ,  G06F3/16 ,  G06K9/62

CPC classification number: G06F3/017 ,  G06F3/011 ,  G06F3/012 ,  G06F3/0304 ,  G06F3/16 ,  G06F3/165 ,  G06K9/00375 ,  G06K9/00389 ,  G06K9/6269 ,  G06K9/6282 ,  G06K2209/40

Abstract: Intelligent systems are disclosed that respond to user intent and desires based upon activity that may or may not be expressly directed at the intelligent system. In some embodiments, the intelligent system acquires a depth image of a scene surrounding the system. A scene geometry may be extracted from the depth image and elements of the scene may be monitored. In certain embodiments, user activity in the scene is monitored and analyzed to infer user desires or intent with respect to the system. The interpretation of the user's intent as well as the system's response may be affected by the scene geometry surrounding the user and/or the system. In some embodiments, techniques and systems are disclosed for interpreting express user communication, e.g., expressed through hand gesture movements. In some embodiments, such gesture movements may be interpreted based on real-time depth information obtained from, e.g., optical or non-optical type depth sensors.

公开(公告)号：US20180089880A1

公开(公告)日：2018-03-29

申请号：US15712683

申请日：2017-09-22

Applicant: Apple Inc.

Inventor： Christopher M. Garrido ,  Brian Amberg ,  David L. Biderman ,  Eric L. Chien ,  Haitao Guo ,  Sarah Amsellem ,  Thibaut Weise ,  Timothy L. Bienz

IPC: G06T13/80 ,  H04N7/14 ,  H04N7/15 ,  H04L29/06

CPC classification number: G06T13/80 ,  H04L65/4069 ,  H04L65/601 ,  H04L65/605 ,  H04L65/80 ,  H04N7/147 ,  H04N7/15 ,  H04N7/157 ,  H04N21/4223 ,  H04N21/44209 ,  H04N21/44245 ,  H04N21/4532 ,  H04N21/4788 ,  H04N2007/145

Abstract: In an embodiment a method of online video communication is disclosed. An online video communication is established between a source device and a receiving device. The source device captures a live video recording of a sending user. The captured recording is analyzed to identify one or more characteristics of the sending user. The source device then generates avatar data corresponding to the identified characteristics. The avatar data is categorized into a plurality of groups, wherein a first group of the at least two groups comprises avatar data that is more unique to the sending user. Finally, at least the first group of the plurality of groups is transmitted to the receiving device. The transmitted first group of avatar data defines, at least in part, how to animate an avatar that mimics the sending user's one or more physical characteristics.