公开(公告)号：US20160125580A1

公开(公告)日：2016-05-05

申请号：US14636682

申请日：2015-03-03

Applicant: Apple Inc.

Inventor： Haiyan He

IPC: G06T5/00 ,  G06T5/50 ,  H04N9/68 ,  G06T15/30 ,  H04N5/202 ,  G06T5/40 ,  G06T7/40

CPC classification number: H04N9/68 ,  G06T15/30 ,  G09G3/2003 ,  G09G2320/0626 ,  G09G2340/06 ,  H04N5/20 ,  H04N5/202

Abstract: An image processing system performs intensity mapping in a manner that avoids color shifts and conserves processing resources while adapting image data for a target display device. The image processing system may convert input image data to a target color space in which brightness components are orthogonal to other color components. When intensity mapping is performed on image data, the intensity mapping operations do not induce the color shifts that were created in these other proposals. Resource conservation may be achieved by altering operation of perceptual quantization processes as used in other intensity mapping systems. Where prior proposals performed perceptual quantization on all color components of the image data being processed, the disclosed embodiments perform perceptual quantization on only a brightness color component of image data. Thus, these embodiments avoid resource expenditures that otherwise would be spent on perceptual quantization of two other color components.

Abstract translation: 图像处理系统以避免颜色偏移的方式执行强度映射，并且在调整用于目标显示设备的图像数据的同时节省处理资源。 图像处理系统可以将输入图像数据转换成其中亮度分量与其他颜色分量正交的目标色彩空间。 当对图像数据执行强度映射时，强度映射操作不会导致在这些其他提案中创建的颜色偏移。 可以通过改变在其他强度测绘系统中使用的感知量化过程的操作来实现资源保护。 在先前的提案对正在处理的图像数据的所有颜色分量执行感知量化的情况下，所公开的实施例仅对图像数据的亮度颜色分量执行感知量化。 因此，这些实施例避免了否则将花费在两个其他颜色分量的感知量化上的资源支出。

公开(公告)号：US20240404009A1

公开(公告)日：2024-12-05

申请号：US18326630

申请日：2023-05-31

Applicant: Apple Inc.

Inventor： Yun Gong ,  Jim C. Chou ,  Guy Cote ,  Haiyan He ,  Michael J. Rockwell

IPC: G06T5/20 ,  G06F3/01 ,  G06T5/50 ,  G06T7/13 ,  G06T11/00 ,  G09G3/20

Abstract: A system may include a display for displaying an image frame that is divided into regions having respective resolutions based on display image data. The system may also include image processing circuitry to generate the display image data based on multi-resolution image data of the image frame. Generating the display image data may include determining an enhancement to be applied to a portion of the multi-resolution image data and adjusting the determined enhancement to be applied to the portion of the multi-resolution image data based on boundary data associated with locations of boundaries between the regions.

公开(公告)号：US11551336B2

公开(公告)日：2023-01-10

申请号：US17006779

申请日：2020-08-28

Applicant: Apple inc.

Inventor： Jim C. Chou ,  Haiyan He ,  Yun Gong

IPC: G06T5/00 ,  G06T3/40 ,  G06T7/90 ,  G06T5/20

Abstract: An electronic device may include enhancement circuitry to enhance high resolution image data to improve perceived quality of an image corresponding to the high resolution image data. The enhancement circuitry may include tone detection circuitry to determine one or more tones within the image and apply changes to the high resolution image data based on the one or more tones. The enhancement circuitry may also include example-based improvement circuitry to compare the high resolution image data to low resolution image data and apply changes to the high resolution image data based on differences between sections of the high resolution image data and sections of the low resolution image data. The enhancement circuitry may also include channel processing circuitry to apply the first and second changes to one or more channels of the high resolution image data.

公开(公告)号：US10762604B2

公开(公告)日：2020-09-01

申请号：US16053342

申请日：2018-08-02

Applicant: Apple Inc.

Inventor： Jim C. Chou ,  Haiyan He ,  Yun Gong

IPC: G06T5/00 ,  G06T3/40 ,  G06T7/90 ,  G06T5/20

Abstract: An electronic device may include enhancement circuitry to enhance high resolution image data to improve perceived quality of an image corresponding to the high resolution image data. The enhancement circuitry may include tone detection circuitry to determine one or more tones within the image and apply changes to the high resolution image data based on the one or more tones. The enhancement circuitry may also include example-based improvement circuitry to compare the high resolution image data to low resolution image data and apply changes to the high resolution image data based on differences between sections of the high resolution image data and sections of the low resolution image data. The enhancement circuitry may also include channel processing circuitry to apply the first and second changes to one or more channels of the high resolution image data.

公开(公告)号：US10719916B2

公开(公告)日：2020-07-21

申请号：US16053324

申请日：2018-08-02

Applicant: Apple Inc.

Inventor： Haiyan He ,  Jim C. Chou

IPC: G06T5/00 ,  G06T5/20 ,  G06K9/62 ,  G06T7/11 ,  G06T7/90 ,  G06T5/40 ,  G06T3/40

Abstract: An electronic device may include noise statistics circuitry to receive input image data corresponding to an image displayable on an electronic display. The input image data may include one or more channels of pixel data. The noise statistics circuitry may also determine a subset of pixel data of a channel of pixel data that qualifies for statistics gathering according to qualification criteria. Additionally, the noise statistics circuitry may determine noise statistics based on the subset of pixel data, and identify image features within the subset of pixel data based on the noise statistics. The image features may include frequency signatures, differentiated from noise, that correspond to features of content of the image. The electronic device may also include enhancement circuitry to enhance the input image data based on the noise statistics and the identified image features. Such enhancement circuitry may substantially preserve the image features within the input image data.

公开(公告)号：US20200053362A1

公开(公告)日：2020-02-13

申请号：US16100310

申请日：2018-08-10

Applicant: Apple Inc.

Inventor： Xiang Fu ,  Linfeng Guo ,  Haiyan He ,  Wei Li ,  Xu Gang Zhao ,  Hao Pan ,  Xiaohua Yang ,  Krishnakanth Rapaka ,  Munehiro Nakazato ,  Haitao Guo

IPC: H04N19/176 ,  H04N19/126 ,  G06N3/08 ,  G06T7/13

Abstract: Techniques are disclosed for coding image data adaptively at different levels of downscaling. Such techniques may involve partitioning input data into pixel blocks for coding and performing content analysis on the pixel blocks. The pixel blocks may be input to block coders that operate at different pixel block sizes, which may code the pixel blocks input to them at their respective sizes. Except when a block coder operates at the partitioning size, block coders that operate at different pixel block sizes may perform downscaling of the pixel blocks to match their size with the block coders' respective coding size. A block decoder may invert the coding operations performed by the block coders, decoding coded image data at respective pixel block sizes, then upscaling decoded image data obtained therefrom to a common pixel block size. Image reconstruction may synthesize a resultant image from the decode pixel block data output by the decoders. Quality enhancements may be added by neural network processing systems that have been trained to other segmented images.

公开(公告)号：US20200043137A1

公开(公告)日：2020-02-06

申请号：US16053324

申请日：2018-08-02

Applicant: Apple Inc.

Inventor： Haiyan He ,  Jim C. Chou

IPC: G06T5/00 ,  G06T5/20 ,  G06K9/62 ,  G06T7/90 ,  G06T7/11

Abstract: An electronic device may include noise statistics circuitry to receive input image data corresponding to an image displayable on an electronic display. The input image data may include one or more channels of pixel data. The noise statistics circuitry may also determine a subset of pixel data of a channel of pixel data that qualifies for statistics gathering according to qualification criteria. Additionally, the noise statistics circuitry may determine noise statistics based on the subset of pixel data, and identify image features within the subset of pixel data based on the noise statistics. The image features may include frequency signatures, differentiated from noise, that correspond to features of content of the image. The electronic device may also include enhancement circuitry to enhance the input image data based on the noise statistics and the identified image features. Such enhancement circuitry may substantially preserve the image features within the input image data.

公开(公告)号：US20210096023A1

公开(公告)日：2021-04-01

申请号：US16586411

申请日：2019-09-27

Applicant: Apple Inc.

Inventor： Xiaohua Yang ,  Ruiqi Hu ,  Hao Pan ,  Vaidyanath Mani ,  Qiang Wang ,  Haiyan He ,  Xin Wang ,  Gui Xie ,  Jin Wook Chang

IPC: G01J1/42 ,  G06T5/00 ,  G06T7/90 ,  G06T7/11 ,  H04N1/60

Abstract: A device comprises memory, a display characterized by a display characteristic, and processors coupled to the memory. The processors execute instructions causing the processors to receive data indicative of the display characteristic, data indicative of ambient lighting, and data indicative of content characteristics for a content item; determine a tone mapping curve for the content item based on the data indicative of content characteristics; determine a first, so-called “anchor” point along the tone mapping curve; modify a first portion of the tone mapping curve below the anchor point based on the data indicative of ambient lighting; modify a second portion of the tone mapping curve above the anchor point based on the data indicative of the display characteristic; perform tone mapping for the content item based on the modified toned mapping curve to obtain a tone mapped content item; and cause the display to display the tone mapped content item.

公开(公告)号：US20200043138A1

公开(公告)日：2020-02-06

申请号：US16053342

申请日：2018-08-02

Applicant: Apple Inc.

Inventor： Jim C. Chou ,  Haiyan He ,  Yun Gong

IPC: G06T5/00 ,  G06T3/40 ,  G06T5/20 ,  G06T7/90

Abstract: An electronic device may include enhancement circuitry to enhance high resolution image data to improve perceived quality of an image corresponding to the high resolution image data. The enhancement circuitry may include tone detection circuitry to determine one or more tones within the image and apply changes to the high resolution image data based on the one or more tones. The enhancement circuitry may also include example-based improvement circuitry to compare the high resolution image data to low resolution image data and apply changes to the high resolution image data based on differences between sections of the high resolution image data and sections of the low resolution image data. The enhancement circuitry may also include channel processing circuitry to apply the first and second changes to one or more channels of the high resolution image data.

公开(公告)号：US09569816B2

公开(公告)日：2017-02-14

申请号：US14687513

申请日：2015-04-15

Applicant: Apple Inc.

Inventor： Jim C. Chou ,  Guy Cote ,  Haiyan He

IPC: G09G5/28 ,  G09G5/39 ,  G06T3/40 ,  G06T5/00

CPC classification number: G06T3/4007 ,  G06T5/001 ,  G06T5/002 ,  G06T5/10 ,  G06T2207/10024 ,  G06T2207/20012 ,  G06T2207/20028 ,  G06T2207/20048

Abstract: An image signal processing system may include processing circuitry that may reduce banding artifacts in image data to be depicted on a display. The processing circuitry may receive a first pixel value associated with a first pixel of the image data and detect a first set of pixels located in a first direction along a same row of pixels or a same column of pixels with respect to the first pixel. The first set of pixels is associated with a first band. The processing circuitry may then interpolate a second pixel value based on an average of a first set of pixel values that correspond to the first set of pixels and a distance between the first pixel and a closest pixel in the first band. The processing circuitry may then output the second pixel value for the first pixel.

Abstract translation: 图像信号处理系统可以包括可以减少要在显示器上描绘的图像数据中的带状伪影的处理电路。 处理电路可以接收与图像数据的第一像素相关联的第一像素值，并且相对于第一像素沿同一行像素或相同列的像素检测位于第一方向上的第一组像素。 第一组像素与第一个带相关联。 然后，处理电路可以基于对应于第一组像素的第一组像素值的平均值和第一像素与第一像素中的最近像素之间的距离来内插第二像素值。 处理电路然后可以输出第一像素的第二像素值。