公开(公告)号：US10986345B2

公开(公告)日：2021-04-20

申请号：US16277892

申请日：2019-02-15

Applicant: Apple Inc.

Inventor： Haitao Guo ,  Hao Pan ,  Guy Cote ,  Andrew Bai

IPC: H04N11/02 ,  H04N19/14 ,  G06F3/14 ,  G09G5/02 ,  G09G5/10 ,  H04N1/64 ,  H04N5/20 ,  H04N5/235 ,  H04N19/172 ,  H04N19/102 ,  H04N19/137 ,  H04N19/177 ,  H04N19/124 ,  H04N19/154 ,  H04N19/17 ,  H04N19/98 ,  H04N21/422 ,  H04N21/431 ,  G06T5/00 ,  G09G3/20 ,  G09G5/00 ,  H04N1/60 ,  H04N5/50 ,  H04N9/64 ,  H04N9/67 ,  H04N19/136 ,  H04N19/184 ,  H04N19/186 ,  H04N19/169 ,  H04N19/44 ,  H04N19/30 ,  H04N19/33 ,  H04N19/176 ,  H04N19/182 ,  H04N19/52 ,  H04N19/86 ,  H04N19/463 ,  H04N21/4223 ,  H04N21/44 ,  H04N21/4402 ,  H04N21/442 ,  H04N21/485

Abstract: Video processing techniques and pipelines that support capture, distribution, and display of high dynamic range (HDR) image data to both HDR-enabled display devices and display devices that do not support HDR imaging. A sensor pipeline may generate standard dynamic range (SDR) data from HDR data captured by a sensor using tone mapping, for example local tone mapping. Information used to generate the SDR data may be provided to a display pipeline as metadata with the generated SDR data. If a target display does not support HDR imaging, the SDR data may be directly rendered by the display pipeline. If the target display does support HDR imaging, then an inverse mapping technique may be applied to the SDR data according to the metadata to render HDR data for display. Information used in performing color gamut mapping may also be provided in the metadata and used to recover clipped colors for display.

公开(公告)号：US20210227226A1

公开(公告)日：2021-07-22

申请号：US17132922

申请日：2020-12-23

Applicant: Apple Inc.

Inventor： Kenneth I. Greenebaum ,  Haitao Guo ,  Hao Pan ,  Guy Cote ,  Andrew Bai

IPC: H04N19/14 ,  G06F3/14 ,  G09G5/02 ,  G09G5/10 ,  H04N1/64 ,  H04N5/20 ,  H04N5/235 ,  H04N19/172 ,  H04N19/102 ,  H04N19/137 ,  H04N19/177 ,  H04N19/124 ,  H04N19/154 ,  H04N19/17 ,  H04N19/98 ,  H04N21/422 ,  H04N21/431 ,  G06T5/00 ,  G09G3/20 ,  G09G5/00 ,  H04N1/60 ,  H04N5/50 ,  H04N9/64 ,  H04N9/67 ,  H04N19/136 ,  H04N19/184 ,  H04N19/186 ,  H04N19/169 ,  H04N19/44 ,  H04N19/30 ,  H04N19/33 ,  H04N19/176 ,  H04N19/182 ,  H04N19/52

Abstract: Adaptive video processing for a target display panel may be implemented in or by a server/encoding pipeline. The adaptive video processing methods may obtain and take into account video content and display panel-specific information including display characteristics and environmental conditions (e.g., ambient lighting and viewer location) when processing and encoding video content to be streamed to the target display panel in an ambient setting or environment. The server-side adaptive video processing methods may use this information to adjust one or more video processing functions as applied to the video data to generate video content in the color gamut and dynamic range of the target display panel that is adapted to the display panel characteristics and ambient viewing conditions.

公开(公告)号：US10271054B2

公开(公告)日：2019-04-23

申请号：US14631394

申请日：2015-02-25

Applicant: Apple Inc.

Inventor： Kenneth I. Greenebaum ,  Haitao Guo ,  Hao Pan ,  Guy Cote ,  Andrew Bai

IPC: G06F3/14 ,  G06T5/00 ,  G09G3/20 ,  G09G5/00 ,  G09G5/02 ,  G09G5/10 ,  H04N1/60 ,  H04N1/64 ,  H04N5/20 ,  H04N5/50 ,  H04N9/64 ,  H04N9/67 ,  H04N19/14 ,  H04N19/17 ,  H04N19/30 ,  H04N19/33 ,  H04N19/44 ,  H04N19/52 ,  H04N19/86 ,  H04N19/98 ,  H04N19/136 ,  H04N19/184 ,  H04N19/186 ,  H04N19/169 ,  H04N19/176 ,  H04N19/182 ,  H04N5/235 ,  H04N19/172 ,  H04N19/102 ,  H04N19/137 ,  H04N19/177 ,  H04N21/422 ,  H04N21/431 ,  H04N19/124 ,  H04N19/154 ,  H04N19/463 ,  H04N21/4223 ,  H04N21/44 ,  H04N21/4402 ,  H04N21/442 ,  H04N21/485

Abstract: Adaptive video processing for a target display panel may be implemented in or by a decoding/display pipeline associated with the target display panel. The adaptive video processing methods may take into account video content, display characteristics, and environmental conditions including but not limited to ambient lighting and viewer location when processing and rendering video content for a target display panel in an ambient setting or environment. The display-side adaptive video processing methods may use this information to adjust one or more video processing functions as applied to the video data to render video for the target display panel that is adapted to the display panel according to the ambient viewing conditions.

公开(公告)号：US10212429B2

公开(公告)日：2019-02-19

申请号：US14631401

申请日：2015-02-25

Applicant: Apple Inc.

Inventor： Haitao Guo ,  Hao Pan ,  Guy Cote ,  Andrew Bai

IPC: H04N11/02 ,  H04N19/14 ,  G06T5/00 ,  G09G3/20 ,  G09G5/00 ,  H04N1/60 ,  H04N5/50 ,  H04N9/64 ,  H04N9/67 ,  H04N19/136 ,  H04N19/184 ,  H04N19/186 ,  H04N19/169 ,  H04N19/44 ,  H04N19/30 ,  H04N19/33 ,  H04N19/176 ,  H04N19/182 ,  H04N19/52 ,  G06F3/14 ,  G09G5/02 ,  G09G5/10 ,  H04N1/64 ,  H04N5/20 ,  H04N5/235 ,  H04N19/172 ,  H04N19/102 ,  H04N19/137 ,  H04N19/177 ,  H04N21/422 ,  H04N21/431 ,  H04N19/124 ,  H04N19/154 ,  H04N19/17 ,  H04N19/98 ,  H04N19/86 ,  H04N19/463 ,  H04N21/4223 ,  H04N21/44 ,  H04N21/4402 ,  H04N21/442 ,  H04N21/485

Abstract: Video processing techniques and pipelines that support capture, distribution, and display of high dynamic range (HDR) image data to both HDR-enabled display devices and display devices that do not support HDR imaging. A sensor pipeline may generate standard dynamic range (SDR) data from HDR data captured by a sensor using tone mapping, for example local tone mapping. Information used to generate the SDR data may be provided to a display pipeline as metadata with the generated SDR data. If a target display does not support HDR imaging, the SDR data may be directly rendered by the display pipeline. If the target display does support HDR imaging, then an inverse mapping technique may be applied to the SDR data according to the metadata to render HDR data for display. Information used in performing color gamut mapping may also be provided in the metadata and used to recover clipped colors for display.

公开(公告)号：US10602152B2

公开(公告)日：2020-03-24

申请号：US14631398

申请日：2015-02-25

Applicant: Apple Inc.

Inventor： Kenneth I. Greenebaum ,  Haitao Guo ,  Hao Pan ,  Guy Cote ,  Andrew Bai

IPC: G06F3/14 ,  G09G5/02 ,  H04N1/64 ,  H04N19/102 ,  H04N19/98 ,  H04N21/422 ,  H04N21/431 ,  G09G5/00 ,  H04N19/14 ,  G09G5/10 ,  H04N5/20 ,  H04N5/235 ,  H04N19/172 ,  H04N19/137 ,  H04N19/177 ,  H04N19/124 ,  H04N19/154 ,  H04N19/17 ,  G06T5/00 ,  G09G3/20 ,  H04N1/60 ,  H04N5/50 ,  H04N9/64 ,  H04N9/67 ,  H04N19/136 ,  H04N19/184 ,  H04N19/186 ,  H04N19/169 ,  H04N19/44 ,  H04N19/30 ,  H04N19/33 ,  H04N19/176 ,  H04N19/182 ,  H04N19/52 ,  H04N19/86 ,  H04N19/463 ,  H04N21/4223 ,  H04N21/44 ,  H04N21/4402 ,  H04N21/442 ,  H04N21/485

Abstract: Adaptive video processing for a target display panel may be implemented in or by a server/encoding pipeline. The adaptive video processing methods may obtain and take into account video content and display panel-specific information including display characteristics and environmental conditions (e.g., ambient lighting and viewer location) when processing and encoding video content to be streamed to the target display panel in an ambient setting or environment. The server-side adaptive video processing methods may use this information to adjust one or more video processing functions as applied to the video data to generate video content in the color gamut and dynamic range of the target display panel that is adapted to the display panel characteristics and ambient viewing conditions.

公开(公告)号：US20150245044A1

公开(公告)日：2015-08-27

申请号：US14631401

申请日：2015-02-25

Applicant: Apple Inc.

Inventor： Haitao Guo ,  Hao Pan ,  Guy Cote ,  Andrew Bai

IPC: H04N19/30 ,  H04N19/169 ,  H04N19/33 ,  H04N19/186

CPC classification number: H04N19/14 ,  G06F3/1454 ,  G06T5/009 ,  G06T2207/20208 ,  G09G3/2007 ,  G09G5/005 ,  G09G5/02 ,  G09G5/10 ,  G09G2320/0261 ,  G09G2320/0271 ,  G09G2320/0613 ,  G09G2320/062 ,  G09G2320/0626 ,  G09G2320/066 ,  G09G2320/0666 ,  G09G2320/0673 ,  G09G2320/0686 ,  G09G2320/0693 ,  G09G2320/08 ,  G09G2320/103 ,  G09G2340/02 ,  G09G2360/144 ,  G09G2370/042 ,  H04N1/6066 ,  H04N1/64 ,  H04N5/20 ,  H04N5/2355 ,  H04N5/505 ,  H04N9/641 ,  H04N9/67 ,  H04N19/102 ,  H04N19/124 ,  H04N19/136 ,  H04N19/137 ,  H04N19/154 ,  H04N19/17 ,  H04N19/172 ,  H04N19/176 ,  H04N19/177 ,  H04N19/182 ,  H04N19/184 ,  H04N19/186 ,  H04N19/188 ,  H04N19/30 ,  H04N19/33 ,  H04N19/44 ,  H04N19/463 ,  H04N19/52 ,  H04N19/86 ,  H04N19/98 ,  H04N21/42202 ,  H04N21/4223 ,  H04N21/4318 ,  H04N21/44008 ,  H04N21/4402 ,  H04N21/44218 ,  H04N21/4854

Abstract: Video processing techniques and pipelines that support capture, distribution, and display of high dynamic range (HDR) image data to both HDR-enabled display devices and display devices that do not support HDR imaging. A sensor pipeline may generate standard dynamic range (SDR) data from HDR data captured by a sensor using tone mapping, for example local tone mapping. Information used to generate the SDR data may be provided to a display pipeline as metadata with the generated SDR data. If a target display does not support HDR imaging, the SDR data may be directly rendered by the display pipeline. If the target display does support HDR imaging, then an inverse mapping technique may be applied to the SDR data according to the metadata to render HDR data for display. Information used in performing color gamut mapping may also be provided in the metadata and used to recover clipped colors for display.

Abstract translation: 视频处理技术和管道支持将HDR动态范围（HDR）图像数据捕获，分配和显示到支持HDR的显示设备和不支持HDR成像的显示设备。 传感器管线可以从使用色调映射的传感器捕获的HDR数据（例如本地色调映射）生成标准动态范围（SDR）数据。 用于生成SDR数据的信息可以作为具有生成的SDR数据的元数据提供给显示管道。 如果目标显示不支持HDR成像，则SDR数据可以由显示管道直接呈现。 如果目标显示确实支持HDR成像，则可以根据元数据将逆映射技术应用于SDR数据，以呈现HDR数据进行显示。 用于执行色域映射的信息也可以在元数据中提供，并用于恢复被剪辑的颜色以供显示。

公开(公告)号：US20150243243A1

公开(公告)日：2015-08-27

申请号：US14631398

申请日：2015-02-25

Applicant: Apple Inc.

Inventor： Kenneth I. Greenebaum ,  Haitao Guo ,  Hao Pan ,  Guy Cote ,  Andrew Bai

IPC: G09G5/00 ,  G09G3/20 ,  H04N1/60 ,  H04N9/67 ,  H04N9/64 ,  G06T5/00 ,  H04N5/50

Abstract: Adaptive video processing for a target display panel may be implemented in or by a server/encoding pipeline. The adaptive video processing methods may obtain and take into account video content and display panel-specific information including display characteristics and environmental conditions (e.g., ambient lighting and viewer location) when processing and encoding video content to be streamed to the target display panel in an ambient setting or environment. The server-side adaptive video processing methods may use this information to adjust one or more video processing functions as applied to the video data to generate video content in the color gamut and dynamic range of the target display panel that is adapted to the display panel characteristics and ambient viewing conditions.

Abstract translation: 用于目标显示面板的自适应视频处理可以在服务器/编码流水线中或由服务器/编码流水线实现。 当处理和编码要流式传输到目标显示面板的视频内容时，自适应视频处理方法可以获得并考虑视频内容和显示面板特定信息，包括显示特性和环境条件（例如，环境照明和观看者位置） 环境设置或环境。 服务器侧自适应视频处理方法可以使用该信息来调整应用于视频数据的一个或多个视频处理功能，以生成适合于显示面板特征的目标显示面板的色域和动态范围中的视频内容 和环境观察条件。

公开(公告)号：US20210235093A1

公开(公告)日：2021-07-29

申请号：US17233099

申请日：2021-04-16

Applicant: Apple Inc.

Inventor： Haitao Guo ,  Hao Pan ,  Guy Cote ,  Andrew Bai

IPC: H04N19/14 ,  G06F3/14 ,  G09G5/02 ,  G09G5/10 ,  H04N1/64 ,  H04N5/20 ,  H04N5/235 ,  H04N19/172 ,  H04N19/102 ,  H04N19/137 ,  H04N19/177 ,  H04N19/124 ,  H04N19/154 ,  H04N19/17 ,  H04N19/98 ,  H04N21/422 ,  H04N21/431 ,  G06T5/00 ,  G09G3/20 ,  G09G5/00 ,  H04N1/60 ,  H04N5/50 ,  H04N9/64 ,  H04N9/67 ,  H04N19/136 ,  H04N19/184 ,  H04N19/186 ,  H04N19/169 ,  H04N19/44 ,  H04N19/30 ,  H04N19/33 ,  H04N19/176 ,  H04N19/182 ,  H04N19/52

Abstract: Video processing techniques and pipelines that support capture, distribution, and display of high dynamic range (HDR) image data to both HDR-enabled display devices and display devices that do not support HDR imaging. A sensor pipeline may generate standard dynamic range (SDR) data from HDR data captured by a sensor using tone mapping, for example local tone mapping. Information used to generate the SDR data may be provided to a display pipeline as metadata with the generated SDR data. If a target display does not support HDR imaging, the SDR data may be directly rendered by the display pipeline. If the target display does support HDR imaging, then an inverse mapping technique may be applied to the SDR data according to the metadata to render HDR data for display. Information used in performing color gamut mapping may also be provided in the metadata and used to recover clipped colors for display.

公开(公告)号：US20190182487A1

公开(公告)日：2019-06-13

申请号：US16277892

申请日：2019-02-15

Applicant: Apple Inc.

Inventor： Haitao Guo ,  Hao Pan ,  Guy Cote ,  Andrew Bai

IPC: H04N19/14 ,  G09G3/20 ,  H04N5/50 ,  G06T5/00 ,  H04N19/136 ,  H04N19/184 ,  H04N19/186 ,  H04N19/169 ,  H04N19/44 ,  H04N19/30 ,  H04N19/33 ,  H04N19/176 ,  H04N19/182 ,  H04N19/52 ,  H04N5/20 ,  H04N21/422 ,  H04N19/172 ,  H04N21/431 ,  H04N19/102 ,  H04N19/98 ,  H04N19/137 ,  H04N19/177 ,  H04N9/64 ,  G09G5/10 ,  G09G5/02 ,  G06F3/14 ,  H04N5/235 ,  G09G5/00 ,  H04N19/17 ,  H04N9/67 ,  H04N19/154 ,  H04N19/124 ,  H04N1/60 ,  H04N1/64

Abstract: Video processing techniques and pipelines that support capture, distribution, and display of high dynamic range (HDR) image data to both HDR-enabled display devices and display devices that do not support HDR imaging. A sensor pipeline may generate standard dynamic range (SDR) data from HDR data captured by a sensor using tone mapping, for example local tone mapping. Information used to generate the SDR data may be provided to a display pipeline as metadata with the generated SDR data. If a target display does not support HDR imaging, the SDR data may be directly rendered by the display pipeline. If the target display does support HDR imaging, then an inverse mapping technique may be applied to the SDR data according to the metadata to render HDR data for display. Information used in performing color gamut mapping may also be provided in the metadata and used to recover clipped colors for display.

公开(公告)号：US20150245043A1

公开(公告)日：2015-08-27

申请号：US14631394

申请日：2015-02-25

Applicant: APPLE INC.

Inventor： Kenneth I. Greenebaum ,  Haitao Guo ,  Hao Pan ,  Guy Cote ,  Andrew Bai

IPC: H04N19/186 ,  H04N19/184 ,  H04N19/136 ,  H04N19/169 ,  H04N19/44

CPC classification number: H04N19/14 ,  G06F3/1454 ,  G06T5/009 ,  G06T2207/20208 ,  G09G3/2007 ,  G09G5/005 ,  G09G5/02 ,  G09G5/10 ,  G09G2320/0261 ,  G09G2320/0271 ,  G09G2320/0613 ,  G09G2320/062 ,  G09G2320/0626 ,  G09G2320/066 ,  G09G2320/0666 ,  G09G2320/0673 ,  G09G2320/0686 ,  G09G2320/0693 ,  G09G2320/08 ,  G09G2320/103 ,  G09G2340/02 ,  G09G2360/144 ,  G09G2370/042 ,  H04N1/6066 ,  H04N1/64 ,  H04N5/20 ,  H04N5/2355 ,  H04N5/505 ,  H04N9/641 ,  H04N9/67 ,  H04N19/102 ,  H04N19/124 ,  H04N19/136 ,  H04N19/137 ,  H04N19/154 ,  H04N19/17 ,  H04N19/172 ,  H04N19/176 ,  H04N19/177 ,  H04N19/182 ,  H04N19/184 ,  H04N19/186 ,  H04N19/188 ,  H04N19/30 ,  H04N19/33 ,  H04N19/44 ,  H04N19/463 ,  H04N19/52 ,  H04N19/86 ,  H04N19/98 ,  H04N21/42202 ,  H04N21/4223 ,  H04N21/4318 ,  H04N21/44008 ,  H04N21/4402 ,  H04N21/44218 ,  H04N21/4854

Abstract: Adaptive video processing for a target display panel may be implemented in or by a decoding/display pipeline associated with the target display panel. The adaptive video processing methods may take into account video content, display characteristics, and environmental conditions including but not limited to ambient lighting and viewer location when processing and rendering video content for a target display panel in an ambient setting or environment. The display-side adaptive video processing methods may use this information to adjust one or more video processing functions as applied to the video data to render video for the target display panel that is adapted to the display panel according to the ambient viewing conditions.

Abstract translation: 用于目标显示面板的自适应视频处理可以在与目标显示面板相关联的解码/显示管道中或由其执行。 自适应视频处理方法可以在环境设置或环境中处理和呈现目标显示面板的视频内容时考虑视频内容，显示特性和环境条件，包括但不限于环境照明和观看者位置。 显示侧自适应视频处理方法可以使用该信息来调整应用于视频数据的一个或多个视频处理功能，以根据环境观看条件为适用于显示面板的目标显示面板渲染视频。