OPTIMIZING HIGH DYNAMIC RANGE IMAGES FOR PARTICULAR DISPLAYS

    公开(公告)号:US20190052908A1

    公开(公告)日:2019-02-14

    申请号:US16060274

    申请日:2016-12-21

    摘要: To enable practical and quick generation of a family of good looking HDR gradings for various displays on which the HDR image may need to be shown, we describe a color transformation apparatus (201) to calculate resultant colors (R2, G2, B2) of pixels of an output image (IM_MDR) for a display with a display peak brightness (PB_D) starting from input colors (R, G, B) of pixels of an input image (Im_in) having a maximum luma code corresponding to a first image peak brightness (PB_IM1) which is different from the display peak brightness, characterized in that the color transformation apparatus comprises: —a color transformation determination unit (102; 2501) arranged to determine a color transformation (TMF; g) as defined in color processing specification data (MET_1) comprising at least one tone mapping function (CC) received via a metadata input (116), which color transformation specifies how the luminances of pixels of the input image are to be converted into luminances for those pixels of a second image (IM_HDR) having corresponding to its maximum luma code a second image peak brightness (PB_IM2), which is different from the display peak brightness (PB_D) and the first image peak brightness (PB_IM1), and whereby the division of the first image peak brightness by the second image peak brightness is either larger than 2 or smaller than ½; —a scaling factor determination unit (200; 2603) arranged to determine a resultant common multiplicative factor (gt; Ls), the unit being arranged to apply determining along a direction (DIR) a position along a metric a position (M_PB_U) which corresponds with the display peak brightness (PB_D) and arranged to determine the resultant common multiplicative factor (gt; Ls) based on the position, and wherein the color transformation apparatus (201) further comprises: —a scaling multiplier (114) arranged to multiply each of the three color components of an RGB color representation of the input colors with the resultant common multiplicative factor (gt).

    ADJUSTMENT OF DISPLAY OPTIMIZATION BEHAVIOUR FOR HDR IMAGES

    公开(公告)号:US20220262293A1

    公开(公告)日:2022-08-18

    申请号:US17625354

    申请日:2020-06-30

    发明人: Rutger NIJLAND

    IPC分类号: G09G3/20

    摘要: To enable a better and more adjustable manner of HDR video display adaptation, applicants inventor contributed an image pixel luminance adaptation apparatus (500), comprising: a connection (501) to a comprised or connectable video decoder (207), which video decoder is arranged to receive an encoded high dynamic range image (Im_COD), which is encoded according to a first maximum codeable luminance (PB H), and which video decoder is arranged to receive metadata specifying at least one luma mapping function (F_ct; FL_50t1_1), which at least one luma mapping function specifies the offsets of luminances of a secondary image corresponding to the encoded high dynamic range image compared to the luminances of the same pixel positions as encoded in the encoded high dynamic range image, which secondary image has a second maximum codeable luminance (PB_S) which preferably is at least 4× smaller or larger than the first maximum codeable luminance (PB_H), and the video decoder being arranged to output a decoded high dynamic range image (Im_RHDR) and the luma mapping function; a display adaptation unit (401) arranged to receive a value of a display maximum luminance (PB_D) that a particular display can display as brightest pixel color, and an input luma mapping function, and the display adaptation unit being arranged to apply an algorithm which calculates at least one display adapted luma mapping function based on the input luma mapping function and the display maximum luminance (PD_D), wherein this at least one display adapted luma mapping function corresponds in shape to the input luma mapping function but lies closer to a 45 degree increasing diagonal of a graph of the input luma mapping function in perceptually uniformized axes, depending on the difference between the value of the display maximum luminance (PB_D) and the first maximum codeable luminance (PB_H) relative to the difference between the second maximum codeable luminance (PB_S) and the first maximum codeable luminance (PB_H); characterized in that the image pixel luminance adaptation apparatus comprises an alternative luma mapping function determination unit (502) arranged to determine an alternative luma mapping function (ALT_FL_50t1_1) and wherein the display adaptation unit (401) comprises a combination unit (503) which is arranged to combine the at least one luma mapping function (F_ct; FL_50t1_1) and the alternative luma mapping function (ALT_FL_50t1_1) into a combined luma mapping function (CMB_FL_50t1_1), and wherein the display adaptation unit is arranged to apply its algorithm on as input luma mapping function the combined luma mapping function; the image pixel luminance adaptation apparatus comprising a luma mapping unit (510) arranged to receive pixel lumas of the decoded high dynamic range image (Im_RHDR) and to apply to those pixel lumas the combined luma mapping function to obtain output lumas of an output image (Im_DA); the image pixel luminance adaptation apparatus comprising an output image or video communication cable or wireless channel, to which a display can be connected, and an output signal formatter (230) arranged to send the output image (Im_DA).

    COLOR SPACE AND DECODER FOR VIDEO
    3.
    发明申请
    COLOR SPACE AND DECODER FOR VIDEO 审中-公开
    彩色空间和视频解码器

    公开(公告)号:US20170054989A1

    公开(公告)日:2017-02-23

    申请号:US15119735

    申请日:2015-02-12

    摘要: Because we needed a new improved and very different color encoding space for being able to faithfully encode the presently emerging high dynamic range video for good quality rendering on emerging HDR displays such as the SIM2 display, the video encoder (300) with an input (308) to obtain a video from a video source (301) wherein pixel colors are encoded in an (XYZ) color encoding, the video encoder comprising an opto-electronic conversion unit (304) arranged to convert the luminances (Y) of the pixel colors into lumas (Y′) with a predetermined code allocation function (F), characterized in that the video encoder comprises a chromaticity determination unit (310), which is arranged to encode chromaticities (u″,v″) of pixel colors with lumas (Y′) below a predetermined threshold luma (E′) with a mathematical chromaticity definition which yields a maximum encodable saturation (S_bL) for a particular hue for pixel colors with a luma below the predetermined threshold luma (E′) which is lower than a maximum encodable saturation (S_bH) for the particular hue for a pixel color with a luma above the predetermined threshold luma (E′), and a constant maximum encodable saturation (S_bH) for pixels with colors of a particular hue and a luma equal to or larger than the predetermined threshold luma (E′).

    摘要翻译: 因为我们需要一个新的改进和非常不同的颜色编码空间,以便能够忠实地编码当前正在出现的高动态范围视频,以便在诸如SIM2显示器的新兴HDR显示器上实现良好质量渲染,具有输入的视频编码器(308) )以从视频源(301)获得视频,其中以(XYZ)颜色编码对像素颜色进行编码,所述视频编码器包括光电转换单元(304),其被配置为将像素颜色的亮度(Y) 以预定的码分配功能(F)进入亮度(Y'),其特征在于,所述视频编码器包括色度确定单元(310),其被配置为将像素颜色的色度(u“,v”)与亮度 Y')低于具有数学色度定义的预定阈值亮度(E'),其为具有低于预定阈值亮度(E')的像素颜色的特定色调产生最大可编码饱和度(S_bL) ch低于具有高于预定阈值亮度(E')的亮度的像素颜色的特定色调的最大可编码饱和度(S_bH),以及对于具有特定色调的颜色的像素的恒定最大可编码饱和度(S_bH),以及 等于或大于预定阈值亮度(E')的亮度。

    ENCODING AND DECODING HDR VIDEOS
    4.
    发明申请

    公开(公告)号:US20210019868A1

    公开(公告)日:2021-01-21

    申请号:US17061937

    申请日:2020-10-02

    IPC分类号: G06T5/00 H04N19/186 H04N19/60

    摘要: To enable a high quality HDR video communication, which can work by sending corresponding LDR images potentially via established LDR video communication technologies, which works well in practical situations, applicant has invented a HDR video decoder (600, 1100) arranged to calculate a HDR image (Im_RHDR) based on applying to a received 100 nit standard dynamic range image (Im_RLDR) a set of luminance transformation functions, the functions comprising at least a coarse luminance mapping (FC), which is applied by a dynamic range optimizer (603), and a mapping of the darkest value (0) of an intermediate luma (Y′HPS), being output of the dynamic range optimizer, to a received black offset value (Bk_off) by a range stretcher (604), the video decoder comprising a gain limiter (611, 1105) arranged to apply an alternate luminance transformation function to calculate a subset (502) of the darkest luminances of the HDR image, from corresponding darkest lumas (Y′_in) of the standard dynamic range image.

    OPTIMIZING HIGH DYNAMIC RANGE IMAGES FOR PARTICULAR DISPLAYS

    公开(公告)号:US20170330529A1

    公开(公告)日:2017-11-16

    申请号:US15533498

    申请日:2015-09-02

    IPC分类号: G09G5/02 H04N19/85 G09G3/20

    摘要: Color transformation apparatus (201) for calculating resultant colors (R2, G2, B2) of pixels of an output image for a display with a display peak brightness (PB_D) starting from input colors (R,G,B) of pixels of an input image first image peak brightness (PB_H) which is different from the display peak brightness, said color transformation apparatus comprising: a color transformation determination unit (102) arranged to determine a color transformation (g) from color processing specification data (MET) comprising at least one tone mapping function (CC) for at least a range of pixel luminances received via a metadata input (116), which color transformation specifies the calculation of at least some pixel colors of an image having corresponding to its maximum luma code a second image peak brightness (PB_L), which is different from the display peak brightness (PB_D) and the first image peak brightness (PB_H), and whereby the division of the first image peak brightness by the second image peak brightness is either larger than 2 or smaller than ½; a scaling factor determination unit (200) arranged to determine a resultant common multiplicative factor (gt), said scaling factor determination unit comprising:—a capability metric determination unit arranged to determine a metric for locating positions of display peak brightnesses between the first image peak brightness (PB_H), and the second image peak brightness (PB_L) and outside that range; and—a resultant multiplier determination unit arranged to determine from the display peak brightness (PB_D), the metric, and the color transformation the resultant common multiplicative factor (gt), and wherein the color transformation apparatus (201) further comprises a scaling multiplier (114) arranged to multiply a linear RGB color representation of the input colors with the resultant common multiplicative factor (gt).

    OPTIMIZING HIGH DYNAMIC RANGE IMAGES FOR PARTICULAR DISPLAYS

    公开(公告)号:US20210174761A1

    公开(公告)日:2021-06-10

    申请号:US17106226

    申请日:2020-11-30

    摘要: To enable practical and quick generation of a family of good looking HDR gradings for various displays on which the HDR image may need to be shown, we describe color transformation apparatus (201) to calculate resultant colors (R2, G2, B2) of pixels of an output image (IM_MDR) for a display with a display peak brightness (PB_D) starting from input colors (R,G,B) of pixels of an input image (Im_in) having a maximum luma code corresponding to a first image peak brightness (PB_IM1) which is different from the display peak brightness, characterized in that the color transformation apparatus comprises: a color transformation determination unit (102) arranged to determine a color transformation (TMF; g) from color processing specification data (MET_1) comprising at least one tone mapping function (CC) for at least a range of pixel luminances received via a metadata input (116), which color transformation specifies the calculation of at least some pixel colors of an image (IM_GRAD_LXDR) having corresponding to its maximum luma code a second image peak brightness (PB_IM2), which is different from the display peak brightness (PB_D) and the first image peak brightness (PB_IM1), and whereby the division of the first image peak brightness by the second image peak brightness is either larger than 2 or smaller than ½; a scaling factor determination unit (200) arranged to determine a resultant common multiplicative factor (gt), by comprising: a capability metric determination unit (1303) arranged to determine a metric for locating positions of display peak brightnesses between the first image peak brightness (PB_IM1), and the second image peak brightness (PB_IM2) and outside that range; and a resultant multiplier determination unit (1310) arranged to determine from the display peak brightness (PB_D), the metric, and the color transformation the resultant common multiplicative factor (gt), and wherein the color transformation apparatus (201) further comprises a scaling multiplier (114) arranged to multiply a linear RGB color representation of the input colors with the resultant common multiplicative factor (gt).

    ENCODING AND DECODING HDR VIDEOS
    7.
    发明申请

    公开(公告)号:US20190130542A1

    公开(公告)日:2019-05-02

    申请号:US16085087

    申请日:2017-03-15

    IPC分类号: G06T5/00 H04N19/186 H04N19/60

    摘要: To enable a high quality HDR video communication, which can work by sending corresponding LDR images potentially via established LDR video communication technologies, which works well in practical situations, applicant has invented a HDR video decoder (600, 1100) arranged to calculate a HDR image (Im_RHDR) based on applying to a received 100 nit standard dynamic range image (Im_RLDR) a set of luminance 5 transformation functions, the functions comprising at least a coarse luminance mapping (FC), which is applied by a dynamic range optimizer (603), and a mapping of the darkest value (0) of an intermediate luma (Y′HPS), being output of the dynamic range optimizer, to a received black offset value (Bk_off) by a range stretcher (604), the video decoder comprising a gain limiter (611, 1105) arranged to apply an alternate luminance transformation function to 10 calculate a subset (502) of the darkest luminances of the HDR image, from corresponding darkest lumas (Y′_in) of the standard dynamic range image.

    HDR COLOR PROCESSING FOR SATURATED COLORS

    公开(公告)号:US20210266509A1

    公开(公告)日:2021-08-26

    申请号:US17184221

    申请日:2021-02-24

    发明人: Rutger NIJLAND

    摘要: To mitigate some problems of the pixel color mapping being used in HDR video decoding of the type of SLHDR, a high dynamic range video encoding circuit (300) is taught, configured to encode a high dynamic range image (IM_HDR) of a first maximum pixel luminance (PB_C1), together with a second image (Im_LWRDR) of lower dynamic range and corresponding lower second maximum pixel luminance (PB_C2), the second image being functionally encoded as a luma mapping function (400) for decoders to apply to pixel lumas (Y_PQ) of the high dynamic range image to obtain corresponding pixel lumas (PO) of the second image, the encoder comprising a data formatter (304) configured to output to a video communication medium (399) the high dynamic range image and metadata (MET) encoding the luma mapping function (400), the functional encoding of the second image being based also on a color lookup table (CL(Y_PQ)) which encodes a multiplier constant (B) for all possible values of the pixel lumas of the high dynamic range image, and the formatter being configured to output this color lookup table in the metadata, characterized in that the high dynamic range video encoding circuit comprises: —a gain determination circuit (302) configured to determine a luma gain value (G_PQ) which quantifies a ratio of an output image luma for a luma position equal to a correct normalized luminance position divided by an output luma for the luma of the pixel of the high dynamic range image, wherein the high dynamic range video encoding circuit comprises a color lookup table determination circuit (303) configured to determine the color lookup table (CL(Y_PQ)) based on values of the luma gain value for various lumas of pixels present in the high dynamic range image. Similarly we teach how the same principles can be embodied in a SLHDR-type video decoder.

    OPTIMIZING HIGH DYNAMIC RANGE IMAGES FOR PARTICULAR DISPLAYS

    公开(公告)号:US20190311694A1

    公开(公告)日:2019-10-10

    申请号:US16441284

    申请日:2019-06-14

    摘要: To enable practical and quick generation of a family of good looking HDR gradings for various displays on which the HDR image may need to be shown, we describe color transformation apparatus (201) to calculate resultant colors (R2, G2, B2) of pixels of an output image (IM_MDR) for a display with a display peak brightness (PB_D) starting from input colors (R,G,B) of pixels of an input image (Im_in) having a maximum luma code corresponding to a first image peak brightness (PB_IM1) which is different from the display peak brightness, characterized in that the color transformation apparatus comprises: a color transformation determination unit (102) arranged to determine a color transformation (TMF; g) from color processing specification data (MET_1) comprising at least one tone mapping function (CC) for at least a range of pixel luminances received via a metadata input (116), which color transformation specifies the calculation of at least some pixel colors of an image (IM_GRAD_LXDR) having corresponding to its maximum luma code a second image peak brightness (PB_IM2), which is different from the display peak brightness (PB_D) and the first image peak brightness (PB_IM1), and whereby the division of the first image peak brightness by the second image peak brightness is either larger than 2 or smaller than ½; a scaling factor determination unit (200) arranged to determine a resultant common multiplicative factor (gt), by comprising: a capability metric determination unit (1303) arranged to determine a metric for locating positions of display peak brightnesses between the first image peak brightness (PB_IM1), and the second image peak brightness (PB_IM2) and outside that range; and a resultant multiplier determination unit (1310) arranged to determine from the display peak brightness (PB_D), the metric, and the color transformation the resultant common multiplicative factor (gt), and wherein the color transformation apparatus (201) further comprises a scaling multiplier (114) arranged to multiply a linear RGB color representation of the input colors with the resultant common multiplicative factor (gt).

    HIGH DEFINITION AND HIGH DYNAMIC RANGE CAPABLE VIDEO DECODER
    10.
    发明申请
    HIGH DEFINITION AND HIGH DYNAMIC RANGE CAPABLE VIDEO DECODER 审中-公开
    高定义和高动态范围的视频解码器

    公开(公告)号:US20160366449A1

    公开(公告)日:2016-12-15

    申请号:US15119000

    申请日:2015-02-21

    摘要: Because we needed a new improved and very different color encoding space for being able to faithfully encode the presently emerging high dynamic range video for good quality rendering on emerging HDR displays such as the SIM2 display, we present around that new color space various new decoders which allow simplified processing, in particular the handling of all achromatic direction (i.e. luminance) optimization separate from the chromatic processing, and increased quality of the reconstructed HDR images. This is realized by a video decoder (350) having an input (358) for receiving a video signal (S_im) transmitted over a video transmission system or received on a video storage product, in which pixel colors are encoded with an achromatic luma (Y′) coordinate and two chromaticity coordinates (u″,v″), the video decoder comprising a scaling unit (356) arranged to transform the chromaticity colors into a luminance-dependent chrominance color representation, by scaling with the achromatic luma.

    摘要翻译: 因为我们需要一个新的改进和非常不同的颜色编码空间,以便能够忠实地编码目前正在出现的高动态范围视频,以便在诸如SIM2显示器的新兴HDR显示器上获得良好的质量渲染,我们围绕着这种新的色彩空间呈现各种新的解码器 允许简化的处理,特别是处理与彩色处理分开的所有消色方向(即,亮度)优化,以及提高重建的HDR图像的质量。 这是由具有输入(358)的视频解码器(350)来实现的,该输入端用于接收通过视频传输系统发送的或在视频存储产品上接收的视频信号(S_im),其中像素颜色用无色亮度(Y ')坐标和两个色度坐标(u“,v”),所述视频解码器包括经缩放单元(356),缩放单元(356)被布置为通过与所述消色差亮度缩放来将色度颜色变换为依赖于亮度的色度颜色表示。