-
公开(公告)号：US20220309616A1
公开(公告)日：2022-09-29
申请号：US17841387
申请日：2022-06-15
申请人： Apple Inc.
发明人： Jim C. Chou , Yun Gong
摘要： Methods and systems include neural network-based image processing and blending circuitry to blend an output of the neural network to compensate for potential artifacts from the neural network-based image processing. The neural network(s) apply image processing to image data using one or more neural networks as processed data. Enhance circuitry enhances the image data in a scaling circuitry to generate enhanced data. Blending circuitry receives the processed image data and the enhanced data along with an image plane of the processed data. The blending circuitry also determines whether the image processing using the one or more neural networks has applied a change to the image data greater than a threshold amount. The blending circuitry then, based at least in part in response to the change being greater than the threshold amount and/or edge information of the image data, blends the processed data with the enhanced data.
-
公开(公告)号：US11308582B2
公开(公告)日：2022-04-19
申请号：US16844951
申请日：2020-04-09
申请人： Apple Inc.
发明人： Jim Chen Chou , Chenge Li , Yun Gong
摘要： Embodiments relate to a super-resolution engine that converts a lower resolution input image into a higher resolution output image. The super-resolution engine includes a directional scaler, an enhancement processor, a feature detection processor, a blending logic circuit, and a neural network. The directional scaler generates directionally scaled image data by upscaling the input image. The enhancement processor generates enhanced image data by applying an example-based enhancement, a peaking filter, or some other type of non-neural network image processing scheme to the directionally scaled image data. The feature detection processor determines features indicating properties of portions of the directionally scaled image data. The neural network generates residual values defining differences between a target result of the super-resolution enhancement and the directionally scaled image data. The blending logic circuit blends the enhanced image data with the residual values according to the features.
-
公开(公告)号：US20210287344A1
公开(公告)日：2021-09-16
申请号：US17331602
申请日：2021-05-26
申请人： Apple Inc.
发明人： Jim C. Chou , Yun Gong
摘要： An electronic device may include scaling circuitry to scale input pixel data to a greater resolution. The directional scaling circuitry may include first interpolation circuitry to receive best mode data, including one or more angles corresponding to content of the image and interpolate first pixel values at first pixel positions diagonally offset from input pixel positions of the input pixel data based on the best mode data and input pixel values corresponding to the input pixel positions. The directional scaling circuitry may also include second interpolation circuitry to receive the best mode data and the input pixel values and interpolate second pixel values at second pixel positions horizontally or vertically offset from the input pixel positions based at least in part on the best mode data and the input pixel values.
-
公开(公告)号：US20240233094A1
公开(公告)日：2024-07-11
申请号：US18416654
申请日：2024-01-18
申请人： Apple Inc.
发明人： Jim C. Chou , Yun Gong
IPC分类号： G06T5/70 , G06T3/4007 , G06T5/50
CPC分类号： G06T5/70 , G06T3/4007 , G06T5/50 , G06T2207/20192 , G06T2207/20216
摘要： An electronic device may include scaling circuitry to scale input pixel data to a greater resolution. The directional scaling circuitry may include first interpolation circuitry to receive best mode data, including one or more angles corresponding to content of the image and interpolate first pixel values at first pixel positions diagonally offset from input pixel positions of the input pixel data based on the best mode data and input pixel values corresponding to the input pixel positions. The directional scaling circuitry may also include second interpolation circuitry to receive the best mode data and the input pixel values and interpolate second pixel values at second pixel positions horizontally or vertically offset from the input pixel positions based at least in part on the best mode data and the input pixel values.
-
公开(公告)号：US11367167B2
公开(公告)日：2022-06-21
申请号：US17000260
申请日：2020-08-21
申请人： Apple Inc.
发明人： Jim C. Chou , Yun Gong
摘要： Methods and systems include neural network-based image processing and blending circuitry to blend an output of the neural network to compensate for potential artifacts from the neural network-based image processing. The neural network(s) apply image processing to image data using one or more neural networks as processed data. Enhance circuitry enhances the image data in a scaling circuitry to generate enhanced data. Blending circuitry receives the processed image data and the enhanced data along with an image plane of the processed data. The blending circuitry also determines whether the image processing using the one or more neural networks has applied a change to the image data greater than a threshold amount. The blending circuitry then, based at least in part in response to the change being greater than the threshold amount and/or edge information of the image data, blends the processed data with the enhanced data.
-
公开(公告)号：US20220058773A1
公开(公告)日：2022-02-24
申请号：US17000260
申请日：2020-08-21
申请人： Apple Inc.
发明人： Jim C. Chou , Yun Gong
摘要： Methods and systems include neural network-based image processing and blending circuitry to blend an output of the neural network to compensate for potential artifacts from the neural network-based image processing. The neural network(s) apply image processing to image data using one or more neural networks as processed data. Enhance circuitry enhances the image data in a scaling circuitry to generate enhanced data. Blending circuitry receives the processed image data and the enhanced data along with an image plane of the processed data. The blending circuitry also determines whether the image processing using the one or more neural networks has applied a change to the image data greater than a threshold amount. The blending circuitry then, based at least in part in response to the change being greater than the threshold amount and/or edge information of the image data, blends the processed data with the enhanced data.
-
公开(公告)号：US20200294196A1
公开(公告)日：2020-09-17
申请号：US16844951
申请日：2020-04-09
申请人： Apple Inc.
发明人： Jim Chen Chou , Chenge Li , Yun Gong
摘要： Embodiments relate to a super-resolution engine that converts a lower resolution input image into a higher resolution output image. The super-resolution engine includes a directional scaler, an enhancement processor, a feature detection processor, a blending logic circuit, and a neural network. The directional scaler generates directionally scaled image data by upscaling the input image. The enhancement processor generates enhanced image data by applying an example-based enhancement, a peaking filter, or some other type of non-neural network image processing scheme to the directionally scaled image data. The feature detection processor determines features indicating properties of portions of the directionally scaled image data. The neural network generates residual values defining differences between a target result of the super-resolution enhancement and the directionally scaled image data. The blending logic circuit blends the enhanced image data with the residual values according to the features.
-
公开(公告)号：US12067674B2
公开(公告)日：2024-08-20
申请号：US17934138
申请日：2022-09-21
申请人： Apple Inc.
发明人： Yun Gong , Jim C Chou , Guy Cote
CPC分类号： G06T15/503 , G06T3/18
摘要： A device may include an electronic display to display an image frame based on blended image data and image processing circuitry to generate the blended image data by combining first image data and second image data via a blend operation. The blend operation may include receiving graphics alpha data indicative of a transparency factor to be applied to the first image data to generate a first layer of the blend operation. The blend operation may also include overlaying the first layer onto a second layer that is based on the second image data. Overlaying the first layer onto the second layer may include adding first pixels values of the first image data that include negative pixel values and are augmented by the transparency factor to second pixel values of the second image data to generate blended pixel values of the blended image data.
-
公开(公告)号：US11941785B2
公开(公告)日：2024-03-26
申请号：US17331602
申请日：2021-05-26
申请人： Apple Inc.
发明人： Jim C Chou , Yun Gong
IPC分类号： G06T5/00 , G06T3/40 , G06T3/4007 , G06T5/50
CPC分类号： G06T5/002 , G06T3/4007 , G06T5/50 , G06T2207/20192 , G06T2207/20216
摘要： An electronic device may include scaling circuitry to scale input pixel data to a greater resolution. The directional scaling circuitry may include first interpolation circuitry to receive best mode data, including one or more angles corresponding to content of the image and interpolate first pixel values at first pixel positions diagonally offset from input pixel positions of the input pixel data based on the best mode data and input pixel values corresponding to the input pixel positions. The directional scaling circuitry may also include second interpolation circuitry to receive the best mode data and the input pixel values and interpolate second pixel values at second pixel positions horizontally or vertically offset from the input pixel positions based at least in part on the best mode data and the input pixel values.
-
公开(公告)号：US11893711B2
公开(公告)日：2024-02-06
申请号：US17841387
申请日：2022-06-15
申请人： Apple Inc.
发明人： Jim C. Chou , Yun Gong
CPC分类号： G06T5/001 , G06T3/4046 , G06T3/4053 , G06T5/50 , G06T7/11 , G06T2207/20084 , G06T2207/20192 , G06T2207/20221
摘要： Methods and systems include neural network-based image processing and blending circuitry to blend an output of the neural network to compensate for potential artifacts from the neural network-based image processing. The neural network(s) apply image processing to image data using one or more neural networks as processed data. Enhance circuitry enhances the image data in a scaling circuitry to generate enhanced data. Blending circuitry receives the processed image data and the enhanced data along with an image plane of the processed data. The blending circuitry also determines whether the image processing using the one or more neural networks has applied a change to the image data greater than a threshold amount. The blending circuitry then, based at least in part in response to the change being greater than the threshold amount and/or edge information of the image data, blends the processed data with the enhanced data.
-
-
-
-
-
-
-
-
-
搜索结果
22 条记录 (耗时 0.015 秒)
