-
公开(公告)号:US20220092400A1
公开(公告)日:2022-03-24
申请号:US17543551
申请日:2021-12-06
Applicant: Intel Corporation
Inventor: Noam Elron , Ben Berlin , Dmitry Rudoy , Amir Goren , Noam Levy
Abstract: A method, system, and article of highly efficient neural network video image processing uses temporal correlations.
-
公开(公告)号:US20240046427A1
公开(公告)日:2024-02-08
申请号:US18486554
申请日:2023-10-13
Applicant: Intel Corporation
Inventor: Noam Elron
IPC: G06T5/00
CPC classification number: G06T5/002 , G06T2207/20081
Abstract: An unsupervised technique for training a deep learning based temporal noise reducer on unlabeled real-world data. The unsupervised technique can also be used to calibrate the free parameters of a TNR based on algorithmic principles. The training is based on actual real-world video (which may include noise), and not based on video containing artificial or added noise. Using the unsupervised technique to train a TNR allows the TNR to be tailored to the noise statistics of the use-case, resulting in the provision of high quality video with minimal resources.
The TNR can be based on an uncalibrated TNR's output in time-reverse, as well as the uncalibrated TNR's output in time-forward. The frames used for both the time-forward output and the time-reversed output can be frames from the past. The TNR is calibrated to minimize the difference between its time-forward output and its time-reversed output.-
公开(公告)号:US20210233210A1
公开(公告)日:2021-07-29
申请号:US17213489
申请日:2021-03-26
Applicant: Intel Corporation
Inventor: Noam Elron , Alexander Itskovich , Shahar S Yuval , Noam Levy
Abstract: A method, system, and article is directed to real-time super-resolution image processing using neural networks.
-
4.
公开(公告)号:US11688070B2
公开(公告)日:2023-06-27
申请号:US16911937
申请日:2020-06-25
Applicant: INTEL CORPORATION
Inventor: Amir Goren , Noam Elron , Noam Levy
IPC: G06T7/11 , G06T3/40 , G06T7/194 , G06N3/02 , G06T5/00 , G06V20/40 , G06V40/16 , G06F18/214 , G06V10/82 , G06V10/44 , G06V10/26
CPC classification number: G06T7/11 , G06F18/214 , G06N3/02 , G06T3/4046 , G06T5/002 , G06T7/194 , G06V10/26 , G06V10/454 , G06V10/82 , G06V20/40 , G06V20/49 , G06V40/165 , G06T2207/10016 , G06T2207/20081 , G06T2207/20084 , G06V40/161
Abstract: An example apparatus for video frame segmentation includes a receiver to receive a current video frame to be segmented. The apparatus also includes a segmenting neural network to receive a previous mask including a segmentation mask corresponding to a previous frame and generate a segmentation mask for the current frame based on the previous mask and the video frame.
-
公开(公告)号:US10735769B2
公开(公告)日:2020-08-04
申请号:US16141419
申请日:2018-09-25
Applicant: Intel Corporation
Inventor: Noam Levy , Liron Lvov , Noam Elron , Oskar Pelc , Shahar S. Yuval
IPC: H04N19/615 , H04N19/513 , H04N19/176 , H04N19/137 , H04N19/105 , H04N19/30 , H04N19/587 , H04N19/85
Abstract: Techniques related to temporal noise reduction in captured video are discussed. Such techniques include performing motion estimation on a portion of a downsampled current frame performed during the downsampling of the current frame, replacing one or more of the resultant motion vectors based on confidence scores of the resultant motion vector, and blending the current frame and a temporally previous frame to generate a temporally filtered current frame. The temporally filtered current frame may be displayed to a user and/or encoded to generate a bitstream.
-
公开(公告)号:US20250005765A1
公开(公告)日:2025-01-02
申请号:US18342549
申请日:2023-06-27
Applicant: Intel Corporation
Inventor: Dmitry Rudoy , Rakefet Kol , Noam Elron , Noam Levy
Abstract: Systems, apparatus, articles of manufacture, and methods are disclosed to process images using segmentation. An example apparatus includes interface circuitry, machine readable instructions, and programmable circuitry to at least one of instantiate or execute the machine readable instructions to generate a scaled frame from an input video frame, segment, with a neural network, the scaled frame to generate a scaled segmentation map based on the scaled frame, the scaled segmentation map to associate pixels of the scaled frame with ones of a plurality of segments in the scaled frame, and generate an output video frame based on the input video frame and an upscaled version of the scaled segmentation map.
-
公开(公告)号:US20250005709A1
公开(公告)日:2025-01-02
申请号:US18882214
申请日:2024-09-11
Applicant: Intel Corporation
Inventor: Noam Elron , Alexander Itskovich , Shahar S Yuval , Noam Levy
IPC: G06T3/4053 , G06N3/08 , G06T3/4046 , G06T5/50 , G06T5/70
Abstract: Example methods, apparatus, systems, and articles directed to real-time super-resolution image processing using neural networks are disclosed. Example apparatus disclosed herein cause a neural network to process an input frame of input video, the input video having a first resolution, the neural network trained to upscale the input frame to a second resolution, the neural network trained to reduce a presence of one or more types of image imperfections in the input frame. Disclosed example apparatus also obtain, from the neural network, an output frame at the second resolution. Disclosed example apparatus further cause the output frame to be presented as part of an output video at the second resolution.
-
公开(公告)号:US20240249392A1
公开(公告)日:2024-07-25
申请号:US18583642
申请日:2024-02-21
Applicant: Intel Corporation
Inventor: Dmitry Rudoy , Rakefet Kol , Noam Elron , Noam Levy
CPC classification number: G06T5/50 , G06T3/40 , G06T5/20 , G06T7/10 , G06T2207/20084 , G06T2207/20221
Abstract: A high-level understanding of the scene captured by a camera allows for the use of scene-level understanding in the processing of the captured image. A downscaled image of a captured scene is generated and used as a basis for artificial intelligence analysis before the full image of the captured scene is processed. The downscaled image is generated concurrently with the capturing of the raw image at the image sensor and before full image signal processor (ISP) processing. Neural networks and other AI algorithms can be applied directly to the downscaled image to perform high-level understanding using minimal resources. The processing of the full scale captured image can be adapted to specific scenarios based on the understanding rather than undergoing all-purpose processing. The high-level understanding is provided to the full image processing pipe for enhancements in image quality, video conferencing, face detection, and other user experiences.
-
公开(公告)号:US11823352B2
公开(公告)日:2023-11-21
申请号:US16790456
申请日:2020-02-13
Applicant: INTEL CORPORATION
Inventor: Noam Elron
CPC classification number: G06T5/002 , G06F17/16 , G06F17/18 , G06N3/045 , G06N3/08 , G06T5/003 , G06T2207/10016 , G06T2207/10024 , G06T2207/20081 , G06T2207/20084
Abstract: An example apparatus for video imaging includes a feature estimator to calculate a local value of a feature for averaging in a compressed set of features of a current frame. The apparatus also includes a validator to calculate a validity map comprising a weight for frame-wide averaging based on the compressed current frame. The apparatus further includes a vector generator to generate a state vector based on the local value of the feature and the weight. The apparatus further includes a relevance calculator to calculate a relevance to local processing for each coordinate in a restored state vector associated with a previous frame. The apparatus further includes a vector modulator to multiply the restored state vector by the relevance feature to generate a set of output features.
-
10.
公开(公告)号:US20200327334A1
公开(公告)日:2020-10-15
申请号:US16911937
申请日:2020-06-25
Applicant: INTEL CORPORATION
Inventor: Amir Goren , Noam Elron , Noam Levy
Abstract: An example apparatus for video frame segmentation includes a receiver to receive a current video frame to be segmented. The apparatus also includes a segmenting neural network to receive a previous mask including a segmentation mask corresponding to a previous frame and generate a segmentation mask for the current frame based on the previous mask and the video frame.
-
-
-
-
-
-
-
-
-