Abstract:
In an example method for training image signal processors, a reconstructed image is generated via an image signal processor based on a sensor image. An intermediate loss function is generated based on a comparison of an output of one or more corresponding layers of a computer vision network and a copy of the computer vision network. The output of the computer vision network is based on the reconstructed image. An image signal processor is trained based on the intermediate loss function.
Abstract:
An example apparatus for processing images includes a hybrid infinite impulse response—finite impulse response (IIR-FIR) convolution block to receive an image and generate processed image information. The hybrid IIR-FIR convolution block includes a vertical infinite impulse response (IIR) component to approximate a vertical convolution when processing the image.
Abstract:
Techniques related to computer vision tasks are discussed. Such techniques include applying a pretrained non-linear transform and pretrained details boosting factor to generate an enhanced image from an input image and reducing the bit depth of the enhanced image prior to applying a pretrained computer vision network to perform the computer vision task.
Abstract:
Techniques related to approximate nearest neighbor searching are discussed. Such techniques may include traversing an approximate nearest neighbor search tree from root node to a resultant leaf node while maintaining a priority queue of best matches, determining candidate entries for evaluation based on the resultant leaf node, and generating search results based on the priority queue and the candidate entries.
Abstract:
Techniques related to generating downscaled image or image frame data in a luma chroma separated color space for an image or video pipeline architecture are discussed. Such techniques may include converting input image data to the luma chroma separated color space based on adaptive color coefficients determined based on an illumination indicator associated with the input image data and storing downscaled color converted image data to an input image buffer of the image or video pipeline.
Abstract:
System, apparatus, method, and computer readable media for texture enhanced non-local means (NLM) image denoising. In embodiments, detail is preserved in filtered image data through a blending between the noisy input target pixel value and the NLM pixel value that is driven by self-similarity and further informed by an independent measure of local texture. In embodiments, the blending is driven by one or more blending weight or coefficient that is indicative of texture so that the level of detail preserved by the enhanced noise reduction filter scales with the amount of texture. Embodiments herein may thereby denoise regions of an image that lack significant texture (i.e. are smooth) more aggressively than more highly textured regions. In further embodiments, the blending coefficient is further determined based on similarity scores of candidate patches with the number of those scores considered being based on the texture score.
Abstract:
An apparatus to facilitate partially-frozen neural networks for efficient computer vision systems is disclosed. The apparatus includes a frozen core to store fixed weights of a machine learning model, one or more trainable cores coupled to the frozen core, the one or more trainable cores comprising multipliers for trainable weights of the machine learning model, and wherein the alpha blending layer includes a trainable alpha blending parameter, and wherein the trainable alpha blending parameter is a function of a trainable parameter, a sigmoid function, and outputs of frozen and trainable blocks in a preceding layer of the machine learning model.
Abstract:
Techniques related to generating dictionaries for example based image processing algorithms are discussed. Such techniques may include iteratively performing example based image processing for candidate look up entries of candidate pairs from a training set database using a current dictionary to determine a test result for each of the look up entries of the candidate pairs and selecting one or more of the candidate pairs for entry in a resultant dictionary based on an error between the test result and a predetermined result entry for the candidate pairs.
Abstract:
Techniques related to generating downscaled image or image frame data in a luma chroma separated color space for an image or video pipeline architecture are discussed. Such techniques may include converting input image data to the luma chroma separated color space based on adaptive color coefficients determined based on an illumination indicator associated with the input image data and storing downscaled color converted image data to an input image buffer of the image or video pipeline.
Abstract:
A processor includes a front end including a decoder, an execution unit including a shift-sum multiplier (SSM), and a retirement unit. The decoder includes logic identify a multiplication instruction to multiply a first number and a second number. The execution unit includes logic to, based on the instruction, access a look-up table based on the second number to determine a plurality of shift parameters and one or more flag parameters. The SSM includes logic to use the shift parameters to shift the first number to determine a plurality of partial products, and the flag parameters to determine signs of the partial products. The SSM also includes logic to sum the partial products to yield a result of the multiplication instruction.