Abstract:
An adaptive super sampling method includes: rendering frames of a three-dimensional (3D) model, the frames including a current frame and a previous frame preceding the current frame; determining motion vectors indicating a correspondence relationship between pixels in the current frame and pixels in the previous frame; generating a geometric identifier maps (G-ID maps) respectively corresponding to the current frame and the previous frame based on 3D geometrical properties associated with the pixels in the current frame and the previous frame; based on the motion vectors and the G-ID maps, generating an artifact map predicting where artifacts will occur from inter-frame super sampling of the current frame; and performing adaptive super sampling on the current frame based on the artifact map.
Abstract:
A supersampling method and apparatus are provided. The method includes: receiving a low-resolution three-dimensional (3D) image comprising a current frame and receiving a previous frame preceding the current frame; generating a low-resolution partial image by repeatedly sampling sub-pixel regions of the current frame; warping a high-resolution image, of the previous frame, which has been outputted from a neural network, to a current view corresponding to the current frame; replacing a partial region of the warped high-resolution image of the previous frame with image data from the low-resolution partial image; and generating a high-resolution image of the current frame by applying the high-resolution image of the previous frame, in which the partial region has been replaced, to the neural network.
Abstract:
A method includes: inserting new pixels between original pixels for each of maps included in a first geometry buffer (or G-buffer) generated from a frame, wherein the maps represent geometric information of a three-dimensional (3D) model of an object included in the frame; generating a second G-buffer by setting values of the new pixels using a motion vector map that may be one of the maps; generating a third G-buffer by combining, with the second G-buffer, a result of updating only values of pixels masked based on an output of a pixel masking neural network to which the second G-buffer may be input; generating a fourth G-buffer by updating values of pixels by inputting the third G-buffer to a G-buffer reconstruction neural network; and update, based on the fourth G-buffer, the resolution of a subsequent frame that follows the frame.
Abstract:
An electronic device includes a memory for storing a first neural network and a second neural network including a plurality of residual blocks and an upscaling block, and a processor for selecting a residual block from among the plurality of residual blocks for an input patch image of a first frame based on the second neural network and generating an output patch image of the first frame by upscaling the input patch image of the first frame to an image having a target resolution based on the selected residual block and the upscaling block.
Abstract:
A processor implemented method includes generating a semantic map indicating a visualization property assigned to an object of an obtained frame image having a first resolution and generating a reconstruction image using an image reconstruction machine learning model provided input based on the obtained frame image and the semantic map having a second resolution and including a second object having a visualization property indicated by the semantic map.
Abstract:
An apparatus is provided. The apparatus includes an input/output interface configured to receive an image and output a result, a memory storing one or more instructions for processing the image by using a convolutional neural network, and a processor configured to process the image by executing the one or more instructions, wherein the convolutional neural network (CNN) may include one or more spatial transformation modules, and the spatial transformation module may include a spatial transformer configured to apply a spatial transform to first input data that is the image or an output of a previous spatial transformation module, by using a spatial transformation function, a first convolutional layer configured to perform a convolution operation between the first input data to which the spatial transform is applied and a first filter, and a spatial inverse transformer configured to apply a spatial inverse transform to an output of the first convolutional layer.
Abstract:
A server for pose estimation of a person and an operating method of the server are provided. The operating method includes obtaining an original image including a person, generating a plurality of input images by rotating the original image, obtaining first pose estimation results respectively corresponding to the plurality of input images, by inputting the plurality of input images to a pose estimation model, applying weights to the first pose estimation results respectively corresponding to the plurality of input images, and obtaining a second pose estimation result, based on the first pose estimation results to which the weights are applied, wherein the first pose estimation results and the second pose estimation result each include data indicating main body parts of the person.
Abstract:
A method of operating an image processing apparatus is provided. The method includes generating a first feature map by performing a convolution operation between a first image and a first kernel group, generating a second feature map by performing a convolution operation between the first image and a second kernel group, generating a first combination map based on the first feature map, generating a second combination map based on the first feature map and the second feature map, generating a second image based on the first combination map and the second combination map, and generating a reconstructed image of the first image, based on the second image and the first image, and generating a high-resolution image of the first image by inputting the reconstructed image to an upscaling model.
Abstract:
Provided is a genetically engineered yeast cell with lactate production capacity, including an enzyme that catalyzes conversion of acetaldehyde to acetyl-CoA and an enzyme that catalyzes conversion of pyruvate to lactate, which activities are increased compared to a parent cell of the yeast cell, as well as a method of producing the genetically engineered yeast cell and method of producing lactate using the genetically engineered yeast cell.