Abstract:
An image processing apparatus (110) capable of causing the influence of a light source (350) that is in a captured scene to affect a background image of in-camera VFX video, is disclosed. The apparatus (110) acquires information relating to a light source (350) existing in real space captured by an image capture apparatus (200) and generates, based on a three-dimensional model of a virtual space, an image to be displayed on a display apparatus (310, 320) disposed in the real space. The apparatus (110) generates the image in which an influence exerted by light from the light source (350) on the virtual space has been affected.
Abstract:
A processor-implemented method includes obtaining an input image, predicting light source color information of a scene corresponding to the input image and a panoramic image corresponding to the input image using an image processing model, and generating a rendered image by rendering the input image based on either one or both of the light source color information and the panoramic image.
Abstract:
A method is provided for removing reflections from an image. Images of a scene and a geometry of the scene are obtained. For observed pixels in an image, the observed pixels are adapted by identifying corresponding pixels in other images which correspond to the same positon in the scene as the observed pixel, identifying light source pixels, corresponding to positions in the scene at which a light source is delivering light to the position in the scene which corresponds to the observed pixel and the corresponding pixels, and analyzing the texture values of the observed pixel, and corresponding pixels, and the light source pixels, to obtain an adapted texture value with reflections removed for the observed pixel.
Abstract:
Es wird das innere Volumen eines inhomogenen dreidimensionalen Objekts (OBJ) durch eine Vielzahl von simulierten Sehstrahlen (R1,...,R6) visualisiert. Dabei wird für einen jeweiligen, in das Objektvolumen (OV) eindringenden Sehstrahl (R1,...,R6) i) entlang des Sehstrahls (R1,...,R6) eine Streuposition bestimmt, ii) abhängig von einem Zufallsprozess eine Streurichtung ausgewählt und iii) der Sehstrahl (R1,...,R6) an der Streuposition in die ausgewählte Streurichtung gestreut. Die Schritte i) bis iii) werden wiederholt, bis der Sehstrahl (R1,...,R6) im Objektvolumen (OV) absorbiert wird oder aus dem Objektvolumen (OV) austritt, wobei der austretende Sehstrahl auf eine Beleuchtungsquelle (LP1,...,LP3, LS1, LS2) trifft und abhängig von einem Helligkeits- und/oder Farbwert der Beleuchtungsquelle (LP1,...,LP3, LS1, LS2) ein Beleuchtungsbeitrag des Sehstrahls (R1,...,R6) zu einem jeweiligen Visualisierungspixel ermittelt wird. Über die jeweiligen Beleuchtungsbeiträge der Vielzahl von Sehstrahlen (R1,...,R6) wird statistisch gemittelt, um einen Helligkeits- und/oder Farbwert für das jeweilige Visualisierungspixel zu ermitteln.
Abstract:
For three-dimensional rendering (32), a machine-learnt model is trained (14) to generate representation vectors for rendered images formed with different rendering parameter settings. The distances between representation vectors of the images to a reference are used to select (36) the rendered image and corresponding rendering parameters that provides a consistency with the reference. In an additional or different embodiment, optimized pseudorandom sequences are used for physically-based rendering (52). The random number generator seed is selected (46) to improve the convergence speed of the renderer and to provide higher quality images, such as providing images more rapidly for training compared to using non-optimized seed selection.
Abstract:
Data visualization systems and methods for generating 3D visualizations of a multidimensional data space are described. In one embodiment a 3D data visualization application directs a processing system to: load a set of multidimensional data points into a visualization table; create representations of a set of 3D objects corresponding to the set of data points; receive mappings of data dimensions to visualization attributes; determine the visualization attributes of the set of 3D objects based upon the selected mappings of data dimensions to 3D object attributes; update a visibility dimension in the visualization table for each of the plurality of 3D object to reflect the visibility of each 3D object based upon the selected mappings of data dimensions to visualization attributes; and interactively render 3D data visualizations of the 3D objects within the virtual space from viewpoints determined based upon received user input.
Abstract:
A 3D scene (2) illuminated by light sources (L1, L2) is rendered on an image grid (3) by path tracing. At least one ray originating from each grid pixel (P1A, P1B, P2) is traced in the 3D scene until it meets an object (21, 22) at a crossing point (M1A, M1B, M2), that ray is bounced towards one of the light sources, a visibility test is made for that ray between the crossing point and that light source, and a contribution of that light ray is added at the crossing point in carrying out the rendering at the concerned pixel. The visibility tests are carried out over the pixels in a clustered way according to the light sources, the visibility tests being clustered in terms of computations and/or of memory storage in function of the light sources respectively associated with the visibility tests. Application to a GPU.
Abstract:
An image processor, a lighting processor, and a method therefore are provided. According to one aspect of the invention, the lighting processor can extract information related to defuse lighting applied to a real object using a colored image and a depth image of the real object. The lighting processor can recover the diffuse image for the real object using the extracted information related to diffuse lighting, and generate either a speculum image or a shadow image using the recovered diffuse image and the colored image.
Abstract:
An information processing apparatus obtains an incident radiance at a shading point by obtaining a light emission radiance of a target light source expressed by a spherical Gaussian (SG expressed), approximating by a spherical Gaussian (SG approximating) a function indicating a spread of the target light source from a perspective of the shading point, and obtaining the product of these. Also, the apparatus SG approximates a bidirectional reflection distribution function (BRDF) at a shading point, and calculates the radiance at the shading point based on information indicating the viewpoint for which the shading point is to be rendered, an incident radiance at the shading point, and the SG approximated BRDF at the shading point.