摘要:
A structure of metadata relevant to a moving image, in which metadata editing is easily performed, comprising a stream data structure including one or more access units each capable of being independently processed; each of said access units has: first data for a reference time point within an access unit time for describing the metadata so as to cause the access unit time to correspond to a moving image time; an object area data describing a spatio-temporal region in the moving image; and second data for specifying a display method relevant to the spatio-temporal region and/or a processing when the spatio-temporal region is designated. The moving image time is to be made to correspond to the access unit time on basis of the reference time point in the first data, so that a period during which at least said second data may be called is specified.
摘要:
In order to assist a viewer in understanding the contents of a moving image, it is desired to plainly represent the contents of metadata to the viewer. The metadata relevant to the moving image has a stream data structure including one or more access units each being a data unit which can be independently processed. Each of the access units includes first data to specify an effective period defined with respect to a time axis of the moving image, object area data describing a spatio-temporal region in the moving image, and balloon data to display relevant data of the object by a balloon. The balloon data includes text data to be displayed in the inside of the balloon and to express the contents of the object and position specifying data to specify a display position of the balloon.
摘要:
Since there is a case where reproduction of metadata is limited according to the processing power of a reproduction apparatus or the designation from a user, the invention provides a data structure in which metadata whose preferential reproduction is desired can be selected and reproduced. The metadata relevant to a moving image includes a stream data structure including one or more access units each being a data unit which can be independently processed, and each of the access units includes first data to specify an effective period defined with respect to a time axis of the moving image, object area data describing a spatio-temporal region in the moving image, second data including one of or both of data to specify a display method relevant to the spatio-temporal region and data to specify a processing to be performed when the spatio-temporal region is specified, and third data to specify, in a case where one or more access units exist on a same screen in the moving image at a time of reproduction of the metadata, reproduction priority of each of the access units.
摘要:
In the case where metadata refers to relevant content on a network, since the relevant content on the network can not be necessarily permanently held, it is desirable that a time limit for making reference can be set. Besides, in order to provide relevant content which can be referred to only in a limited period for promoting sales, or in order to provide relevant content which can be referred to only in a limited period such as, for example, Christmas Day every year for raising the entertainingness of the metadata, it is desirable that a reference time limit of the relevant content can be set. Then, in order to set an effective time limit of an access unit, a flag to specify the effective time limit and the effective time limit are described in each access unit.
摘要:
Although it is necessary to display a mouse cursor in order to specify an object area in a moving image, there is a fear that a standard cursor spoils the atmosphere of the moving image or the intention of a producer. Then, a data structure is desired in which the shape of the cursor can be freely specified according to the contents of the moving image or the object. In metadata of the moving image, the object area appearing in the moving image is divided into plural data (access units), and the access unit is made to be capable of specifying the cursor shape, and the cursor shape in the object area is made freely changeable.
摘要:
There is provided a structure of metadata which can express an object of a complicated shape. There are added vcr_shape_num indicating the number of sub-planar areas constituting an object area, vcr_rule_code indicating that an integration system to integrate the sub-planar areas and to determine a final object area is written, vcr_rule_length to indicate the length of data of the integration system, and data vcr_rule to indicate the integration system, and thereafter, vcr_subregion_data of data of each sub-planar area appearing in vcr_rule is described continuously by the number indicated by vcr_shape_num.
摘要:
An imaging device includes: a capturing unit that captures a motion picture at one of a plurality of frame rates; a buffer that temporary stores the motion picture captured by the capturing unit; a signal generation unit that generates a signal used for specifying a core frame that is to be subjected to a resolution enhancement processing, while the capturing unit captures the motion picture at a first frame rate; a capturing control unit that controls the capturing unit to capture the motion picture, after the core frame specified by the signal, at a second frame rate that is higher than the first frame rate; a reference frame determination unit that determines a frame stored in the buffering unit at the second frame rate as a reference frame; and an image processing unit that performs the resolution enhancement processing by converting the core frame into a high-resolution frame by reference to the reference frame determined by the reference frame determination unit.
摘要:
A super-resolution device and method for setting at least one of a plurality of pixels included in image data as target pixels, the image data including pixels arranged in a screen and pixel values representing brightness, an area including the target pixel and peripheral pixels as a target area, and an area for searching pixel value change patterns in the target pixel area; calculating a difference between a first change pattern and second change pattern; comparing a difference between the first and second change patterns; calculating a pixel value of a super-resolution image having a number of pixels larger than a number of pixels included in the image data on the basis of a decimal-accuracy-vector, an extrapolated vector, and pixel values obtained from the image data.
摘要:
A super-resolution device and method for setting at least one of a plurality of pixels included in image data as target pixels, the image data including pixels arranged in a screen and pixel values representing brightness, an area including the target pixel and peripheral pixels as a target area, and an area for searching pixel value change patterns in the target pixel area; calculating a difference between a first change pattern and second change pattern; comparing a difference between the first and second change patterns; calculating a pixel value of a super-resolution image having a number of pixels larger than a number of pixels included in the image data on the basis of a decimal-accuracy-vector, an extrapolated vector, and pixel values obtained from the image data.
摘要:
An image processing apparatus calculates estimated pixel values of respective pixels of a provisional high-resolution image by interpolation on basis of pixel values in a reference frame, segmentalizes interior of the reference frame into an edge region, a texture region or a flat region and other on basis of pixel values of respective pixels, sets the respective pixels in the reference frame as target pixels one by one in sequence, calculates corresponding positions on the provisional high-resolution image, of the respective target pixels in fractional pixel accuracy on basis of information on the segmented regions including the target values, modifies the estimated pixel values so that difference from the pixel values of the target pixels to provisionally estimated pixel values obtained from the estimated pixel values of the provisional high-resolution image for pixels around the corresponding positions of the target pixels, becomes smaller, and obtains modified pixel values.