Abstract:
An output device 10 is provided with an output unit 11 for outputting, on the basis of job feature information indicating the features of the job of a distributed processing system, estimation model application information that is information in a format suitable for an estimation model that estimates the amount of computer resources required for processing a task constituting the job. The estimation model application information may include word-containing information having binary information that indicates whether or not a character string indicated by the character string information included in the job feature information includes a prescribed word. The estimation model application information may include numerical inversion label information having, as string label information, a value derived by converting, by a prescribed function, the numeric value indicated by the numerical information included in the job feature information.
Abstract:
A distributed system (3000) includes processing servers (3200). A task is allocated to a processing server (3200). A speed information acquisition unit (2020) acquires speed information, which is information relating to a processing speed of the task in execution on the processing server (3200). An abnormality determination unit (2040) determines whether or not a processing speed of a task to be determined is abnormal using the speed information. When the processing speed of the task to be determined is determined to be abnormal by the abnormality determination unit (2040), an allocation exclusion unit (2060) temporarily excludes the processing server (3200) to which the task is allocated, from allocation targets of a new task.
Abstract:
A distributed processing management apparatus 10 is connected to a plurality of execution servers 20 so as to be able to communicate with the execution servers 20. The distributed processing management apparatus 10 is provided with a conversion instruction unit 11 configured to specify, for each execution server 20, a data format usable by a machine learning engine executed by the execution server 20, and issue an instruction to convert a data format of data held by the execution server 20 to the specified data format.
Abstract:
A computational resource management apparatus is for managing a cluster system that executes a plurality of tasks. The computational resource management apparatus includes a condition specification unit that specifies a relationship between computational resources of the cluster system and computation time, a dependency relationship between tasks, and an execution time limit of each task, and a scheduling unit that determines, for each task, an execution sequence and computational resources to be allocated from among the computational resources of the cluster system, based on the relationship between the computational resources and computation time and the dependency relationship that are specified, such that the execution time limit is met.
Abstract:
A feature design unit 81 designs, from relational data, a feature as a variable likely to affect an objective variable. A feature generating unit 82 generates the designed feature, from the relational data. A learning unit 83 learns a prediction model, on the basis of the generated feature.
Abstract:
Computational resource management device includes a model learning unit that uses a measured value of an execution time of data processing, a measured value of a deresource amount, and a feature of input data as training data to learn a model indicating relationship between the execution time and the resource, an execution time estimation unit that inputs, into the model, a feature of data scheduled to be input to calculate an estimated value of the execution time of the scheduled data processing, a resource amount calculation unit that uses the estimated value, a variation index indicating variation in the estimated value, and distribution of estimated residuals to calculate resource amount required in the scheduled data processing, and an execution plan creation unit that creates an execution plan of the scheduled data processing, based on the estimated value, the variation index, the distribution of estimated residuals, and the calculated resource amount.
Abstract:
A price estimation device that can predict a price with a high degree of precision is disclosed. Said price estimation device has a price-predicting means that predicts a price pertaining to second information in a target second time period by applying rule information to said second information, which includes explanatory variables. Said rule information represents the relationship between the explanatory variables and the price, said relationship having been extracted on the basis of a first-information set comprising first information in which explanatory-variable values are associated with price values. The explanatory variables include an attribute that represents a length of time, determined on the basis of a first time period in which a specific event occurs, pertaining to a target object associated with the aforementioned first information or the abovementioned second information. The value of said attribute in the second information is the length of time between the first time period and the second time period, and the value of the attribute in the first information is the length of time between the first time period and a third time period associated with the abovementioned price.
Abstract:
An abnormality detection apparatus (2000) handles tasks allocated to a plurality of processing servers (3200) as processing targets in a distribution system (3000) having the processing servers (3200). A history acquisition unit (2020) acquires progress history information which is information regarding progress of the plurality of tasks at a plurality of time point of recording. A target range determination unit (2040) determines a target range. A distribution calculation unit (2060) calculates a task speed distribution which is a probability distribution of processing speeds of the tasks using the progress history information regarding the plurality of tasks. An abnormality determination unit (2080) compares a processing speed of a task to be determined with the task speed distribution to thereby determine whether or not the processing speed of the task to be determined is abnormal.