摘要:
Providing cost model data for tuning query cache memory size in database systems. In one aspect, a query is received, and a query cache is checked to determine whether a stored query matches the received query. When a cache miss has occurred due to no stored queries matching the received query, the processing time saved by the avoidance of the cache miss and a cache size needed to avoid the cache miss are determined.
摘要:
A system and method for facilitating execution of one or more data integration projects in multiple environments or an environment that undergoes changes. Each project has a set of project parameters, which are bound to environment variables. Each environment has a corresponding environment representation with environment variables and corresponding values. Each project is mapped to an environment representation. Values of environment variables are provided to projects with corresponding parameters. When one or more projects are changed to a different environment with a different corresponding environment representation, the environment variable values of the new environment representation are provided to the projects. When an environment change is reflected in the environment representation, the changed variable values are provided to mapped projects.
摘要:
A method includes connecting an integration process to a first set of inputs. The first set of inputs may include one or more inputs. The integration process includes one or more data transformation operations using the inputs. The method further includes receiving metadata about one or more of the inputs in the first set of inputs. The metadata about one or more of the inputs in the first set of inputs is cached. The integration process is then connected to a second set of inputs based on the cached metadata about one or more of the inputs in the first set of inputs.
摘要:
A method includes connecting an integration process to a first set of inputs. The first set of inputs may include one or more inputs. The integration process includes one or more data transformation operations using the inputs. The method further includes receiving metadata about one or more of the inputs in the first set of inputs. The metadata about one or more of the inputs in the first set of inputs is cached. The integration process is then connected to a second set of inputs based on the cached metadata about one or more of the inputs in the first set of inputs.
摘要:
A system and method for extracting data from an input source, transforming the data, and loading the transformed data to an output destination. A schema contract including constraints is used to validate a set of input data column types and translate them into a set of actual types. Mapping data in the schema contract enable mapping input data columns to data columns used by data integration components. The constraints and mapping data provide flexibility in transforming sets of data having different sets of input data column types, while providing a fixed set of types for use during dataflow executions. Flexibility may enable optional columns, sets of one or more columns, varying arrangements of columns, and variations in type definitions of each column.
摘要:
An arrangement for deducing descriptive metadata from data contained in a column of a relational table and associated existing metadata (e.g., that which identifies column data type and/or column name) is provided by a metadata deduction engine in a set of OLAP tools which operates in conjunction with an analysis services server. The metadata deduction engine applies one or more criteria that are configured to evaluate column data in order to deduce metadata that provides additional contextual meaning to the column data beyond that given by the existing metadata. The metadata deduction engine maps the column data to a metadata tag that is passed to the analysis services server to enable it to create an OLAP cube using the deduced metadata.
摘要:
Methods and systems are provided for executing a simulation of an operation in a data processing system. In one implementation, the method includes executing an operation under a first set of conditions, determining a characteristic associated with the execution of the operation under the first set of conditions, and executing a simulation of the operation under a second set of conditions different from the first set of conditions. The simulation of the operation is constrained by the determined characteristic. The method can further include determining a cost/benefit of executing the operation under a set of conditions different from the first set of conditions based at least in part on the simulation.
摘要:
A method for reducing oscillations of an output value associated with a program to be operatively coupled to a data processing system. The program having an internal process configured to read an input value provided by the program, the input value adjusting a performance aspect of the internal process, the internal process configured to provide an output value reflecting changes in the internal process responsive to the input value, the output value readable by the program. The method including writing the output value to a queue stored in memory of the data processing system, selecting a portion of the queue, matching the selected portion of the queue with a predetermined pattern, selecting a type of adjustment to be made to the input value, the type of adjustment corresponding to the matched predetermined pattern, determining a new input value according to the selected type of adjustment, and providing the new value the internal process, the internal process providing a new output value having reduced oscillations responsive to the new input value.
摘要:
A system and method for facilitating execution of one or more data integration projects in multiple environments or an environment that undergoes changes. Each project has a set of project parameters, which are bound to environment variables. Each environment has a corresponding environment representation with environment variables and corresponding values. Each project is mapped to an environment representation. Values of environment variables are provided to projects with corresponding parameters. When one or more projects are changed to a different environment with a different corresponding environment representation, the environment variable values of the new environment representation are provided to the projects. When an environment change is reflected in the environment representation, the changed variable values are provided to mapped projects.
摘要:
A system and method for facilitating execution of one or more data integration projects in multiple environments or an environment that undergoes changes. Each project has a set of project parameters, which are bound to environment variables. Each environment has a corresponding environment representation with environment variables and corresponding values. Each project is mapped to an environment representation. Values of environment variables are provided to projects with corresponding parameters. When one or more projects are changed to a different environment with a different corresponding environment representation, the environment variable values of the new environment representation are provided to the projects. When an environment change is reflected in the environment representation, the changed variable values are provided to mapped projects.