摘要:
Novel methods are described herein to provide an OLAP database system that performs lock-less bulk insertion while maintaining high query performance and minimizing additional storage requirements. Aspects of the claimed subject matter include novel methods for merging two index structures while maintaining query consistency without the use of a versioning scheme by using copies of vertical segments of an index tree page; a method to prepare and merge two index structures that operates within storage constraints; and a method to execute queries concurrently while index maintenance is in progress while still producing consistent results. According to an aspect of the present disclosure, a flexible index merge mechanism is provided that merges data from incremental indices to a primary data index in three phases: a load phase, a copy phase, and a replace phase.
摘要:
A method and an apparatus for processing photovoltaic data, and a system for managing photovoltaic data are provided, which relates to the field of data processing technology. The method includes: generating request identification metadata for starting a current data write transaction based on a current time when it is determined that a previous data write transaction is successfully executed; writing to-be-written photovoltaic data in the current data write transaction into a row storage format file in a row storage format based on the request identification metadata; merging the photovoltaic data in the row storage format file into a column storage format file in a column storage mode when it is determined that an amount of data written in the row storage format exceeds a target data amount threshold, where the row storage format file and the column storage format file are used for data query.
摘要:
System, method, and computer program product for processing data are disclosed. The system is configured to perform transfer of data from a file system to a database system. Such transfer is accomplished through receiving a request for loading data into a database system, wherein the data includes a plurality of attributes, determining at least one attribute of the data for loading into the database system, and loading the at least one attribute of the data into the database system while continuing to process remaining attributes of the data.