Abstract:
A system performs masking of data stored in a database. The system receives change logs from a source database and masks the change logs to generate masked change logs. The system stores the masked change logs in a pre-buffer. If the system determines that the set of masked change logs stored in the pre-buffer corresponds to a complete transaction, the system determines whether any conflicts exist between masked change logs stored in the pre-buffer and masked change logs stored in a main buffer. If the system identifies conflicts, the system applies the masked change logs stored in the main buffer to a masked replica database. This causes the system to move masked change logs corresponding to a complete transaction from the pre-buffer to the main buffer.
Abstract:
A system performs masking of data stored in a database. The system receives change logs from a source database and masks the change logs to generate masked change logs. The system stores the masked change logs in a pre-buffer. If the system determines that the set of masked change logs stored in the pre-buffer corresponds to a complete transaction, the system determines whether any conflicts exist between masked change logs stored in the pre-buffer and masked change logs stored in a main buffer. If the system identifies conflicts, the system applies the masked change logs stored in the main buffer to a masked replica database. This causes the system to move masked change logs corresponding to a complete transaction from the pre-buffer to the main buffer.
Abstract:
A data processing system maintaining a plurality of masking engines is configured to synchronize masking jobs between different masking engines, in order to ensure consistent outputs between the different engines for the same job. Upon identifying a masking job object maintained by a first masking engine to be exported, dependencies of the job object are traversed to identify all objects depended on by the job object, which are used to form an export payload. At least object of the payload is a reference object that references other objects maintained by the first masking engine. When importing the export payload onto a second masking engine, the export payload is analyzed to identify revision information of the referenced object. The identified revision information is compared with revision information of a corresponding object maintained by the second masking engine, and the referenced objects is imported based upon a result of the comparison.
Abstract:
Storage systems store data in a storage pool comprising storage devices or virtual devices. The storage pool may be allocated for a particular purpose. If a virtual device within the storage pool needs to be repurposed, the virtual device is removed from the storage pool. Data is moved from the removed virtual device to one or more target virtual devices. Segments of the source virtual device being removed are copied to target virtual devices. Mapping tables associating source segments with target segments are stored. If the storage system receives a request to access data stored on a virtual device that is removed, the storage system processes the mapping tables to determine where the data is stored.
Abstract:
A database storage system allows users to modify the state of a virtual database. The database storage system provides a respective virtual database (VDB) at a respective destination, the respective VDB having a first timeflow stored in a respective container. A user can send a request to rewind a VDB. The request identifies timeflow of the VDB and a state of the VDB associated with a timeflow. The database storage system modifies the virtual database to refer to database blocks associated with a snapshot of the VDB associated with the identified timeflow. The database storage system maintains a new timeflow for the modified VDB. The database storage system also allows the virtual database to be refreshed to a state of a source database. The source database can be a database stored in an external system or a virtual database stored within the database storage system.
Abstract:
Information from multiple databases is retrieved and stored on a database storage system. Multiple point-in-time copies are obtained for each database. A point-in-time copy retrieves data changed in the database since the retrieval of a previous point-in-time copy. A virtual database (VDB) is created by creating a set of files in the data storage system. Each file in the set of files created for a VDB is linked to the database blocks on the database storage system associated with a point-in-time copy of the source database. The set of files associated with the VDB are mounted on a database server allowing the database server to read from and write to the set of files. Workflows based on VDBs allow various usage scenarios based on databases to be implemented efficiently, for example, testing and development, backup and recovery, and data warehouse building.
Abstract:
Information from multiple databases is retrieved and stored on a database storage system. Multiple point-in-time copies are obtained for each database. A point-in-time copy retrieves data changed in the database since the retrieval of a previous point-in-time copy. A virtual database (VDB) is created by creating a set of files in the data storage system. Each file in the set of files created for a VDB is linked to the database blocks on the database storage system associated with a point-in-time copy of the source database. The set of files associated with the VDB are mounted on a database server allowing the database server to read from and write to the set of files. Workflows based on VDBs allow various usage scenarios based on databases to be implemented efficiently, for example, testing and development, backup and recovery, and data warehouse building.