Application-driven storage systems for a computing system

    公开(公告)号:US10289568B2

    公开(公告)日:2019-05-14

    申请号:US15204787

    申请日:2016-07-07

    Abstract: Systems and methods that allow secure application-driven arbitrary compute in storage devices in a cloud-based computing system are provided. A computing system including a compute controller configured to: (1) provide access to host compute resources, and (2) operate in at least one of a first mode or a second mode is provided. The computing system may further include a storage controller configured to provide access to storage systems including storage components, at least one compute component, and at least one cryptographic component. In the first mode, the host compute resources may be configured to execute at least a first operation on at least a first set of data stored in at least one of the storage components. In the second mode, the at least one compute component may be configured to execute at least a second operation on at least a second set of data.

    Flash memory cache including for use with persistent key-value store
    13.
    发明授权
    Flash memory cache including for use with persistent key-value store 有权
    闪存缓存包括用于持久性键值存储

    公开(公告)号:US09436596B2

    公开(公告)日:2016-09-06

    申请号:US13919727

    申请日:2013-06-17

    Abstract: Described is using flash memory, RAM-based data structures and mechanisms to provide a flash store for caching data items (e.g., key-value pairs) in flash pages. A RAM-based index maps data items to flash pages, and a RAM-based write buffer maintains data items to be written to the flash store, e.g., when a full page can be written. A recycle mechanism makes used pages in the flash store available by destaging a data item to a hard disk or reinserting it into the write buffer, based on its access pattern. The flash store may be used in a data deduplication system, in which the data items comprise chunk-identifier, metadata pairs, in which each chunk-identifier corresponds to a hash of a chunk of data that indicates. The RAM and flash are accessed with the chunk-identifier (e.g., as a key) to determine whether a chunk is a new chunk or a duplicate.

    Abstract translation: 描述的是使用闪存,基于RAM的数据结构和机制来提供用于在闪存页中缓存数据项(例如键值对)的闪存。 基于RAM的索引将数据项映射到闪存页面,并且基于RAM的写入缓冲器保持要写入闪存存储器的数据项目,例如当可以写入全页时。 回收机制使得通过将数据项降级到硬盘或将其重新插入到写入缓冲器中,基于其访问模式,可用于闪存存储器中的使用页面。 闪存存储器可以用在数据重复数据删除系统中,其中数据项包括块标识符,元数据对,其中每个块标识符对应于指示的数据块的散列。 使用块标识符(例如,作为密钥)来访问RAM和闪存,以确定块是新的块还是重复的。

    USING INDEX PARTITIONING AND RECONCILIATION FOR DATA DEDUPLICATION
    14.
    发明申请
    USING INDEX PARTITIONING AND RECONCILIATION FOR DATA DEDUPLICATION 审中-公开
    使用索引分类和重新进行数据分类

    公开(公告)号:US20160012098A1

    公开(公告)日:2016-01-14

    申请号:US14797890

    申请日:2015-07-13

    Abstract: The subject disclosure is directed towards a data deduplication technology in which a hash index service's index is partitioned into subspace indexes, with less than the entire hash index service's index cached to save memory. The subspace index is accessed to determine whether a data chunk already exists or needs to be indexed and stored. The index may be divided into subspaces based on criteria associated with the data to index, such as file type, data type, time of last usage, and so on. Also described is subspace reconciliation, in which duplicate entries in subspaces are detected so as to remove entries and chunks from the deduplication system. Subspace reconciliation may be performed at off-peak time, when more system resources are available, and may be interrupted if resources are needed. Subspaces to reconcile may be based on similarity, including via similarity of signatures that each compactly represents the subspace's hashes.

    Abstract translation: 本发明涉及一种数据重复数据删除技术,其中散列索引服务的索引被分割成子空间索引,其中小于整个散列索引服务的索引来缓存存储器。 访问子空间索引以确定数据块是否已经存在或需要进行索引和存储。 索引可以根据与索引的数据相关联的标准被划分为子空间,例如文件类型,数据类型,上次使用的时间等等。 还描述了子空间协调,其中检测子空间中的重复条目,以便从重复数据删除系统中删除条目和块。 当更多的系统资源可用时,子空间协调可以在非高峰时间执行,并且如果需要资源,则可能被中断。 调和的子空间可以基于相似性,包括通过每个紧密地表示子空间的散列的签名的相似性。

    Latch-free, log-structured storage for multiple access methods
    17.
    发明授权
    Latch-free, log-structured storage for multiple access methods 有权
    用于多种访问方式的无锁存,日志结构存储

    公开(公告)号:US09519591B2

    公开(公告)日:2016-12-13

    申请号:US13924567

    申请日:2013-06-22

    Abstract: A data manager may include a data opaque interface configured to provide, to an arbitrarily selected page-oriented access method, interface access to page data storage that includes latch-free access to the page data storage. In another aspect, a swap operation may be initiated, of a portion of a first page in cache layer storage to a location in secondary storage, based on initiating a prepending of a partial swap delta record to a page state associated with the first page, the partial swap delta record including a main memory address indicating a storage location of a flush delta record that indicates a location in secondary storage of a missing part of the first page. In another aspect, a page manager may initiate a flush operation of a first page in cache layer storage to a location in secondary storage, based on atomic operations with flush delta records.

    Abstract translation: 数据管理器可以包括数据不透明接口,被配置为向任意选择的面向页面的访问方法提供对包括对页面数据存储器的无闩锁访问的页面数据存储的接口访问。 在另一方面,可以基于发起部分交换增量记录的前缀到与第一页相关联的页面状态,将高速缓存层存储器中的第一页面的一部分的交换操作发起到辅助存储器中的位置, 该部分交换增量记录包括指示闪存增量记录的存储位置的主存储器地址,其指示第一页的缺失部分的辅助存储器中的位置。 在另一方面,页面管理器可以基于具有刷新三角洲记录的原子操作来启动高速缓存层存储器中的第一页面的刷新操作到辅助存储器中的位置。

Patent Agency Ranking