-
公开(公告)号:US20180357727A1
公开(公告)日:2018-12-13
申请号:US15780380
申请日:2016-12-16
发明人: Haiyong ZHANG , Jing LU , Wenhui YAO , Chengyu DONG , Jiaji ZHU
CPC分类号: G06Q40/125 , G06F17/30 , G06F17/30091 , G06F17/30194 , G06F17/30584
摘要: The disclosure discloses a method for adjusting distribution of partitioned data. Access frequency information of to-be-processed partitioned data is acquired when an adjustment time corresponding to the to-be-processed partitioned data has arrived; revenue data of each of data centers corresponding to the partitioned data is then determined according to the access frequency information and a preset revenue function; and finally, optimal distribution information is determined according to the revenue data of each of the data centers and a quantity of copies, and a position of each of the copies in each of the data centers is adjusted according to the optimal distribution information. Therefore, without even having to provide additional memory or hard disk for storage, this disclosure dynamically optimizes the distribution status of the partitioned data according to access frequencies and characteristics of the partitioned data, thus reducing transmission bandwidth requirements among data centers.
-
2.
公开(公告)号:US20180246934A1
公开(公告)日:2018-08-30
申请号:US15907114
申请日:2018-02-27
申请人: Timescale, Inc.
发明人: Matvey Arye , Michael J. Freedman , Robert Kiefer , Ajay A. Kulkarni , Erik Nordström , Olof Rensfelt
IPC分类号: G06F17/30
CPC分类号: G06F17/30486 , G06F17/30283 , G06F17/30333 , G06F17/30336 , G06F17/30339 , G06F17/30551 , G06F17/30584 , G06F17/30864
摘要: A database system stores data as hypertables that represent partitioned database tables. Each hypertable comprises chunks of data that may be distributed across multiple locations, each location comprising at least a storage device. The database system provides an interface that allows database queries seamlessly to hypertables as well as standard tables. The database system dynamically creates chunks as records are added to a hypertable. The database system defines a new partitioning strategy if the storage configuration of the database system is changed by adding new locations or removing existing locations. The records added to the hypertable before the storage configuration was changed continue to be stored as chunks distributed according to the previous partitioning policy.
-
公开(公告)号:US09946719B2
公开(公告)日:2018-04-17
申请号:US15694674
申请日:2017-09-01
申请人: SAS Institute Inc.
CPC分类号: G06F17/30097 , G06F3/0604 , G06F3/061 , G06F3/064 , G06F3/0643 , G06F3/0644 , G06F3/067 , G06F9/5072 , G06F9/5077 , G06F12/0292 , G06F17/302 , G06F17/30312 , G06F17/30584 , G06F21/602 , G06F2212/1016 , G06F2212/1056 , G06F2212/154 , G06F2212/262 , G06F2212/263
摘要: An apparatus includes a processor component of a first node device caused to receive data block encryption data and an indication of size of an encrypted data block distributed to the first node device for decryption, and in response to the data set being of encrypted data: receive an indication of the quantity of sub-blocks within the encrypted data block, and a hashed identifier for each data sub-block; use the data block encryption data to decrypt the encrypted data block to regenerate data set portions from the data sub-blocks; analyze the hashed identifier of each data sub-block to determine whether all data set portions are distributed to the first node device for processing; and in response to a determination that at least one data set portion is to be distributed to a second node device for processing, transmit the at least one data set portion to the second node device.
-
公开(公告)号:US09934325B2
公开(公告)日:2018-04-03
申请号:US14571476
申请日:2014-12-16
发明人: Jung Ho Um , Taehong Kim , Chang Hoo Jeong , Seungwoo Lee , Hanmin Jung , Won Kyung Sung
IPC分类号: G06F17/30
CPC分类号: G06F17/30958 , G06F17/30 , G06F17/30498 , G06F17/30528 , G06F17/30584
摘要: A method and apparatus distributes graph data in a distributed computing environment. The method of distributing graph data in a distributed computing environment includes searching graph data for common sub-graphs, generating a partition by merging the common sub-graphs if, as a result of the search, the common sub-graphs are present and generating a partition by arranging the graph data if, as a result of the search, the common sub-graphs are not present, and calculating a processing cost of the graph data and allocating the partition based on the calculated processing cost.
-
公开(公告)号:US09886469B2
公开(公告)日:2018-02-06
申请号:US15154980
申请日:2016-05-14
发明人: David R. Kent, IV , Ryan Caudy , Charles Wright , Radu Teodorescu
IPC分类号: G06F17/30 , G06F3/0482 , G06F3/0489 , G06F17/22 , G06F17/24 , G06F17/27 , G06F12/084 , H04L12/58 , G06F15/173 , G06F3/0481 , G06F3/0484 , G06F3/0485 , G06F12/02 , G06F9/44 , G06F9/45 , H04L29/08 , G06F3/06 , G06F11/14 , H04L29/06 , G06F9/445 , H04L12/18 , H04L29/12
CPC分类号: H04L67/42 , G06F3/0481 , G06F3/0482 , G06F3/0483 , G06F3/04847 , G06F3/0485 , G06F3/04895 , G06F3/0605 , G06F3/0656 , G06F3/067 , G06F8/30 , G06F8/41 , G06F8/427 , G06F8/60 , G06F11/1451 , G06F11/1464 , G06F11/1469 , G06F12/0261 , G06F12/084 , G06F12/1483 , G06F15/17331 , G06F17/2235 , G06F17/24 , G06F17/245 , G06F17/246 , G06F17/2715 , G06F17/276 , G06F17/30117 , G06F17/30283 , G06F17/30303 , G06F17/30312 , G06F17/30315 , G06F17/30321 , G06F17/30324 , G06F17/30327 , G06F17/30333 , G06F17/30336 , G06F17/30339 , G06F17/30342 , G06F17/30345 , G06F17/30368 , G06F17/30371 , G06F17/30374 , G06F17/30377 , G06F17/30398 , G06F17/30424 , G06F17/30448 , G06F17/30451 , G06F17/30454 , G06F17/30457 , G06F17/30477 , G06F17/30483 , G06F17/30498 , G06F17/30522 , G06F17/30528 , G06F17/30554 , G06F17/30563 , G06F17/30584 , G06F17/30598 , G06F17/30864 , G06F17/30867 , G06F17/30887 , G06F17/30902 , G06F17/30958 , G06F17/30997 , G06F17/40 , G06F21/00 , G06F21/6209 , G06F2201/805 , G06F2201/84 , G06F2212/1052 , G06F2212/154 , G06F2212/163 , G06F2212/60 , H04L12/18 , H04L51/046 , H04L51/12 , H04L61/2069 , H04L63/101 , H04L63/102 , H04L67/1002 , H04L67/141 , H04L67/28 , H04L67/2833 , H04L67/2842 , H04L67/2847 , H04L67/34 , H04L69/16
摘要: Described are methods, systems and computer readable media for performance logging of complex query operations.
-
公开(公告)号:US09875272B1
公开(公告)日:2018-01-23
申请号:US14748225
申请日:2015-06-23
申请人: Google Inc.
发明人: Anant Jhingran , Rupesh Kumar , Sanjoy Bose
CPC分类号: G06F17/30371 , G06F17/30342 , G06F17/30581 , G06F17/30584
摘要: A computer-implemented database system, method, and computer program product are provided. the database system comprises a plurality of nodes, each node including a data storage device having memory and a server; and a database system controller coupled to each of the plurality of nodes and having a processor and software program code for directing the database system to perform the following function of defining, for a user, a node group including at least one of the plurality of nodes, upon which the user's data is to be stored in a user database; wherein the user database is defined in terms of time-partitioned tables residing on the nodes of the node group, and wherein each time-partitioned table is further defined in terms of shards of the user's data, the shards corresponding with respective ones of the time partitions. The user data is managed in terms of the shards on respective nodes of the node group, and the time-partitioned tables include a chronologically oldest time-partitioned table and a current time-partitioned table into which a new user data entry will be written. The system further performs the functions of determining whether a predetermined criterion has been met; and, responsive to the detecting that the predetermined criterion has been met, purging all shards of the chronologically oldest time-partitioned table.
-
公开(公告)号:US09875263B2
公开(公告)日:2018-01-23
申请号:US14519952
申请日:2014-10-21
IPC分类号: G06F17/30
CPC分类号: G06F17/30321 , G06F17/30345 , G06F17/30584 , G06F17/30867
摘要: Composite partition function techniques are described herein that may be used to repartition a database without moving existing data. In one or more implementations, a database is partitioned in a first arrangement associated with a first partition function. The database is repartitioned to form a second arrangement associated with a second partition function. A record of key membership for data entries in the partitions existing at the time of repartitioning is created, which can be used to recognize data corresponding to the first arrangement. A composite partition function is defined for subsequent database operations that is configured to apply the first partition function for data having keys found in the record of key membership and apply the second partition function for other data having keys that are not found in the record of key membership.
-
公开(公告)号:US20180011866A1
公开(公告)日:2018-01-11
申请号:US15694662
申请日:2017-09-01
申请人: SAS Institute Inc.
CPC分类号: G06F17/30097 , G06F3/0604 , G06F3/061 , G06F3/064 , G06F3/0643 , G06F3/0644 , G06F3/067 , G06F9/5072 , G06F9/5077 , G06F12/0292 , G06F17/302 , G06F17/30312 , G06F17/30584 , G06F21/602 , G06F2212/1016 , G06F2212/1056 , G06F2212/154 , G06F2212/262 , G06F2212/263
摘要: An apparatus may include a processor component caused to: generate map entries in map data descriptive of encrypted data blocks within a data file; use first map block encryption data to encrypt a first map extension of the map data; transmit the encrypted first map extension for storage within the data file; store the first map block encryption data within the second map extension; use second map block encryption data to encrypt a second map extension of the map data after storage of the first map block encryption data therein; transmit encrypted second map extension for storage within the data file; store the second map block encryption data within the map base; use third map block encryption data to encrypt a map base of the map data after storage of the second map block encryption data therein; and transmit the encrypted map base for storage within the data file.
-
9.
公开(公告)号:US09864759B2
公开(公告)日:2018-01-09
申请号:US13170490
申请日:2011-06-28
IPC分类号: G06F12/00 , G06F17/30 , H04L29/06 , G06F15/173 , H04L12/24 , H04L12/931 , H04L29/08 , G06F9/455
CPC分类号: G06F17/30286 , G06F9/45504 , G06F15/17318 , G06F17/30368 , G06F17/30584 , H04L29/06088 , H04L41/042 , H04L41/0686 , H04L49/358 , H04L67/02 , H04L67/10 , H04L67/1002 , H04L67/1004 , H04L67/1027 , H04L67/1034 , H04L67/1095 , H04L67/14 , H04L67/142 , H04L67/146
摘要: Systems and methods are provided for providing scatter/gather data processing. In accordance with an embodiment, a such a system can include a cluster of one or more high performance computing systems, each including one or more processors and a high performance memory. The cluster communicates over an InfiniBand network. The system can also include a middleware environment, executing on the cluster, that includes one or more application server instances. The system can further include a plurality of muxers. Each application server instance includes at least one muxer, and each muxer is operable to collect data from a plurality of locations in the high performance memory, and transfer the data in bulk.
-
公开(公告)号:US09852161B2
公开(公告)日:2017-12-26
申请号:US14252018
申请日:2014-04-14
IPC分类号: G06F17/30
CPC分类号: G06F17/30292 , G06F17/30584
摘要: A method for autonomic data partition placement in an in-memory data grid (IMDG) based on usage sampling is provided. The method may include sampling access pattern data, during a configurable window, of a client accessing one or more data objects in the IMDG. Analytics are applied to the sampled access pattern data to determine a replacement partition schema, based on the analyzed sampled access pattern data exceeding at least one performance threshold. The deployed partition schema is altered, based on the replacement partition schema.
-
-
-
-
-
-
-
-
-