-
公开(公告)号:US11354252B2
公开(公告)日:2022-06-07
申请号:US16144926
申请日:2018-09-27
发明人: Hariharan Lakshmanan , Dhruvil Shah , Prashant Gaharwar , Shasank K. Chavan , Tirthankar Lahiri , Saraswathy Narayan
IPC分类号: G06F12/12 , G06F16/24 , G06F12/126 , G06F16/22 , G06F16/2455 , G06F16/172
摘要: Techniques related to automatic cache management are disclosed. In some embodiments, one or more non-transitory storage media store instructions which, when executed by one or more computing devices, cause performance of an automatic cache management method when a determination is made to store a first set of data in a cache. The method involves determining whether an amount of available space in the cache is less than a predetermined threshold. When the amount of available space in the cache is less than the predetermined threshold, a determination is made as to whether a second set of data has a lower ranking than the first set of data by at least a predetermined amount. When the second set of data has a lower ranking than the first set of data by at least the predetermined amount, the second set of data is evicted. Thereafter, the first set of data is cached.
-
2.
公开(公告)号:US10678791B2
公开(公告)日:2020-06-09
申请号:US15602009
申请日:2017-05-22
发明人: Shasank K. Chavan , Dina Thomas , Ajit Mylavarapu , Prashant Gaharwar , Tirthankar Lahiri , Jesse Kamp
IPC分类号: G06F16/2453 , G06F16/22 , G06F16/9535 , G06F16/2455 , G06F7/24
摘要: Techniques are described for encoding join columns that belong to the same domain with a common dictionary. The tables are encoded with dictionary indexes that make the comparison operation of a join query a quick equality check of two integers and there is no need to compute any hashes during execution. Additionally, the techniques described herein minimize the bloom filter creation and evaluation cost as well because the dictionary indexes serve as hash values into the bloom filter. If the bloom filter is as large as the range of dictionary indexes, then the filter is no longer a probabilistic structure and can be used to filter rows in the probe phase with full certainty without any significant overhead.
-
公开(公告)号:US20180067853A1
公开(公告)日:2018-03-08
申请号:US15257754
申请日:2016-09-06
发明人: Niloy Mukherjee , Tirthankar Lahiri , Juan R. Loaiza , Jesse Kamp , Prashant Gaharwar , Hariharan Lakshmanan , Dhruvil Shah
CPC分类号: G06F12/08 , G06F3/0604 , G06F3/0638 , G06F3/0647 , G06F3/067 , G06F17/30289 , G06F17/30312 , G06F2212/1016
摘要: Techniques related to efficient data storage and retrieval using a heterogeneous main memory are disclosed. A database includes a set of persistent format (PF) data that is stored on persistent storage in a persistent format. The database is maintained on the persistent storage and is accessible to a database server. The database server converts the set of PF data to sets of mirror format (MF) data and stores the MF data in a hierarchy of random-access memories (RAMs). Each RAM in the hierarchy has an associated latency that is different from a latency associated with any other RAM in the hierarchy. Storing the sets of MF data in the hierarchy of RAMs includes (1) selecting, based on one or more criteria, a respective RAM in the hierarchy to store each set of MF data and (2) storing said each set of MF data in the respective RAM.
-
4.
公开(公告)号:US20170255675A1
公开(公告)日:2017-09-07
申请号:US15602009
申请日:2017-05-22
发明人: Shasank K. Chavan , Dina Thomas , Ajit Mylavarapu , Prashant Gaharwar , Tirthankar Lahiri , Jesse Kamp
IPC分类号: G06F17/30
摘要: Techniques are described for encoding join columns that belong to the same domain with a common dictionary. The tables are encoded with dictionary indexes that make the comparison operation of a join query a quick equality check of two integers and there is no need to compute any hashes during execution. Additionally, the techniques described herein minimize the bloom filter creation and evaluation cost as well because the dictionary indexes serve as hash values into the bloom filter. If the bloom filter is as large as the range of dictionary indexes, then the filter is no longer a probabilistic structure and can be used to filter rows in the probe phase with full certainty without any significant overhead.
-
5.
公开(公告)号:US20140095448A1
公开(公告)日:2014-04-03
申请号:US13826075
申请日:2013-03-14
IPC分类号: G06F17/30
CPC分类号: G06F17/30221 , G06F3/0649 , G06F17/30073 , G06F17/30289 , G06F17/30306 , G06F17/30312 , G06F17/30575
摘要: A method, apparatus, and system for automated information lifecycle management using low access patterns in a database management system are provided. A user or the database can store policy data that defines an archiving action when meeting an activity-level condition on one or more database objects. The archiving actions may include compression, data movement, and other actions to place the database object in an appropriate storage tier for a lifecycle phase of the database object. The activity-level condition may specify the database object meeting a low access pattern, optionally for a minimum time period. Various criteria including access statistics for the database object and cost characteristics of current and target compression levels or storage tiers may be considered to determine the meeting of the activity-level condition. The policies may be evaluated on an adjustable periodic basis and may utilize a task scheduler for minimal performance impact.
摘要翻译: 提供了一种在数据库管理系统中使用低访问模式的自动信息生命周期管理的方法,装置和系统。 用户或数据库可以存储在满足一个或多个数据库对象上的活动级别条件时定义归档操作的策略数据。 归档操作可以包括压缩,数据移动和其他动作,以将数据库对象放置在数据库对象的生命周期阶段的适当的存储层中。 活动级别条件可以指定满足低访问模式的数据库对象,可选地在最短时间段内。 可以考虑包括数据库对象的访问统计和当前和目标压缩级别或存储层的成本特征的各种标准来确定活动级别条件的会议。 这些策略可以在可调周期的基础上进行评估,并且可以利用任务调度器来最小的性能影响。
-
公开(公告)号:US20210149847A1
公开(公告)日:2021-05-20
申请号:US17159070
申请日:2021-01-26
摘要: A method, apparatus, and system for policy driven data placement and information lifecycle management in a database management system are provided. A user or database application can specify declarative policies that define the movement and transformation of stored database objects. The policies are associated with a database object and may also be inherited. A policy defines, for a database object, an archiving action to be taken, a scope, and a condition before the archiving action is triggered. Archiving actions may include compression, data movement, table clustering, and other actions to place the database object into an appropriate storage tier for a lifecycle phase of the database object. Conditions based on access statistics can be specified at the row level and may use segment or block level heatmaps. Policy evaluation occurs periodically in the background, with actions queued as tasks for a task scheduler.
-
公开(公告)号:US10318493B2
公开(公告)日:2019-06-11
申请号:US13804581
申请日:2013-03-14
摘要: A method, apparatus, and system for custom policy driven data placement and information lifecycle management in a database management system are provided. A user or database application can specify declarative custom policies that define the movement and transformation of stored database objects. A custom policy defines, for a database object, a custom function to evaluate on an associated database object to determine whether an archiving action is triggered. Archiving actions may include compression, data movement, table clustering, and other actions to place the database object into an appropriate storage tier for a lifecycle phase of the database object. The custom function is defined by the database user, and can flexibly include any customized business logic using data sources internal and external to the database, including database access statistics such as segment level or block level heatmaps.
-
8.
公开(公告)号:US20170116232A1
公开(公告)日:2017-04-27
申请号:US14922086
申请日:2015-10-23
IPC分类号: G06F17/30
CPC分类号: G06F16/217
摘要: A method, apparatus, and system for periodic performance optimization through heatmap based management of an in-memory area are provided. A heatmap is maintained to track database accesses, and a sliding most recent time window of the heatmap is externalized to a desired granularity level to provide access statistics regarding candidate elements to be possibly placed in the in-memory area. Initially and on a periodic basis, an appropriate knapsack algorithm is chosen based on an analysis on the computational costs versus the benefits of applying various knapsack algorithms for the candidate elements. Using the chosen algorithm in conjunction with a selected performance model, an optimized configuration of the in-memory area is determined. The optimized configuration indicates a set of elements chosen from the candidate elements, optionally specified with compression levels. A task scheduler then schedules the appropriate tasks, working in a coordinated fashion, to reconfigure the in-memory area according to the optimized configuration.
-
9.
公开(公告)号:US20140095449A1
公开(公告)日:2014-04-03
申请号:US13804394
申请日:2013-03-14
IPC分类号: G06F17/30
CPC分类号: G06F16/185 , G06F3/0649 , G06F16/113 , G06F16/21 , G06F16/217 , G06F16/22 , G06F16/27 , G06F17/30073 , G06F17/30221 , G06F17/30289 , G06F17/30306 , G06F17/30312 , G06F17/30575
摘要: A method, apparatus, and system for policy driven data placement and information lifecycle management in a database management system are provided. A user or database application can specify declarative policies that define the movement and transformation of stored database objects. The policies are associated with a database object and may also be inherited. A policy defines, for a database object, an archiving action to be taken, a scope, and a condition before the archiving action is triggered. Archiving actions may include compression, data movement, table clustering, and other actions to place the database object into an appropriate storage tier for a lifecycle phase of the database object. Conditions based on access statistics can be specified at the row level and may use segment or block level heatmaps. Policy evaluation occurs periodically in the background, with actions queued as tasks for a task scheduler.
摘要翻译: 提供了一种用于数据库管理系统中的策略驱动数据放置和信息生命周期管理的方法,装置和系统。 用户或数据库应用程序可以指定定义存储的数据库对象的移动和转换的声明性策略。 策略与数据库对象相关联,也可以被继承。 在触发归档操作之前,策略为数据库对象定义要执行的归档操作,作用域和条件。 归档操作可能包括压缩,数据移动,表集群和其他操作,以将数据库对象放入适用于数据库对象生命周期阶段的存储层。 可以在行级别指定基于访问统计信息的条件,并可以使用段或块级散热图。 策略评估在后台定期进行,操作会作为任务调度程序的任务进行排队。
-
公开(公告)号:US11556505B2
公开(公告)日:2023-01-17
申请号:US17159070
申请日:2021-01-26
摘要: A method, apparatus, and system for policy driven data placement and information lifecycle management in a database management system are provided. A user or database application can specify declarative policies that define the movement and transformation of stored database objects. The policies are associated with a database object and may also be inherited. A policy defines, for a database object, an archiving action to be taken, a scope, and a condition before the archiving action is triggered. Archiving actions may include compression, data movement, table clustering, and other actions to place the database object into an appropriate storage tier for a lifecycle phase of the database object. Conditions based on access statistics can be specified at the row level and may use segment or block level heatmaps. Policy evaluation occurs periodically in the background, with actions queued as tasks for a task scheduler.
-
-
-
-
-
-
-
-
-