公开(公告)号：US10229089B2

公开(公告)日：2019-03-12

申请号：US15639110

申请日：2017-06-30

Applicant: Oracle International Corporation

Inventor： Amit Ganesh ,  Shasank K. Chavan ,  Vineet Marwah ,  Jesse Kamp ,  Anindya C. Patthak ,  Michael J. Gleeson ,  Allison L. Holloway ,  Roger Macnicol

IPC: G06F9/30 ,  G06F15/80 ,  G06F17/30

Abstract: A method and apparatus for efficiently processing data in various formats in a single instruction multiple data (“SIMD”) architecture is presented. Specifically, a method to unpack a fixed-width bit values in a bit stream to a fixed width byte stream in a SIMD architecture is presented. A method to unpack variable-length byte packed values in a byte stream in a SIMD architecture is presented. A method to decompress a run length encoded compressed bit-vector in a SIMD architecture is presented. A method to return the offset of each bit set to one in a bit-vector in a SIMD architecture is presented. A method to fetch bits from a bit-vector at specified offsets relative to a base in a SIMD architecture is presented. A method to compare values stored in two SIMD registers is presented.

公开(公告)号：US09697174B2

公开(公告)日：2017-07-04

申请号：US14023249

申请日：2013-09-10

Applicant: Oracle International Corporation

Inventor： Amit Ganesh ,  Shasank K. Chavan ,  Vineet Marwah ,  Jesse Kamp ,  Anindya C. Patthak ,  Michael J. Gleeson ,  Allison L. Holloway ,  Roger Macnicol

IPC: G06F15/00 ,  G06F7/38 ,  G06F9/00 ,  G06F9/44 ,  G06F15/80 ,  G06F17/30

CPC classification number: G06F15/8007 ,  G06F17/30315

Abstract: A method and apparatus for efficiently processing data in various formats in a single instruction multiple data (“SIMD”) architecture is presented. Specifically, a method to unpack a fixed-width bit values in a bit stream to a fixed width byte stream in a SIMD architecture is presented. A method to unpack variable-length byte packed values in a byte stream in a SIMD architecture is presented. A method to decompress a run length encoded compressed bit-vector in a SIMD architecture is presented. A method to return the offset of each bit set to one in a bit-vector in a SIMD architecture is presented. A method to fetch bits from a bit-vector at specified offsets relative to a base in a SIMD architecture is presented. A method to compare values stored in two SIMD registers is presented.

公开(公告)号：US09559720B2

公开(公告)日：2017-01-31

申请号：US13631575

申请日：2012-09-28

Applicant: Oracle International Corporation

Inventor： Vineet Marwah ,  Vikram Kapoor ,  Amit Ganesh ,  Jesse Kemp ,  Sachin Kulkarni ,  Roger Macnicol ,  Kam Shergill ,  Manosiz Bhattacharyya

IPC: G06F17/30 ,  H03M7/30

CPC classification number: H03M7/30 ,  G06F17/30595

Abstract: Techniques are described herein for automatically selecting the compression techniques to be used on tabular data. A compression analyzer gives users high-level control over the selection process without requiring the user to know details about the specific compression techniques that are available to the compression analyzer. Users are able to specify, for a given set of data, a “balance point” along the spectrum between “maximum performance” and “maximum compression”. The point thus selected is used by the compression analyzer in a variety of ways. For example, in one embodiment, the compression analyzer uses the user-specified balance point to determine which of the available compression techniques qualify as “candidate techniques” for the given set of data. The compression analyzer selects the compression technique to use on a set of data by actually testing the candidate compression techniques against samples from the set of data. After testing the candidate compression techniques against the samples, the resulting compression ratios are compared. The compression technique to use on the set of data is then selected based, in part, on the compression ratios achieved during the compression tests performed on the sample data.

Abstract translation: 这里描述了用于自动选择要在表格数据上使用的压缩技术的技术。 压缩分析仪为用户提供了对选择过程的高级控制，而不需要用户了解有关压缩分析器可用的特定压缩技术的细节。 用户可以为给定的数据集指定沿“最大性能”和“最大压缩”之间的“平衡点”。 所选择的点由压缩分析器以各种方式使用。 例如，在一个实施例中，压缩分析器使用用户指定的平衡点来确定哪个可用的压缩技术符合给定的数据集合的“候选技术”。 压缩分析仪通过对来自该组数据的样本实际测试候选压缩技术来选择对一组数据使用的压缩技术。 在针对样品测试候选压缩技术之后，比较所得到的压缩比。 然后，部分地基于在对样本数据执行的压缩测试期间实现的压缩比来选择在该组数据上使用的压缩技术。

公开(公告)号：US20140013076A1

公开(公告)日：2014-01-09

申请号：US14023064

申请日：2013-09-10

Applicant: Oracle International Corporation

Inventor： Amit Ganesh ,  Shasank K. Chavan ,  Vineet Marwah ,  Jesse Kamp ,  Anindya C. Patthak ,  Michael J. Gleeson ,  Allison L. Holloway ,  Roger Macnicol

IPC: G06F9/30

CPC classification number: G06F9/30036 ,  G06F9/30032 ,  G06F17/30315

Abstract: A method and apparatus for efficiently processing data in various formats in a single instruction multiple data (“SIMD”) architecture is presented. Specifically, a method to unpack a fixed-width bit values in a bit stream to a fixed width byte stream in a SIMD architecture is presented. A method to unpack variable-length byte packed values in a byte stream in a SIMD architecture is presented. A method to decompress a run length encoded compressed bit-vector in a SIMD architecture is presented. A method to return the offset of each bit set to one in a bit-vector in a SIMD architecture is presented. A method to fetch bits from a bit-vector at specified offsets relative to a base in a SIMD architecture is presented. A method to compare values stored in two SIMD registers is presented.

公开(公告)号：US20130036101A1

公开(公告)日：2013-02-07

申请号：US13631575

申请日：2012-09-28

Applicant: Oracle International Corporation

Inventor： Vineet Marwah ,  Vikram Kapoor ,  Amit Ganesh ,  Jesse Kemp ,  Sachin Kulkarni ,  Roger Macnicol ,  Kam Shergill ,  Manosiz Bhattacharyya

IPC: G06F17/30

CPC classification number: H03M7/30 ,  G06F17/30595

Abstract: Techniques are described herein for automatically selecting the compression techniques to be used on tabular data. A compression analyzer gives users high-level control over the selection process without requiring the user to know details about the specific compression techniques that are available to the compression analyzer. Users are able to specify, for a given set of data, a “balance point” along the spectrum between “maximum performance” and “maximum compression”. The point thus selected is used by the compression analyzer in a variety of ways. For example, in one embodiment, the compression analyzer uses the user-specified balance point to determine which of the available compression techniques qualify as “candidate techniques” for the given set of data. The compression analyzer selects the compression technique to use on a set of data by actually testing the candidate compression techniques against samples from the set of data. After testing the candidate compression techniques against the samples, the resulting compression ratios are compared. The compression technique to use on the set of data is then selected based, in part, on the compression ratios achieved during the compression tests performed on the sample data.

Abstract translation: 这里描述了用于自动选择要在表格数据上使用的压缩技术的技术。 压缩分析仪为用户提供了对选择过程的高级控制，而不需要用户了解有关压缩分析器可用的特定压缩技术的细节。 用户可以为给定的数据集指定沿最大性能和最大压缩之间的平衡点。 所选择的点由压缩分析器以各种方式使用。 例如，在一个实施例中，压缩分析器使用用户指定的平衡点来确定哪些可用的压缩技术被鉴定为用于给定的一组数据的候选技术。 压缩分析仪通过对来自该组数据的样本实际测试候选压缩技术来选择对一组数据使用的压缩技术。 在针对样品测试候选压缩技术之后，比较所得到的压缩比。 然后，部分地基于在对样本数据执行的压缩测试期间实现的压缩比来选择在该组数据上使用的压缩技术。

公开(公告)号：US20140281247A1

公开(公告)日：2014-09-18

申请号：US13840811

申请日：2013-03-15

Applicant: Oracle International Corporation

Inventor： Juan Loaiza ,  Amit Ganesh ,  Roger Macnicol ,  Jesse Kamp ,  Allison Holloway ,  Adrian Ng ,  Vineet Marwah

IPC: G06F12/08

CPC classification number: G06F12/0875 ,  G06F17/30312 ,  G06F17/3048

Abstract: A method for accelerating queries using dynamically generated columnar data in a flash cache is provided. In an embodiment, a method comprises a storage device receiving a first request for data that is stored in the storage device in a base major format in one or more primary storage devices. The storage device comprises a cache. The base major format is any one of: a row-major format, a column-major format and a hybrid-columnar format. Based on first one or more criteria, it is determined whether to rewrite the data into rewritten data in a rewritten major format. In response to determining to rewrite the data into rewritten data in a rewritten major format, the storage device rewrites at least a portion of the data into particular rewritten data in the rewritten major format. The rewritten data is stored in the cache.

Abstract translation: 提供了一种使用Flash缓存中的动态生成的列数据来加速查询的方法。 在一个实施例中，一种方法包括存储设备，其以一个或多个主存储设备中的主要主要格式接收存储在存储设备中的数据的第一请求。 存储设备包括高速缓存。 基本主要格式是以下主题之一：行主格式，列主格式和混合列格式。 基于第一个或多个标准，确定是否以重写的主要格式将数据重写为重写的数据。 响应于确定以重写的主要格式将数据重写为重写数据，存储设备将至少一部分数据重写为重写的主要格式的特定重写数据。 重写的数据存储在缓存中。

公开(公告)号：US20140013078A1

公开(公告)日：2014-01-09

申请号：US14023265

申请日：2013-09-10

Applicant: Oracle International Corporation

Inventor： Amit Ganesh ,  Shasank K. Chavan ,  Vineet Marwah ,  Jesse Kamp ,  Anindya C. Patthak ,  Michael J. Gleeson ,  Allison L. Holloway ,  Roger Macnicol

IPC: G06F9/38

CPC classification number: G06F9/3887 ,  G06F9/30018 ,  G06F9/30032 ,  G06F9/30036 ,  G06F9/30109 ,  G06F9/30112 ,  G06F9/3836 ,  G06F9/3842 ,  G06F9/3851 ,  G06F9/3867 ,  G06F9/3885 ,  G06F17/30315

Abstract: A method and apparatus for efficiently processing data in various formats in a single instruction multiple data (“SIMD”) architecture is presented. Specifically, a method to unpack a fixed-width bit values in a bit stream to a fixed width byte stream in a SIMD architecture is presented. A method to unpack variable-length byte packed values in a byte stream in a SIMD architecture is presented. A method to decompress a run length encoded compressed bit-vector in a SIMD architecture is presented. A method to return the offset of each bit set to one in a bit-vector in a SIMD architecture is presented. A method to fetch bits from a bit-vector at specified offsets relative to a base in a SIMD architecture is presented. A method to compare values stored in two SIMD registers is presented.

Abstract translation: 提出了一种在单指令多数据（“SIMD”）结构中有效处理各种格式的数据的方法和装置。 具体地说，提出了一种在SIMD架构中将位流中的固定宽度位值解包为固定宽度字节流的方法。 介绍了一种解码SIMD架构中字节流中可变长度字节打包值的方法。 提出了一种在SIMD架构中解压缩运行长度编码的压缩位向量的方法。 提出了一种在SIMD架构中将位设置为1的偏移量返回到位向量中的方法。 提出了一种从SIMD架构中相对于基址指定的偏移量从位向量获取位的方法。 提出了一种比较存储在两个SIMD寄存器中的值的方法。

公开(公告)号：US11520743B2

公开(公告)日：2022-12-06

申请号：US14079507

申请日：2013-11-13

Applicant: Oracle International Corporation

Inventor： Vikram Kapoor ,  Amit Ganesh ,  Jesse Kamp ,  Sachin Kulkarni ,  Vineet Marwah ,  Kam Shergill ,  Roger Macnicol ,  Manosiz Bhattacharyya

IPC: G06F16/174 ,  G06F16/2455 ,  G06F16/901

Abstract: A database server stores compressed units in data blocks of a database. A table (or data from a plurality of rows thereof) is first compressed into a “compression unit” using any of a wide variety of compression techniques. The compression unit is then stored in one or more data block rows across one or more data blocks. As a result, a single data block row may comprise compressed data for a plurality of table rows, as encoded within the compression unit. Storage of compression units in data blocks maintains compatibility with existing data block-based databases, thus allowing the use of compression units in preexisting databases without modification to the underlying format of the database. The compression units may, for example, co-exist with uncompressed tables. Various techniques allow a database server to optimize access to data in the compression unit, so that the compression is virtually transparent to the user.

公开(公告)号：US10296462B2

公开(公告)日：2019-05-21

申请号：US13840811

申请日：2013-03-15

Applicant: Oracle International Corporation

Inventor： Juan Loaiza ,  Amit Ganesh ,  Roger Macnicol ,  Jesse Kamp ,  Allison Holloway ,  Adrian Ng ,  Vineet Marwah

IPC: G06F12/08 ,  G06F12/0875 ,  G06F16/22 ,  G06F16/2455

Abstract: A method for accelerating queries using dynamically generated columnar data in a flash cache is provided. In an embodiment, a method comprises a storage device receiving a first request for data that is stored in the storage device in a base major format in one or more primary storage devices. The storage device comprises a cache. The base major format is any one of: a row-major format, a column-major format and a hybrid-columnar format. Based on first one or more criteria, it is determined whether to rewrite the data into rewritten data in a rewritten major format. In response to determining to rewrite the data into rewritten data in a rewritten major format, the storage device rewrites at least a portion of the data into particular rewritten data in the rewritten major format. The rewritten data is stored in the cache.

公开(公告)号：US09342314B2

公开(公告)日：2016-05-17

申请号：US14023265

申请日：2013-09-10

Applicant: Oracle International Corporation

Inventor： Amit Ganesh ,  Shasank K. Chavan ,  Vineet Marwah ,  Jesse Kamp ,  Anindya C. Patthak ,  Michael J. Gleeson ,  Allison L. Holloway ,  Roger Macnicol

IPC: G06F9/30 ,  G06F9/38 ,  G06F17/30

CPC classification number: G06F9/3887 ,  G06F9/30018 ,  G06F9/30032 ,  G06F9/30036 ,  G06F9/30109 ,  G06F9/30112 ,  G06F9/3836 ,  G06F9/3842 ,  G06F9/3851 ,  G06F9/3867 ,  G06F9/3885 ,  G06F17/30315

Abstract: A method and apparatus for efficiently processing data in various formats in a single instruction multiple data (“SIMD”) architecture is presented. Specifically, a method to unpack a fixed-width bit values in a bit stream to a fixed width byte stream in a SIMD architecture is presented. A method to unpack variable-length byte packed values in a byte stream in a SIMD architecture is presented. A method to decompress a run length encoded compressed bit-vector in a SIMD architecture is presented. A method to return the offset of each bit set to one in a bit-vector in a SIMD architecture is presented. A method to fetch bits from a bit-vector at specified offsets relative to a base in a SIMD architecture is presented. A method to compare values stored in two SIMD registers is presented.

Abstract translation: 提出了一种在单指令多数据（“SIMD”）结构中有效处理各种格式的数据的方法和装置。 具体地说，提出了一种在SIMD架构中将位流中的固定宽度位值解包为固定宽度字节流的方法。 介绍了一种解码SIMD架构中字节流中可变长度字节打包值的方法。 提出了一种在SIMD架构中解压缩运行长度编码的压缩位向量的方法。 提出了一种在SIMD架构中将位设置为1的偏移量返回到位向量中的方法。 提出了一种从SIMD架构中相对于基址指定的偏移量从位向量获取位的方法。 提出了一种比较存储在两个SIMD寄存器中的值的方法。