公开(公告)号：US10055158B2

公开(公告)日：2018-08-21

申请号：US15272951

申请日：2016-09-22

申请人： QUALCOMM Incorporated

发明人： Colin Beaton Verrilli ,  Carl Alan Waldspurger ,  Natarajan Vaidhyanathan ,  Mattheus Cornelis Antonius Adrianus Heddes ,  Koustav Bhattacharya

IPC分类号： G06F12/0891 ,  G06F3/06 ,  G06F12/0802 ,  G06F13/16

CPC分类号： G06F3/0629 ,  G06F3/0604 ,  G06F3/0685 ,  G06F12/0802 ,  G06F12/0804 ,  G06F12/0891 ,  G06F12/126 ,  G06F13/1668 ,  G06F13/1694 ,  G06F2212/1016 ,  G06F2212/20 ,  G06F2212/60 ,  G06F2212/601

摘要： Providing flexible management of heterogeneous memory systems using spatial Quality of Service (QoS) tagging in processor-based systems is disclosed. In one aspect, a heterogeneous memory system of a processor-based system includes a first memory and a second memory. The heterogeneous memory system is divided into a plurality of memory regions, each associated with a QoS identifier (QoSID), which may be set and updated by software. A memory controller of the heterogeneous memory system provides a QoS policy table, which operates to associate each QoSID with a QoS policy state, and which also may be software-configurable. Upon receiving a memory access request including a memory address of a memory region, the memory controller identifies a software-configurable QoSID associated with the memory address, and associates the QoSID with a QoS policy state using the QoS policy table. The memory controller then applies the QoS policy state to perform the memory access operation.

公开(公告)号：US20170286214A1

公开(公告)日：2017-10-05

申请号：US15085350

申请日：2016-03-30

申请人： QUALCOMM Incorporated

发明人： Natarajan Vaidhyanathan ,  Mattheus Cornelis Antonius Adrianus Heddes ,  Colin Beaton Verrilli

IPC分类号： G06F11/10 ,  G06F12/08 ,  G11C7/10

CPC分类号： G06F11/1064 ,  G06F12/0806 ,  G06F12/0895 ,  G06F2212/1008 ,  G06F2212/40 ,  G06F2212/403 ,  G06F2212/621 ,  G06F2212/7209 ,  G11C7/1072

摘要： Providing space-efficient storage for dynamic random access memory (DRAM) cache tags is provided. In one aspect, a DRAM cache management circuit provides a plurality of cache entries, each of which contains a tag storage region, a data storage region, and an error protection region. The DRAM cache management circuit is configured to store data to be cached in the data storage region of each cache entry. The DRAM cache management circuit is also configured to use an error detection code (EDC) instead of an error correcting code (ECC), and to store a tag and the EDC for each cache entry in the error protection region of the cache entry. In this manner, the capacity of a DRAM cache can be increased by avoiding the need for the tag storage region for each cache entry, while still providing error detection for the cache entry.

公开(公告)号：US09740621B2

公开(公告)日：2017-08-22

申请号：US14716108

申请日：2015-05-19

申请人： QUALCOMM Incorporated

发明人： Mattheus Cornelis Antonius Adrianus Heddes ,  Natarajan Vaidhyanathan ,  Colin Beaton Verrilli

IPC分类号： G06F12/00 ,  G06F13/00 ,  G06F12/0875 ,  G06F12/0862 ,  G06F12/02 ,  G06F12/1009 ,  H03M7/30

CPC分类号： G06F12/0875 ,  G06F12/0246 ,  G06F12/0862 ,  G06F12/1009 ,  G06F2212/1016 ,  G06F2212/1056 ,  G06F2212/251 ,  G06F2212/401 ,  G06F2212/45 ,  G06F2212/602 ,  H03M7/30 ,  Y02D10/13

摘要： Memory controllers employing memory capacity and/or bandwidth compression with next read address prefetching, and related processor-based systems and methods are disclosed. In certain aspects, memory controllers are employed that can provide memory capacity compression. In certain aspects disclosed herein, a next read address prefetching scheme can be used by a memory controller to speculatively prefetch data from system memory at another address beyond the currently accessed address. Thus, when memory data is addressed in the compressed memory, if the next read address is stored in metadata associated with the memory block at the accessed address, the memory data at the next read address can be prefetched by the memory controller to be available in case a subsequent read operation issued by a central processing unit (CPU) has been prefetched by the memory controller.

公开(公告)号：US11144368B2

公开(公告)日：2021-10-12

申请号：US16443954

申请日：2019-06-18

申请人： QUALCOMM Incorporated

发明人： Colin Beaton Verrilli ,  Natarajan Vaidhyanathan

IPC分类号： G06F9/46 ,  G06F9/52

摘要： Providing self-resetting multi-producer multi-consumer semaphores in distributed processor-based systems is disclosed. In one aspect, a synchronization management circuit provides a semaphore including a counting semaphore value indicator, a current wait count indicator, and a target wait count indicator. When a consumer completes a wait operation, the synchronization management circuit adjusts the value of the current wait count indicator towards the value of the target wait count indicator, and compares the value of the current wait count indicator to the value of the target wait count indicator. If the value of the current wait count indicator has reached the value of the target wait count indicator, the synchronization management circuit infers that all consumers have observed the semaphore, and accordingly resets both the counting semaphore value indicator and the current wait count indicator to an initial wait value to place the semaphore in its initial state for reuse.

公开(公告)号：US10936943B2

公开(公告)日：2021-03-02

申请号：US16117952

申请日：2018-08-30

申请人： QUALCOMM Incorporated

发明人： Colin Beaton Verrilli ,  Mattheus Cornelis Antonius Adrianus Heddes ,  Natarajan Vaidhyanathan ,  Koustav Bhattacharya ,  Robert Dreyer

IPC分类号： G06N3/063 ,  G06F15/80 ,  G06F17/16 ,  G06N3/04

摘要： Providing flexible matrix processors for performing neural network convolution in matrix-processor-based devices is disclosed. In this regard, a matrix-processor-based device provides a central processing unit (CPU) and a matrix processor. The matrix processor reorganizes a plurality of weight matrices and a plurality of input matrices into swizzled weight matrices and swizzled input matrices, respectively, that have regular dimensions natively supported by the matrix processor. The matrix-processor-based device then performs a convolution operation using the matrix processor to perform matrix multiplication/accumulation operations for the regular dimensions of the weight matrices and the input matrices, and further uses the CPU to execute instructions for handling the irregular dimensions of the weight matrices and the input matrices (e.g., by executing a series of nested loops, as a non-limiting example). The matrix-processor-based device thus provides efficient hardware acceleration by taking advantage of dimensional regularity, while maintaining the flexibility to handle different variations of convolution.

公开(公告)号：US10747501B2

公开(公告)日：2020-08-18

申请号：US16118099

申请日：2018-08-30

申请人： QUALCOMM Incorporated

发明人： Mattheus Cornelis Antonius Adrianus Heddes ,  Natarajan Vaidhyanathan ,  Robert Dreyer ,  Colin Beaton Verrilli ,  Koustav Bhattacharya

IPC分类号： G06F7/483 ,  G06F7/544 ,  G06F15/80 ,  G06F7/499 ,  G06F15/78

摘要： Providing efficient floating-point operations using matrix processors in processor-based systems is disclosed. In this regard, a matrix-processor-based device provides a matrix processor comprising a positive partial sum accumulator and a negative partial sum accumulator. As the matrix processor processes pairs of floating-point operands, the matrix processor calculates an intermediate product based on a first floating-point operand and a second floating-point operand and determines a sign of the intermediate product. Based on the sign, the matrix processor normalizes the intermediate product with a partial sum fraction of the positive partial sum accumulator or the negative partial sum accumulator, then adds the intermediate product to the positive sum accumulator or the negative sum accumulator. After processing all pairs of floating-point operands, the matrix processor subtracts the negative partial sum accumulator from the positive partial sum accumulator to generate a final sum, then renormalizes the final sum a single time.

公开(公告)号：US20190079903A1

公开(公告)日：2019-03-14

申请号：US16129480

申请日：2018-09-12

申请人： QUALCOMM Incorporated

发明人： Robert Dreyer ,  Mattheus Cornelis Antonius Adrianus Heddes ,  Colin Beaton Verrilli ,  Natarajan Vaidhyanathan ,  Koustav Bhattacharya

IPC分类号： G06F17/16 ,  G06F15/80

摘要： Providing matrix multiplication using vector registers in processor-based devices is disclosed. In one aspect, a method for providing matrix multiplication comprises rearranging elements of a first submatrix and a second submatrix into first and second vectors, respectively, which are stored in first and second vector registers. A matrix multiplication vector operation using the first and second vector registers as input operands is then performed to generate an output vector that is stored in an output vector register. Each element E of the output vector, where 0≤E

公开(公告)号：US10176090B2

公开(公告)日：2019-01-08

申请号：US15266765

申请日：2016-09-15

申请人： QUALCOMM Incorporated

发明人： Colin Beaton Verrilli ,  Natarajan Vaidhyanathan ,  Mattheus Cornelis Antonius Adrianus Heddes

IPC分类号： G06F12/02 ,  G06F12/0804 ,  G06F12/0866 ,  G06F12/0875 ,  H04L29/06 ,  H04L12/811

摘要： Providing memory bandwidth compression using adaptive compression in central processing unit (CPU)-based systems is disclosed. In one aspect, a compressed memory controller (CMC) is configured to implement two compression mechanisms: a first compression mechanism for compressing small amounts of data (e.g., a single memory line), and a second compression mechanism for compressing large amounts of data (e.g., multiple associated memory lines). When performing a memory write operation using write data that includes multiple associated memory lines, the CMC compresses each of the memory lines separately using the first compression mechanism, and also compresses the memory lines together using the second compression mechanism. If the result of the second compression is smaller than the result of the first compression, the CMC stores the second compression result in the system memory. Otherwise, the first compression result is stored.

公开(公告)号：US10146693B2

公开(公告)日：2018-12-04

申请号：US15718449

申请日：2017-09-28

申请人： QUALCOMM Incorporated

发明人： Colin Beaton Verrilli ,  Mattheus Cornelis Antonius Adrianus Heddes ,  Mark Anthony Rinaldi ,  Natarajan Vaidhyanathan

IPC分类号： G06F12/04 ,  G06F12/12 ,  G06F12/0875 ,  G06F12/0897 ,  G06F12/084 ,  G06F12/0811 ,  G06F12/0862

摘要： Providing memory bandwidth compression using multiple last-level cache (LLC) lines in a central processing unit (CPU)-based system is disclosed. In some aspects, a compressed memory controller (CMC) provides an LLC comprising multiple LLC lines, each providing a plurality of sub-lines the same size as a system cache line. The contents of the system cache line(s) stored within a single LLC line are compressed and stored in system memory within the memory sub-line region corresponding to the LLC line. A master table stores information indicating how the compressed data for an LLC line is stored in system memory by storing an offset value and a length value for each sub-line within each LLC line. By compressing multiple system cache lines together and storing compressed data in a space normally allocated to multiple uncompressed system lines, the CMC enables compression sizes to be smaller than the memory read/write granularity of the system memory.

公开(公告)号：US10067706B2

公开(公告)日：2018-09-04

申请号：US15086882

申请日：2016-03-31

申请人： QUALCOMM Incorporated

发明人： Colin Beaton Verrilli ,  Mattheus Cornelis Antonius Adrianus Heddes ,  Natarajan Vaidhyanathan

IPC分类号： G06F12/08 ,  G06F12/10 ,  G06F3/06 ,  G06F11/10 ,  G06F12/02 ,  G06F12/0875 ,  H03M7/30 ,  H03M13/00 ,  G06F12/0862 ,  G06F12/12

CPC分类号： G06F3/0638 ,  G06F3/0604 ,  G06F3/0632 ,  G06F3/0673 ,  G06F11/1004 ,  G06F11/1048 ,  G06F11/1076 ,  G06F12/0223 ,  G06F12/0862 ,  G06F12/0875 ,  G06F12/12 ,  G06F2212/1024 ,  G06F2212/1044 ,  G06F2212/401 ,  G06F2212/403 ,  G06F2212/466 ,  H03M7/30 ,  H03M13/6312 ,  Y02D10/13

摘要： Providing memory bandwidth compression using compression indicator (CI) hint directories in a central processing unit (CPU)-based system is disclosed. In this regard, a compressed memory controller provides a CI hint directory comprising a plurality of CI hint directory entries, each providing a plurality of CI hints. The compressed memory controller is configured to receive a memory read request comprising a physical address of a memory line, and initiate a memory read transaction comprising a requested read length value. The compressed memory controller is further configured to, in parallel with initiating the memory read transaction, determine whether the physical address corresponds to a CI hint directory entry in the CI hint directory. If so, the compressed memory controller reads a CI hint from the CI hint directory entry of the CI hint directory, and modifies the requested read length value of the memory read transaction based on the CI hint.