-
公开(公告)号:US11188814B2
公开(公告)日:2021-11-30
申请号:US15945952
申请日:2018-04-05
Applicant: Arm Limited
Inventor: Paul Nicholas Whatmough , Ian Rudolf Bratt , Matthew Mattina
Abstract: A circuit and method are provided for performing convolutional neural network computations for a neural network. The circuit includes a transposing buffer configured to receive actuation feature vectors along a first dimension and to output feature component vectors along a second dimension, a weight buffer configured to store kernel weight vectors along a first dimension and further configured to output kernel component vectors along a second dimension, and a systolic array configured to receive the kernel weight vectors along a first dimension and to receive the feature component vectors along a second dimension. The systolic array includes an array of multiply and accumulate (MAC) processing cells. Each processing cell is associated with an output value. The actuation feature vectors may be shifted into the transposing buffer along the first dimension and output feature component vectors may shifted out of the transposing buffer along the second dimension, providing efficient dataflow.
-
公开(公告)号:US10664399B2
公开(公告)日:2020-05-26
申请号:US15825633
申请日:2017-11-29
Applicant: ARM Limited
Inventor: Håkan Lars-Göran Persson , Ian Rudolf Bratt , Andrew Brookfield Swaine , Bruce James Mathewson
IPC: G06F12/0831 , G06F13/16
Abstract: A filter comprises interface circuitry, to intercept coherency protocol transactions exchanged between a master device comprising a first cache and an interconnect for managing coherency between the first cache and at least one other cache or other master device. The filter has filtering circuitry for filtering the coherency protocol transactions in dependence on memory access permission data defining which regions of an address space the master device is allowed to access.
-
公开(公告)号:US11249908B1
公开(公告)日:2022-02-15
申请号:US17023771
申请日:2020-09-17
Applicant: Arm Limited
Inventor: Ole Henrik Jahren , Ian Rudolf Bratt , Sigurd Røed Scheistrøen
IPC: G06F12/00 , G06F12/0831 , G06F12/0891 , G06F9/30 , G06F9/54 , G06F12/02
Abstract: An apparatus and method are disclosed for managing cache coherency. The apparatus has a plurality of agents with cache storage for caching data, and coherency control circuitry for acting as a point of coherency for the data by implementing a cache coherency protocol. In accordance with the cache coherency protocol the coherency control circuitry responds to certain coherency events by issuing coherency messages to one or more of the agents. A given agent is arranged, prior to entering a given state in which its cache storage is unused, to perform a flush operation in respect of its cache storage that may cause one or more evict messages to be issued to the coherency control circuitry. Further, once all evict messages resulting from performance of the flush operation has been issued, the given agent issues an evict barrier message to the coherency control circuitry. The apparatus ensures that the evict barrier message is only processed by the coherency control circuitry once all evict messages resulting from performance of the flush operation have been processed by the coherency control circuitry. When processing the evict barrier message, the coherency control circuitry issues a barrier response message to the given agent once it is determined that there are no outstanding coherency messages, and the given agent defers entering the given state until at least the barrier response message is received.
-
公开(公告)号:US11127110B2
公开(公告)日:2021-09-21
申请号:US15446997
申请日:2017-03-01
Applicant: ARM Limited , APICAL LIMITED
Inventor: Ian Rudolf Bratt , Alexander Eugene Chalfin , Eric Kunze , Paul Stanley Hughes , Alex Kornienko , Damian Piotr Modrzyk , Metin Gokhan Ünal , Jonathan Adam Lawton
Abstract: A display controller 93 in a data processing system includes a timewarp module (transformation circuitry) 100 that is operable to perform timewarp processing of a rendered frame 92 generated by a graphics processor (GPU) 91 for provision to a display panel 94. The timewarp module (transformation circuitry) 100 operates to transform an input surface 92 read by the display controller 93 based on received view orientation data to provide an appropriately “timewarped” transformed version of the input surface as an output transformed surface for display on the display 94.
-
公开(公告)号:US10956045B2
公开(公告)日:2021-03-23
申请号:US14969414
申请日:2015-12-15
Applicant: ARM Limited
Inventor: Andreas Hansson , Ian Rudolf Bratt
Abstract: An apparatus and method are provided for issuing access requests to a memory controller for a memory device whose memory structure consists of a plurality of sub-structures. The apparatus has a request interface for issuing access requests to the memory controller, each access request identifying a memory address. Within the apparatus static abstraction data is stored providing an indication of one or more of the sub-structures of the memory device, and the apparatus also stores an indication of outstanding access requests issued from the request interface. Next access request selection circuitry is then arranged to select from a plurality of candidate access requests a next access request to issue from the request interface. That selection is dependent on sub-structure indication data that is derived from application of an abstraction data function, using the static abstraction data, to the memory addresses of the candidate access requests and the outstanding access requests. Such an approach enables the apparatus to provide a series of access requests to the memory controller with the aim of enabling the memory controller to perform a more optimal access sequence with regard to the memory device.
-
公开(公告)号:US11449729B2
公开(公告)日:2022-09-20
申请号:US16676757
申请日:2019-11-07
Applicant: Arm Limited
Inventor: Lingchuan Meng , Danny Daysang Loh , Ian Rudolf Bratt , Alexander Eugene Chalfin , Tianmu Li
IPC: G06N3/04 , G06N3/06 , G06N3/08 , G06N3/10 , G06F17/15 , G06F17/16 , G06F17/18 , G06F30/18 , G06F30/20 , G06F30/27 , G06F30/33 , G06F30/367
Abstract: The present disclosure advantageously provides a system and a method for convolving data in a quantized convolutional neural network (CNN). The method includes selecting a set of complex interpolation points, generating a set of complex transform matrices based, at least in part, on the set of complex interpolation points, receiving an input volume from a preceding layer of the quantized CNN, performing a complex Winograd convolution on the input volume and at least one filter, using the set of complex transform matrices, to generate an output volume, and sending the output volume to a subsequent layer of the quantized CNN.
-
公开(公告)号:US11127187B2
公开(公告)日:2021-09-21
申请号:US16697984
申请日:2019-11-27
Applicant: Arm Limited
Inventor: Ian Rudolf Bratt , Andreas Due Engh-Halstvedt , Alexander Eugene Chalfin , Andreas Loeve Selvik , Olof Henrik Uhrenholt , Thomas J. Olson
Abstract: When processing graphics primitives in a graphics processing system, the render output is divided into a plurality of regions (40) for rendering, each region (40) comprising a respective area of the render output; and for sets of one or more primitives to be rendered, it is determined for which of the plurality of regions of the render output (40) the primitive(s) should be rendered; and for each region of the render output (40) it is determined the primitive(s) should be rendered for, geometry data for the primitive(s) is stored in memory in a respective data structure (42) along with an indication of state data that is to be used for rendering the primitive(s) for the region, such that the geometry data for the primitive(s) to be rendered is stored in a respective, different data structure (42) for each different region of the render output (40) it is determined the primitive(s) should be rendered for.
-
公开(公告)号:US20190311243A1
公开(公告)日:2019-10-10
申请号:US15945952
申请日:2018-04-05
Applicant: Arm Limited
Inventor: Paul Nicholas Whatmough , Ian Rudolf Bratt , Matthew Mattina
Abstract: A circuit and method are provided for performing convolutional neural network computations for a neural network. The circuit includes a transposing buffer configured to receive actuation feature vectors along a first dimension and to output feature component vectors along a second dimension, a weight buffer configured to store kernel weight vectors along a first dimension and further configured to output kernel component vectors along a second dimension, and a systolic array configured to receive the kernel weight vectors along a first dimension and to receive the feature component vectors along a second dimension. The systolic array includes an array of multiply and accumulate (MAC) processing cells. Each processing cell is associated with an output value. The actuation feature vectors may be shifted into the transposing buffer along the first dimension and output feature component vectors may shifted out of the transposing buffer along the second dimension, providing efficient dataflow.
-
公开(公告)号:US10157132B1
公开(公告)日:2018-12-18
申请号:US15661200
申请日:2017-07-27
Applicant: ARM Limited
Inventor: Edvard Fielding , Andreas Due Engh-Halstvedt , Jorn Nystad , Antonio Garcia Guirado , William Robert Stoye , Ian Rudolf Bratt
IPC: G06F12/00 , G06F13/00 , G06F13/28 , G06F12/0811 , G06F12/0875 , G06F12/0862 , G06F12/0846 , G06F12/0868
Abstract: A method of operating a data processing system comprises maintaining record of a set of processing passes to be performed by processing pass circuitry of the data processing system. The method comprises performing cycles of operation in which it is considered whether or not the data required for a subset of processing passes is stored in a local cache. The subset of processing passes that is considered in a subsequent scan of the record comprises at least one processing pass that was not considered in the previous scan of the record, regardless of whether or not the data considered in the previous scan is determined as being stored in the cache. The method provides an efficient way to identify processing passes that are ready to be performed.
-
公开(公告)号:US11948069B2
公开(公告)日:2024-04-02
申请号:US16518444
申请日:2019-07-22
Applicant: Arm Limited
Inventor: Lingchuan Meng , John Wakefield Brothers, III , Jens Olson , Jared Corey Smolens , Eric Kunze , Ian Rudolf Bratt
Abstract: A processor arranged to compress neural network activation data comprising an input module for obtaining neural network activation data. The processor also comprises a block creation module arranged to split the neural network activation data into a plurality of blocks; and a metadata generation module for generating metadata associated with at least one of the plurality of blocks. Based on the metadata generated a selection module selects a compression scheme for each of the plurality of blocks, and a compression module for applying the selected compression scheme to the corresponding block to produce compressed neural network activation data. An output module is also provided for outputting the compressed neural network activation data.
-
-
-
-
-
-
-
-
-