Splitting of input data for processing in neural network processor

    公开(公告)号:US11783174B2

    公开(公告)日:2023-10-10

    申请号:US15971332

    申请日:2018-05-04

    Applicant: Apple Inc.

    CPC classification number: G06N3/08 G06N3/045 G06N3/06 G06N7/04

    Abstract: Embodiments of the present disclosure relate to splitting input data into smaller units for loading into a data buffer and neural engines in a neural processor circuit for performing neural network operations. The input data of a large size is split into slices and each slice is again split into tiles. The tile is uploaded from an external source to a data buffer inside the neural processor circuit but outside the neural engines. Each tile is again split into work units sized for storing in an input buffer circuit inside each neural engine. The input data stored in the data buffer and the input buffer circuit is reused by the neural engines to reduce re-fetching of input data. Operations of splitting the input data are performed at various components of the neural processor circuit under the management of rasterizers provided in these components.

    Convolution streaming engine for deep neural networks

    公开(公告)号:US11593637B2

    公开(公告)日:2023-02-28

    申请号:US16399928

    申请日:2019-04-30

    Abstract: A method, an electronic device, and computer readable medium are provided. The method includes receiving an input into a neural network that includes a kernel. The method also includes generating, during a convolution operation of the neural network, multiple panel matrices based on different portions of the input. The method additionally includes successively combining each of the multiple panel matrices with the kernel to generate an output. Generating the multiple panel matrices can include mapping elements within a moving window of the input onto columns of an indexing matrix, where a size of the window corresponds to the size of the kernel.

    REASONING WITH REAL-VALUED PROPOSITIONAL LOGIC AND PROBABILITY INTERVALS

    公开(公告)号:US20220398479A1

    公开(公告)日:2022-12-15

    申请号:US17346913

    申请日:2021-06-14

    Inventor: Radu Marinescu

    Abstract: In an approach for reasoning with real-valued propositional logic, a processor receives a set of propositional logic formulae, a set of intervals representing upper and lower bounds on truth values of a set of atomic propositions in the set of propositional logic formulae, and a query. A processor generates a logical neural network based on the set of propositional logic formulae and the set of intervals representing upper and lower bounds on truth values. A processor generates a credal network with a same structure of the logical neural network. A processor runs probabilistic inference on the credal network to compute a conditional probability based on the query. A processor outputs the conditional probability as an answer to the query.

    Power-driven synthesis under latency constraints

    公开(公告)号:US10354183B2

    公开(公告)日:2019-07-16

    申请号:US14537857

    申请日:2014-11-10

    Abstract: Embodiments of the present invention relate to meeting latency constraints in a multi-core neurosynaptic network. In one embodiment of the present invention, a method of and computer program product for power-driven synthesis under latency constraints is provided. Power consumption of a neurosynaptic network is modeled as wire length. The neurosynaptic network comprises a plurality of neurosynaptic cores. Each of the plurality of neurosynaptic cores is modeled as a node in a placement graph. The graph has a plurality of edges. A weight is assigned to each of the plurality of edges based on a spike frequency. An arrangement of the neurosynaptic cores is determined. The arrangement comprises a length of each of the plurality of edges. A maximum length is compared to the length of each of the plurality of edges. The weight of at least one of the plurality of edges is increased where the length is greater than the maximum length.

Patent Agency Ranking