STATIC AND DYNAMIC PRECISION ADAPTATION FOR HARDWARE LEARNING AND CLASSIFICATION

    公开(公告)号:US20170300815A1

    公开(公告)日:2017-10-19

    申请号:US15487117

    申请日:2017-04-13

    申请人: Jae-sun Seo

    发明人: Jae-sun Seo

    IPC分类号: G06N3/08 G06N3/04

    CPC分类号: G06N3/08 G06N3/063

    摘要: An information processing system, which includes a control system and an artificial neural network, is disclosed. The artificial neural network includes a group of neurons and a group of synapses, which includes a first portion and a second portion. The control system selects one of a group of operating modes. The group of neurons processes information. The group of synapses provide connectivity to each of the group of neurons. During a first operating mode of the group of operating modes, the first portion of the group of synapses is enabled and the second portion of the group of synapses is enabled. During a second operating mode of the group of operating modes, the first portion of the group of synapses is enabled and the second portion of the group of synapses is disabled.

    Method and apparatus for treating a signal
    13.
    发明授权
    Method and apparatus for treating a signal 有权
    用于治疗信号的方法和装置

    公开(公告)号:US07913101B2

    公开(公告)日:2011-03-22

    申请号:US11824410

    申请日:2007-06-29

    IPC分类号: G06F1/12

    摘要: A method includes: delaying an excursion of at least one signal a first number of clock phases when the excursion departs from a value in a first direction; and delaying the excursion of the at least one signal a second number of the clock phases when the excursion departs toward the value in a second direction. The first number of clock phases is different from the second number of clock phases. The at least one signal effects a plurality of succeeding excursions in substantial synchrony with a clocked signal presenting succeeding clock cycles having a plurality of the clock phases in each respective clock cycle.

    摘要翻译: 一种方法包括:当偏移偏离第一方向的值时,延迟至少一个信号的偏移的第一数量的时钟相位; 以及当所述偏移在所述第二方向上偏离所述值时,将所述至少一个信号的偏移延迟到所述第二数量的时钟相位。 时钟相位的第一个数量与第二个时钟相位数不同。 所述至少一个信号与在每个相应时钟周期中具有多个时钟相位的呈现后续时钟周期的时钟信号基本同步地影响多个后续偏移。

    CASCADED COMPUTING FOR CONVOLUTIONAL NEURAL NETWORKS

    公开(公告)号:US20190244100A1

    公开(公告)日:2019-08-08

    申请号:US16335775

    申请日:2017-09-21

    IPC分类号: G06N3/08 G06F7/48

    CPC分类号: G06N3/08 G06F7/48 G06N3/0454

    摘要: Techniques are described for efficiently reducing the amount of total computation in convolutional neural networks (CNNs) without affecting the output result or classification accuracy. Computation redundancy in CNNs is reduced by exploiting the computing nature of the convolution and subsequent pooling (e.g., sub-sampling) operations. In some implementations, the input features may be divided into a group of precision values and the operation(s) may be cascaded. A maximum may be identified (e.g., by 90% probability) using a small number of bits in the input features, and the full-precision convolution may then be performed on the maximum input. Accordingly, the total number of bits used to perform the convolution is reduced without affecting the output features or the final classification accuracy.

    High-bandwidth on-chip communication
    17.
    发明授权
    High-bandwidth on-chip communication 有权
    高带宽片上通信

    公开(公告)号:US08242811B2

    公开(公告)日:2012-08-14

    申请号:US12758189

    申请日:2010-04-12

    IPC分类号: H03K3/00

    摘要: Some embodiments of the present invention provide techniques and systems for high-bandwidth on-chip communication. During operation, the system receives an input voltage signal which is to be transmitted over a wire in a chip. The system then generates one or more modified voltage signals from the input voltage signal. Next, the system drives each of the voltage signals (i.e., the input voltage signal and the one or more modified voltage signals) through a respective capacitor. The system then combines the output signals from the capacitors to obtain a combined voltage signal. Next, the system transmits the combined voltage signal over the wire. The transmitted signals can then be received by a hysteresis receiver which is coupled to the wire through a coupling capacitor.

    摘要翻译: 本发明的一些实施例提供了用于高带宽片上通信的技术和系统。 在操作期间,系统接收将通过芯片中的导线传输的输入电压信号。 然后,该系统从输入电压信号产生一个或多个修改的电压信号。 接下来,系统通过相应的电容器驱动每个电压信号(即,输入电压信号和一个或多个修改的电压信号)。 然后,系统组合来自电容器的输出信号以获得组合电压信号。 接下来,系统通过电线传输组合的电压信号。 所传送的信号然后可以由滞后接收器接收,该滞后接收器通过耦合电容耦合到导线。

    HIGH-BANDWIDTH ON-CHIP COMMUNICATION
    18.
    发明申请
    HIGH-BANDWIDTH ON-CHIP COMMUNICATION 有权
    高带宽片上通信

    公开(公告)号:US20110248750A1

    公开(公告)日:2011-10-13

    申请号:US12758189

    申请日:2010-04-12

    IPC分类号: H03K3/00

    摘要: Some embodiments of the present invention provide techniques and systems for high-bandwidth on-chip communication. During operation, the system receives an input voltage signal which is to be transmitted over a wire in a chip. The system then generates one or more modified voltage signals from the input voltage signal. Next, the system drives each of the voltage signals (i.e., the input voltage signal and the one or more modified voltage signals) through a respective capacitor. The system then combines the output signals from the capacitors to obtain a combined voltage signal. Next, the system transmits the combined voltage signal over the wire. The transmitted signals can then be received by a hysteresis receiver which is coupled to the wire through a coupling capacitor.

    摘要翻译: 本发明的一些实施例提供了用于高带宽片上通信的技术和系统。 在操作期间,系统接收将通过芯片中的导线传输的输入电压信号。 然后,该系统从输入电压信号产生一个或多个修改的电压信号。 接下来,系统通过相应的电容器驱动每个电压信号(即,输入电压信号和一个或多个修改的电压信号)。 然后,系统组合来自电容器的输出信号以获得组合电压信号。 接下来,系统通过电线传输组合的电压信号。 所传送的信号然后可以由滞后接收器接收,该滞后接收器通过耦合电容耦合到导线。

    HIERARCHICAL COARSE-GRAIN SPARSITY FOR DEEP NEURAL NETWORKS

    公开(公告)号:US20230129133A1

    公开(公告)日:2023-04-27

    申请号:US18047374

    申请日:2022-10-18

    IPC分类号: G06N3/08

    摘要: Hierarchical coarse-grain sparsity for deep neural networks is provided. An algorithm-hardware co-optimized memory compression technique is proposed to compress deep neural networks in a hardware-efficient manner, which is referred to herein as hierarchical coarse-grain sparsity (HCGS). HCGS provides a new long short-term memory (LSTM) training technique which enforces hierarchical structured sparsity by randomly dropping static block-wise connections between layers. HCGS maintains the same hierarchical structured sparsity throughout training and inference; this reduces weight storage for both training and inference hardware systems.

    Cascaded computing for convolutional neural networks

    公开(公告)号:US11556779B2

    公开(公告)日:2023-01-17

    申请号:US16335775

    申请日:2017-09-21

    IPC分类号: G06N3/08 G06N3/04 G06F7/48

    摘要: Techniques are described for efficiently reducing the amount of total computation in convolutional neural networks (CNNs) without affecting the output result or classification accuracy. Computation redundancy in CNNs is reduced by exploiting the computing nature of the convolution and subsequent pooling (e.g., sub-sampling) operations. In some implementations, the input features may be divided into a group of precision values and the operation(s) may be cascaded. A maximum may be identified (e.g., by 90% probability) using a small number of bits in the input features, and the full-precision convolution may then be performed on the maximum input. Accordingly, the total number of bits used to perform the convolution is reduced without affecting the output features or the final classification accuracy.