IN-MEMORY ATTENTION ENGINE
    4.
    发明申请

    公开(公告)号:US20250077181A1

    公开(公告)日:2025-03-06

    申请号:US18460322

    申请日:2023-09-01

    Abstract: A computing system that includes an attention engine is disclosed. The attention engine is an in-memory computing module that may be used to accelerate attention operations. The attention engine includes a dot product circuit and a multiplier circuit, which together are used to perform matrix generation and matrix multiplication in the analog domain. Performing matrix multiplication in the analog domain may be faster and/or consume less power than performing matrix multiplication in the digital domain.

Patent Agency Ranking