SOFTMAX AND LOG SOFTMAX METHOD AND SYSTEM
    1.
    发明公开

    公开(公告)号:US20240061903A1

    公开(公告)日:2024-02-22

    申请号:US17892852

    申请日:2022-08-22

    Applicant: Xilinx, Inc.

    CPC classification number: G06F17/16 G06F7/5443 G06F7/552 G06F7/4991

    Abstract: Circuits and methods for determining a maximum bias for computing softmax on a tensor include a processor circuit configured to transform in parallel, elements of each group of a plurality of groups of elements of a tensor X into respective power-of-two elements. The respective power-of-two element from element xt of the tensor is pt, pt=(xt*log2e), and pt has an integer part and a fraction part. A first comparison circuit (204) is configured to determine respective group-level biases for the groups. The group-level bias of groupm is dm, and dm is an integer part of a maximum of the power-of-two elements of groupm. A second comparison circuit is configured to determine a greatest one of the respective group-level biases to be a tensor-level bias, dmax.

Patent Agency Ranking