MATRIX MULTIPLICATION IN HARDWARE USING MODULAR MATH

    公开(公告)号:US20210026916A1

    公开(公告)日:2021-01-28

    申请号:US16521294

    申请日:2019-07-24

    Applicant: Facebook, Inc.

    Abstract: A first group of modulo result matrices corresponding to modulo of elements of a first matrix by each of a plurality of moduli is stored. A second group of modulo result matrices corresponding to modulo of elements of a second matrix by each of the plurality of moduli is stored. It is determined whether an element operation of a multiplication of the first matrix with the second matrix can be performed using a first hardware multiplication module rather than a second hardware multiplication module. In response to a determination that the element operation can be performed using the first hardware multiplication module, the element operation is performed using the first hardware multiplication module including by multiplying one or more corresponding elements from the first group of modulo result matrices with one or more corresponding elements from the second group of modulo result matrices.

    HARDWARE FOR FLOATING-POINT ARITHMETIC IN MULTIPLE FORMATS

    公开(公告)号:US20210255830A1

    公开(公告)日:2021-08-19

    申请号:US16795097

    申请日:2020-02-19

    Applicant: Facebook, Inc.

    Abstract: A floating-point number in a first format representation is received. Based on an identification of a floating-point format type of the floating-point number, different components of the first format representation are identified. The different components of the first format representation are placed in corresponding components of a second format representation of the floating-point number, wherein a total number of bits of the second format representation is larger than a total number of bits of the first format representation. At least one of the components of the second format representation is padded with one or more zero bits. The floating-point number in the second format representation is stored in a register. A multiplication using the second format representation of the floating-point number is performed.

    NUMBER-THEORETIC TRANSFORM HARDWARE

    公开(公告)号:US20210073316A1

    公开(公告)日:2021-03-11

    申请号:US16565292

    申请日:2019-09-09

    Applicant: Facebook, Inc.

    Abstract: A forward number-theoretic transform dedicated hardware unit is configured to calculate a number-theoretic transform of an input vector, wherein a root of unity of the number-theoretic transform performed by the forward number-theoretic transform dedicated hardware unit is a power of two. The forward number-theoretic transform dedicated hardware unit includes data routing paths, a plurality of hardware binary bit shifters, and a plurality of adders.

    DEVICE AND METHOD FOR FLEXIBLY SUMMING MATRIX VALUES

    公开(公告)号:US20210349965A1

    公开(公告)日:2021-11-11

    申请号:US16869303

    申请日:2020-05-07

    Applicant: Facebook, Inc.

    Abstract: A device (e.g., an application-specific integrated circuit chip) includes a matrix transpose component, a matrix processing component, a data alignment component, and a data reduction component. The matrix transpose component is configured to transpose an input matrix of elements to output an output matrix of the elements that have been transposed, wherein: each element of the input matrix of elements is represented using a first number of bits, each value of a group of values stored in the input matrix is represented using a second number of bits greater than the first number of bits, and each value of the group of values is stored as split segments across more than one element of the elements of the input matrix. The matrix processing component is configured to multiply a first multiplication input matrix with a second multiplication input matrix, wherein the output matrix of the matrix transpose component is utilized as the first multiplication input matrix and a mask vector is utilized as the second multiplication input matrix. The data alignment component is configured to modify at least a portion of elements of a result of the matrix processing component. The data reduction component is configured to sum at least the elements of the modified result of the matrix processing component to determine a sum of the group of values.

    BYPASSING ZERO-VALUE MULTIPLICATIONS IN A HARDWARE MULTIPLIER

    公开(公告)号:US20210349694A1

    公开(公告)日:2021-11-11

    申请号:US16869288

    申请日:2020-05-07

    Applicant: Facebook, Inc.

    Abstract: A device (e.g., integrated circuit chip) includes a first operand register, a second operand register, a multiplication unit, and a hardware logic component. The first operand register is configured to store a first operand value. The second operand register is configured to store a second operand value. The multiplication unit is configured to at least multiply the first operand value with the second operand value. The hardware logic component is configured to detect whether a zero value is provided and in response to a detection that the zero value is being provided: cause an update of at least the first operand register to be disabled, and cause a result of a multiplication of the first operand value with the second operand value to be a zero-value result.

Patent Agency Ranking