RESIDUAL NORMALIZATION FOR IMPROVED NEURAL NETWORK CLASSIFICATIONS

    公开(公告)号:US20220405547A1

    公开(公告)日:2022-12-22

    申请号:US17807479

    申请日:2022-06-17

    Abstract: Certain aspects of the present disclosure provide techniques for residual normalization. A first tensor comprising a frequency dimension and a temporal dimension is accessed. A second tensor is generated by applying a frequency-based instance normalization operation to the first tensor, comprising, for each respective frequency bin in the frequency dimension, computing a respective frequency-specific mean of the first tensor. A third tensor is generated by: scaling the first tensor by a scale value, and aggregating the scaled first tensor and the second tensor. The third tensor is provided as input to a layer of a neural network.

    BROADCASTED RESIDUAL LEARNING
    13.
    发明申请

    公开(公告)号:US20220309344A1

    公开(公告)日:2022-09-29

    申请号:US17656621

    申请日:2022-03-25

    Abstract: Certain aspects of the present disclosure provide techniques for efficient broadcasted residual machine learning. An input tensor comprising a frequency dimension and a temporal dimension is received, and the input tensor is processed with a first convolution operation to generate a multidimensional intermediate feature map comprising the frequency dimension and the temporal dimension. The multidimensional intermediate feature map is converted to a one-dimensional intermediate feature map in the temporal dimension using a frequency dimension reduction operation, and the one-dimensional intermediate feature map is processed using a second convolution operation to generate a temporal feature map. The temporal feature map is expanded to the frequency dimension using a broadcasting operation to generate a multidimensional output feature map, and the multidimensional output feature map is augmented with the multidimensional intermediate feature map via a first residual connection.

Patent Agency Ranking