DISTRIBUTED TRAINING METHOD BASED ON END-TO-END ADAPTION, AND DEVICE

    公开(公告)号:US20230169351A1

    公开(公告)日:2023-06-01

    申请号:US18060705

    申请日:2022-12-01

    CPC classification number: G06N3/098

    Abstract: A distributed training method based on end-to-end adaption, a device and a storage medium. The method includes: obtaining slicing results by slicing a model to be trained; obtaining an attribute of computing resources allocated to the model for training by parsing the computing resources, in which the computing resources are determined based on a computing resource requirement of the model, computing resources occupied by another model being trained, and idle computing resources, and the attribute of the computing resources is configured to represent at least one of a topology relation and a task processing capability of the computing resources; determining a distribution strategy of each of the slicing results in the computing resources based on the attributes of the computing resources; and performing distributed training on the model using the computing resources based on the distribution strategy.

    METHOD FOR PROCESSING DATA, AND ELECTRONIC DEVICE, STORAGE MEDIUM AND PROGRAM PRODUCT

    公开(公告)号:US20230115163A1

    公开(公告)日:2023-04-13

    申请号:US17989644

    申请日:2022-11-17

    Abstract: The disclosure provides a method for processing data, and an electronic device. The method includes: obtaining first attribute information of input data and second attribute information of a computing device corresponding to the input data; selecting a target operator implementation mode from a plurality of candidate operator implementation modes based on the first attribute information and the second attribute information; determining a plurality of sub-operators included in an operator required for the input data from an operator library based on the target operator implementation mode, to generate the operator; and obtaining an operation result by performing an operation on the input data by the computing device based on the operator.

Patent Agency Ranking