Distribution of parameter calculation for iterative optimization methods
    1.
    发明授权
    Distribution of parameter calculation for iterative optimization methods 有权
    迭代优化方法的参数计算分布

    公开(公告)号:US09015083B1

    公开(公告)日:2015-04-21

    申请号:US13428985

    申请日:2012-03-23

    IPC分类号: G06N7/00 G06F17/17

    摘要: Systems and methods are disclosed for distributed first- or higher-order model fitting algorithms. Determination of the parameter set for the objective function is divided into a plurality of sub-processes, each performed by one of a plurality of worker computers. A master computer coordinates the operation of the plurality of worker computers, each operating on a portion of the parameter set such that no two worker computers contain exactly the same parameter subset nor the complete parameter set. Each worker computer performs its sub-processes on its parameter subset, together with training data. For maximum efficiency, the sub-processes are performed using a compact set of instruction primitives. The results are evaluated by the master computer, which may coordinate additional sub-process operations to perform higher-order optimization or terminate the optimization method and proceed to formulation of a model function.

    摘要翻译: 公开了分布式一阶或更高阶模型拟合算法的系统和方法。 确定目标函数的参数集被划分为多个子进程,每个子进程由多个工作计算机之一执行。 主计算机协调多个工作计算机的操作,每个操作计算机在参数集的一部分上操作,使得没有两个工作计算机包含完全相同的参数子集和完整的参数集。 每个工作计算机在其参数子集上与训练数据一起执行其子进程。 为了最大限度地提高效率,使用一组紧凑的指令原语执行子进程。 结果由主计算机评估,主计算机可以协调附加的子过程操作以执行更高阶优化或终止优化方法并且继续制定模型函数。