Robust large-scale machine learning in the cloud

    公开(公告)号:US10482392B2

    公开(公告)日:2019-11-19

    申请号:US15429216

    申请日:2017-02-10

    Applicant: Google Inc.

    Abstract: The present disclosure provides a new scalable coordinate descent (SCD) algorithm and associated system for generalized linear models whose convergence behavior is always the same, regardless of how much SCD is scaled out and regardless of the computing environment. This makes SCD highly robust and enables it to scale to massive datasets on low-cost commodity servers. According to one aspect, by using a natural partitioning of parameters into blocks, updates can be performed in parallel a block at a time without compromising convergence. Experimental results on a real advertising dataset are used to demonstrate SCD's cost effectiveness and scalability.

    Fault tolerant distributed key-value storage
    3.
    发明授权
    Fault tolerant distributed key-value storage 有权
    容错分布式键值存储

    公开(公告)号:US09569517B1

    公开(公告)日:2017-02-14

    申请号:US14136633

    申请日:2013-12-20

    Applicant: Google Inc.

    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for handling faults in a distributed key-value storage system. One of the methods includes receiving an indication that a machine storing a primary replica of a first replication chain is inactive, in response to receiving the indication, generating a concatenated replica comprising a first replica of the first replication chain and a second replica of a second replication chain, the second replication chain comprising replicas of a second key segment, the second key segment being adjacent to the first key segment in the multiple key segments of the plurality of keys, and providing, to another machine in the ordered sequence of machines, a notification of availability of the concatenated replica.

    Abstract translation: 方法,系统和装置,包括在计算机存储介质上编码的计算机程序,用于处理分布式键值存储系统中的故障。 响应于接收到该指示,接收指示,存储第一复制链的主副本的机器是不活动的,生成包括第一复制链的第一副本和第二副本的第二副本的级联副本 复制链,所述第二复制链包括第二密钥段的副本,所述第二密钥段与所述多个密钥的所述多个密钥段中的所述第一密钥段相邻,并且以所述有序顺序的机器提供给另一个机器, 通知连接的副本的可用性。

Patent Agency Ranking