Regularized neural network architecture search

    公开(公告)号:US11144831B2

    公开(公告)日:2021-10-12

    申请号:US16906034

    申请日:2020-06-19

    Applicant: Google LLC

    Abstract: A method for receiving training data for training a neural network (NN) to perform a machine learning (ML) task and for determining, using the training data, an optimized NN architecture for performing the ML task is described. Determining the optimized NN architecture includes: maintaining population data comprising, for each candidate architecture in a population of candidate architectures, (i) data defining the candidate architecture, and (ii) data specifying how recently a neural network having the candidate architecture has been trained while determining the optimized neural network architecture; and repeatedly performing multiple operations using each of a plurality of worker computing units to generate a new candidate architecture based on a selected candidate architecture having the best measure of fitness, adding the new candidate architecture to the population, and removing from the population the candidate architecture that was trained least recently.

    Content item auction bidding
    3.
    发明授权

    公开(公告)号:US11080762B1

    公开(公告)日:2021-08-03

    申请号:US15211240

    申请日:2016-07-15

    Applicant: Google LLC

    Abstract: Methods, systems, and apparatus for content item auction bidding. In one aspect, a method includes receiving a request for a content item, the request including request feature values and a device identifier, the device identifier being included in a remarketing list; obtaining a predicted performance measure for a remarketing content item associated with the remarketing list based on a first timestamp and a second timestamp, the first timestamp being included in the remarketing list and associated with the device identifier included in the request, and the second timestamp being for the request; determining a bid adjustment value based on the first timestamp and the second timestamp; obtaining a remarketing bid for the remarketing content item, the remarketing bid specifying an amount a content item provider is willing to pay for distribution of the remarketing content item; and adjusting the remarketing bid based on the bid adjustment value.

    REGULARIZED NEURAL NETWORK ARCHITECTURE SEARCH

    公开(公告)号:US20230259784A1

    公开(公告)日:2023-08-17

    申请号:US18140442

    申请日:2023-04-27

    Applicant: Google LLC

    CPC classification number: G06N3/086 G06N3/04

    Abstract: A method for receiving training data for training a neural network (NN) to perform a machine learning (ML) task and for determining, using the training data, an optimized NN architecture for performing the ML task is described. Determining the optimized NN architecture includes: maintaining population data comprising, for each candidate architecture in a population of candidate architectures, (i) data defining the candidate architecture, and (ii) data specifying how recently a neural network having the candidate architecture has been trained while determining the optimized neural network architecture; and repeatedly performing multiple operations using each of a plurality of worker computing units to generate a new candidate architecture based on a selected candidate architecture having the best measure of fitness, adding the new candidate architecture to the population, and removing from the population the candidate architecture that was trained least recently.

    Regularized neural network architecture search

    公开(公告)号:US11669744B2

    公开(公告)日:2023-06-06

    申请号:US17475137

    申请日:2021-09-14

    Applicant: Google LLC

    CPC classification number: G06N3/086 G06N3/04

    Abstract: A method for receiving training data for training a neural network (NN) to perform a machine learning (ML) task and for determining, using the training data, an optimized NN architecture for performing the ML task is described. Determining the optimized NN architecture includes: maintaining population data comprising, for each candidate architecture in a population of candidate architectures, (i) data defining the candidate architecture, and (ii) data specifying how recently a neural network having the candidate architecture has been trained while determining the optimized neural network architecture; and repeatedly performing multiple operations using each of a plurality of worker computing units to generate a new candidate architecture based on a selected candidate architecture having the best measure of fitness, adding the new candidate architecture to the population, and removing from the population the candidate architecture that was trained least recently.

    REGULARIZED NEURAL NETWORK ARCHITECTURE SEARCH

    公开(公告)号:US20220004879A1

    公开(公告)日:2022-01-06

    申请号:US17475137

    申请日:2021-09-14

    Applicant: Google LLC

    Abstract: A method for receiving training data for training a neural network (NN) to perform a machine learning (ML) task and for determining, using the training data, an optimized NN architecture for performing the ML task is described. Determining the optimized NN architecture includes: maintaining population data comprising, for each candidate architecture in a population of candidate architectures, (i) data defining the candidate architecture, and (ii) data specifying how recently a neural network having the candidate architecture has been trained while determining the optimized neural network architecture; and repeatedly performing multiple operations using each of a plurality of worker computing units to generate a new candidate architecture based on a selected candidate architecture having the best measure of fitness, adding the new candidate architecture to the population, and removing from the population the candidate architecture that was trained least recently.

    REGULARIZED NEURAL NETWORK ARCHITECTURE SEARCH

    公开(公告)号:US20200320399A1

    公开(公告)日:2020-10-08

    申请号:US16906034

    申请日:2020-06-19

    Applicant: Google LLC

    Abstract: A method for receiving training data for training a neural network (NN) to perform a machine learning (ML) task and for determining, using the training data, an optimized NN architecture for performing the ML task is described. Determining the optimized NN architecture includes: maintaining population data comprising, for each candidate architecture in a population of candidate architectures, (i) data defining the candidate architecture, and (ii) data specifying how recently a neural network having the candidate architecture has been trained while determining the optimized neural network architecture; and repeatedly performing multiple operations using each of a plurality of worker computing units to generate a new candidate architecture based on a selected candidate architecture having the best measure of fitness, adding the new candidate architecture to the population, and removing from the population the candidate architecture that was trained least recently.

Patent Agency Ranking