Invention Grant
- Patent Title: Systems and methods to perform machine learning with feedback consistency
-
Application No.: US15222997Application Date: 2016-07-29
-
Publication No.: US10482379B2Publication Date: 2019-11-19
- Inventor: Jason E. Holt , Marcello Mathias Herreshoff
- Applicant: Google Inc.
- Applicant Address: US CA Mountain View
- Assignee: Google LLC
- Current Assignee: Google LLC
- Current Assignee Address: US CA Mountain View
- Agency: Dority & Manning, P.A.
- Main IPC: G06N3/08
- IPC: G06N3/08 ; G06N3/04

Abstract:
The present disclosure provides systems and methods that enable training of an encoder model based on a decoder model that performs an inverse transformation relative to the encoder model. In one example, an encoder model can receive a first set of inputs and output a first set of outputs. The encoder model can be a neural network. The decoder model can receive the first set of outputs and output a second set of outputs. A loss function can describe a difference between the first set of inputs and the second set of outputs. According to an aspect of the present disclosure, the loss function can be sequentially backpropagated through the decoder model without modifying the decoder model and then through the encoder model while modifying the encoder model, thereby training the encoder model. Thus, an encoder model can be trained to have enforced consistency relative to the inverse decoder model.
Public/Granted literature
- US20180032871A1 Systems and Methods to Perform Machine Learning with Feedback Consistency Public/Granted day:2018-02-01
Information query