-
公开(公告)号:US20240362460A1
公开(公告)日:2024-10-31
申请号:US18626833
申请日:2024-04-04
Applicant: Google LLC
Inventor: Li Zhang , Yandong Li , Yin Cui , Hong-You Chen , Mingda Zhang
IPC: G06N3/0455 , G06N3/084
CPC classification number: G06N3/0455 , G06N3/084
Abstract: The technology relates to providing personalized neural network-based models according to user input, which can be generated upon request or otherwise as needed. This may include receiving, by one or more processors of a computing device, input corresponding to a task description. Then the input corresponding to the task description is encoded into a set of text embeddings. Based on this, the system applies mixer prediction to the set of text embeddings to generate a set of mixers and learns a set of basis models according to the set of mixers. The set of basis models are combined to form a single personalized model corresponding to the task description. This personalized model can then be used in video understanding, quality assessment, providing a recommendation, performing a classification, or performing a search.
-
公开(公告)号:US20240119307A1
公开(公告)日:2024-04-11
申请号:US18474934
申请日:2023-09-26
Applicant: Google LLC
Inventor: Hong-You Chen , Boqing Gong , Mingda Zhang , Hang Qi , Xuhui Jia , Li Zhang
IPC: G06N3/098
CPC classification number: G06N3/098
Abstract: The embodiments are directed towards providing personalized federated learning (PFL) models via sharable federated basis models. A model architecture and learning algorithm for PFL models is disclosed. The embodiments learn a set of basis models, which can be combined layer by layer to form a personalized model for each client using specifically learned combination coefficients. The set of basis models are shared with each client of a set of the clients. Thus, the set of basis models is common to each client of the set of clients. However, each client may generate a unique PFL based on their specifically learned combination coefficients. The unique combination of coefficients for each client may be encoded in a separate personalized vector for each of the clients.
-
公开(公告)号:US11726769B2
公开(公告)日:2023-08-15
申请号:US17964563
申请日:2022-10-12
Applicant: Google LLC
Inventor: Hugh Brendan McMahan , Kunal Talwar , Li Zhang , Daniel Ramage
IPC: G06F9/44 , G06F8/65 , G06N20/00 , H04L67/10 , G06F21/62 , H04L9/40 , G06F18/214 , G06V10/82 , G06V10/94
CPC classification number: G06F8/65 , G06F18/214 , G06F21/6245 , G06N20/00 , H04L63/00 , H04L67/10 , G06V10/82 , G06V10/95
Abstract: Systems and methods for learning differentially private machine-learned models are provided. A computing system can include one or more server computing devices comprising one or more processors and one or more non-transitory computer-readable media that collectively store instructions that, when executed by the one or more processors cause the one or more server computing devices to perform operations. The operations can include selecting a subset of client computing devices from a pool of available client computing devices; providing a machine-learned model to the selected client computing devices; receiving, from each selected client computing device, a local update for the machine-learned model; determining a differentially private aggregate of the local updates; and determining an updated machine-learned model based at least in part on the data-weighted average of the local updates.
-
公开(公告)号:US11159763B2
公开(公告)日:2021-10-26
申请号:US16936815
申请日:2020-07-23
Applicant: Google LLC
Inventor: Aaron Michael Donsbach , Benjamin Vanik , Jon Gabriel Clapper , Alison Lentz , Joshua Denali Lovejoy , Robert Douglas Fritz, III , Krzysztof Duleba , Li Zhang , Juston Payne , Emily Anne Fortuna , Iwona Bialynicka-Birula , Blaise Aguera-Arcas , Daniel Ramage , Benjamin James McMahan , Oliver Fritz Lange , Jess Holbrook
IPC: G06K9/66 , H04N5/77 , G06K9/62 , H04N19/426 , H04N5/232 , G06N3/04 , H04N9/82 , H04N19/132 , H04N19/46 , G06K9/46 , H04N19/436 , H04N19/423 , H04N19/85 , H04N9/804 , G06K9/00 , H04N19/136 , G06N3/08 , G06N5/00
Abstract: The present disclosure provides an image capture, curation, and editing system that includes a resource-efficient mobile image capture device that continuously captures images. In particular, the present disclosure provides low power frameworks for controlling image sensor mode in a mobile image capture device. On example low power frame work includes a scene analyzer that analyzes a scene depicted by a first image and, based at least in part on such analysis, causes an image sensor control signal to be provided to an image sensor to adjust at least one of the frame rate and the resolution of the image sensor.
-
5.
公开(公告)号:US20200351466A1
公开(公告)日:2020-11-05
申请号:US16936815
申请日:2020-07-23
Applicant: Google LLC
Inventor: Aaron Michael Donsbach , Benjamin Vanik , Jon Gabriel Clapper , Alison Lentz , Joshua Denali Lovejoy , Robert Douglas Fritz, III , Krzysztof Duleba , Li Zhang , Juston Payne , Emily Anne Fortuna , Iwona Bialynicka-Birula , Blaise Aguera-Arcas , Daniel Ramage , Benjamin James McMahan , Oliver Fritz Lange , Jess Holbrook
IPC: H04N5/77 , G06K9/66 , G06K9/62 , H04N19/426 , H04N5/232 , G06N3/04 , H04N9/82 , H04N19/132 , H04N19/46 , G06K9/46 , H04N19/436 , H04N19/423 , H04N19/85 , H04N9/804 , G06K9/00 , H04N19/136 , G06N3/08
Abstract: The present disclosure provides an image capture, curation, and editing system that includes a resource-efficient mobile image capture device that continuously captures images. In particular, the present disclosure provides low power frameworks for controlling image sensor mode in a mobile image capture device. On example low power frame work includes a scene analyzer that analyzes a scene depicted by a first image and, based at least in part on such analysis, causes an image sensor control signal to be provided to an image sensor to adjust at least one of the frame rate and the resolution of the image sensor.
-
公开(公告)号:US20190227980A1
公开(公告)日:2019-07-25
申请号:US15877196
申请日:2018-01-22
Applicant: Google LLC
Inventor: Hugh Brendan McMahan , Kunal Talwar , Li Zhang , Daniel Ramage
Abstract: Systems and methods for learning differentially private machine-learned models are provided. A computing system can include one or more server computing devices comprising one or more processors and one or more non-transitory computer-readable media that collectively store instructions that, when executed by the one or more processors cause the one or more server computing devices to perform operations. The operations can include selecting a subset of client computing devices from a pool of available client computing devices; providing a machine-learned model to the selected client computing devices; receiving, from each selected client computing device, a local update for the machine-learned model; determining a differentially private aggregate of the local updates; and determining an updated machine-learned model based at least in part on the data-weighted average of the local updates.
-
7.
公开(公告)号:US20240054391A1
公开(公告)日:2024-02-15
申请号:US17928372
申请日:2022-04-05
Applicant: GOOGLE LLC
Inventor: Abhradeep Guha Thakurta , Li Zhang , Prateek Jain , Shuang Song , Steffen Rendle , Steve Shaw-Tang Chien , Walid Krichene , Yarong Mu
CPC classification number: G06N20/00 , G06F21/6218
Abstract: Computer-implemented systems and methods for training a decentralized model for making a personalized recommendation. In one aspect, the method comprising: obtaining, using user activity data, client-side training data that includes features and training labels; and training, by the client device, a decentralized model in training rounds, wherein training, in each training round comprises: receiving, first data including a current server-side embedding generated by the server-side machine learning model, wherein the first data received from the server does not include any server-side data used in generating the current server-side embedding; generating, using the client-side machine learning model, a client-side embedding based on the client-side training data; updating, using the client-side embedding and the current server-side embedding and based on the training labels, the client-side machine learning model; generating, an updated client-side embedding; and transmitting second data including the updated client-side embedding for subsequent updating of the server-side machine learning model.
-
8.
公开(公告)号:US20220366219A1
公开(公告)日:2022-11-17
申请号:US17878724
申请日:2022-08-01
Applicant: Google LLC
Inventor: Aaron Michael Donsbach , Christopher Breithaupt , Li Zhang , Arushan Rajasekaram , Navid Shiee
Abstract: The present disclosure provides systems and methods that provide feedback to a user of an image capture device that includes an artificial intelligence system that analyzes incoming image frames to, for example, determine whether to automatically capture and store the incoming frames. An example system can also, in the viewfinder portion of a user interface presented on a display, a graphical intelligence feedback indicator in association with a live video stream. The graphical intelligence feedback indicator can graphically indicate, for each of a plurality of image frames as such image frame is presented within the viewfinder portion of the user interface, a respective measure of one or more attributes of the respective scene depicted by the image frame output by the artificial intelligence system.
-
9.
公开(公告)号:US20210303968A1
公开(公告)日:2021-09-30
申请号:US17266957
申请日:2019-01-22
Applicant: Google LLC
Inventor: Aaron Michael Donsbach , Christopher Breithaupt , Li Zhang , Arushan Rajasekaram , Navid Shiee
Abstract: The present disclosure provides systems and methods that provide feedback to a user of an image capture device that includes an artificial intelligence system that analyzes incoming image frames to, for example, determine whether to automatically capture and store the incoming frames. An example system can also, in the viewfinder portion of a user interface presented on a display, a graphical intelligence feedback indicator in association with a live video stream. The graphical intelligence feedback indicator can graphically indicate, for each of a plurality of image frames as such image frame is presented within the viewfinder portion of the user interface, a respective measure of one or more attributes of the respective scene depicted by the image frame output by the artificial intelligence system.
-
公开(公告)号:US20240202232A1
公开(公告)日:2024-06-20
申请号:US18592132
申请日:2024-02-29
Applicant: Google LLC
Inventor: David Karam , Li Zhang , Ariel Gilder , Yuzo Watanabe , Eric Penner , Farooq Ahmad , Hartwig Adam
IPC: G06F16/583 , G06F16/535 , G06F16/55 , G06N20/00
CPC classification number: G06F16/583 , G06F16/535 , G06F16/55 , G06N20/00
Abstract: The present disclosure is directed to processing imagery using one or more machine learning (ML) models. In particular, data describing imagery comprising a plurality of different and distinct frames can be received; and based at least in part on one or more ML models and the data describing the imagery, and for each frame of the plurality of different and distinct frames, one or more scores can be determined for the frame. Each score of the score(s) can indicate a determined measure of suitability of the frame with respect to one or more of various different and distinct uses for which the ML model(s) are configured to determine suitability of imagery.
-
-
-
-
-
-
-
-
-