公开(公告)号：US20200075002A1

公开(公告)日：2020-03-05

申请号：US16251982

申请日：2019-01-18

Applicant: Google LLC

Inventor： April Pufahl ,  Jared Strawderman ,  Harry Yu ,  Adriana Olmos Antillon ,  Jonathan Livni ,  Okan Kolak ,  James Giangola ,  Nitin Khandelwal ,  Jason Kearns ,  Andrew Watson ,  Joseph Ashear ,  Valerie Nygaard

IPC: G10L15/22 ,  G06F1/16 ,  G06F3/16

Abstract: Systems, methods, and apparatus for using a multimodal response in the dynamic generation of client device output that is tailored to a current modality of a client device is disclosed herein. Multimodal client devices can engage in a variety of interactions across the multimodal spectrum including voice only interactions, voice forward interactions, multimodal interactions, visual forward interactions, visual only interactions etc. A multimodal response can include a core message to be rendered for all interaction types as well as one or more modality dependent components to provide a user with additional information.

公开(公告)号：US10482328B2

公开(公告)日：2019-11-19

申请号：US15722756

申请日：2017-10-02

Applicant: Google LLC

Inventor： Balakrishnan Varadarajan ,  George Dan Toderici ,  Apostol Natsev ,  Nitin Khandelwal ,  Sudheendra Vijayanarasimhan ,  Weilong Yang ,  Sanketh Shetty

IPC: G06K9/62 ,  G06K9/00 ,  G06F16/783 ,  G06F16/78 ,  G06K9/52 ,  H04N5/265

Abstract: A system and methodology provide for annotating videos with entities and associated probabilities of existence of the entities within video frames. A computer-implemented method identifies an entity from a plurality of entities identifying characteristics of video items. The computer-implemented method selects a set of features correlated with the entity based on a value of a feature of a plurality of features, determines a classifier for the entity using the set of features, and determines an aggregation calibration function for the entity based on the set of features. The computer-implemented method selects a video frame from a video item, where the video frame having associated features, and determines a probability of existence of the entity based on the associated features using the classifier and the aggregation calibration function.