公开(公告)号：US20230055477A1

公开(公告)日：2023-02-23

申请号：US17445653

申请日：2021-08-23

Applicant: SoundHound, Inc.

Inventor： Keyvan MOHAJER ,  Morris MICHAEL ,  Bernard MONT-REYNAUD

IPC: G06K9/00 ,  G06T7/70 ,  G10L15/08 ,  G10L15/22 ,  G06T11/60 ,  G06F3/01 ,  G06K9/62

Abstract: Methods and systems for implementing an intuitive interaction between the user and the virtual content of augmented reality applications are disclosed. By implementing an augmented reality inquiry mode of a device, the system can enable a user to interact with relevant virtual objects via a speech-enabled interface. The speech-enabled augmented reality system can identify visual objects in images and recognize virtual objects corresponding to the visual objects, determine one or more relevant objects from the virtual objects based on relevance factors. Once the interaction session is established, a user can further interact with the relevant virtual objects, notably through voice commands addressed to the object. Accordingly, the present subject matter can enable a natural and hands-free interaction between the user and any virtual object that the user is interested in.