公开(公告)号：US20180357479A1

公开(公告)日：2018-12-13

申请号：US15617817

申请日：2017-06-08

Applicant: Microsoft Technology Licensing, LLC

Inventor： Manohar Swaminathan ,  Abhay Kumar Agarwal ,  Sujeath Pareddy

IPC: G06K9/00 ,  G06K9/32 ,  G10L13/04 ,  G10L15/22 ,  H04N7/18 ,  G09B21/00

CPC classification number: G06K9/00671 ,  G06K9/00355 ,  G06K9/3258 ,  G06K2209/01 ,  G06K2209/17 ,  G09B21/006 ,  G10L13/043 ,  G10L15/22 ,  G10L2015/223 ,  H04N7/185

Abstract: An apparatus and method for audibly identifying an object indicated by a hand includes an electronic imager and an audio device. A processing system coupled to the imager and the audio device is configured to cause the imager to capture an image including the hand and the object. The processing system is also configured to process the captured image to identify and track the hand to identify the object indicated by the hand, to contextual assistance data with respect to the indicated object, to generate audio data describing the contextual assistance data, and to provide the generated audio data to the audio device.

公开(公告)号：US10586106B2

公开(公告)日：2020-03-10

申请号：US15423281

申请日：2017-02-02

Applicant: Microsoft Technology Licensing, LLC

Inventor： Swaminathan Manohar ,  Swapna C. Joshi ,  Sujeath Pareddy ,  Abhay Kumar Agarwal

IPC: G06K9/00 ,  G10L13/00 ,  H04W4/80

Abstract: An interactive and responsive presentation of spatially-associated information related to a user's environment based on the user's context is provided. Aspects of a 3D audio cloud system extract information about entities in the user's environment, and generate and provide the user with a 3D audio cloud that presents a spatial audio representation of entities in the user's environment that gives the user cues as to where the entities are located with respect to the user. An entity can be represented in a descriptive manner that provides the user with various types of information about the entity (e.g., shape, size, color, others' opinions, actions, emotions). Further, aspects of the 3D audio cloud system dynamically update the 3D audio cloud based on the user's location, position, or orientation, receive selection input from the user associated with the 3D audio cloud, and retrieve and present additional information as requested by the user.

公开(公告)号：US20180217804A1

公开(公告)日：2018-08-02

申请号：US15423281

申请日：2017-02-02

Applicant: Microsoft Technology Licensing, LLC

Inventor： Swaminathan Manohar ,  Swapna C. Joshi ,  Sujeath Pareddy ,  Abhay Kumar Agarwal

IPC: G06F3/16 ,  G10L13/00 ,  G06F3/0484 ,  G06K9/00

CPC classification number: G06K9/00671 ,  G06F3/011 ,  G06F3/0488 ,  G06F3/162 ,  G06F3/167 ,  G10L13/00 ,  H04W4/026 ,  H04W4/80

Abstract: An interactive and responsive presentation of spatially-associated information related to a user's environment based on the user's context is provided. Aspects of a 3D audio cloud system extract information about entities in the user's environment, and generate and provide the user with a 3D audio cloud that presents a spatial audio representation of entities in the user's environment that gives the user cues as to where the entities are located with respect to the user. An entity can be represented in a descriptive manner that provides the user with various types of information about the entity (e.g., shape, size, color, others' opinions, actions, emotions). Further, aspects of the 3D audio cloud system dynamically update the 3D audio cloud based on the user's location, position, or orientation, receive selection input from the user associated with the 3D audio cloud, and retrieve and present additional information as requested by the user.