-
公开(公告)号:US10048935B2
公开(公告)日:2018-08-14
申请号:US14748296
申请日:2015-06-24
IPC分类号: G10L21/00 , G06F3/16 , G10L15/22 , G10L15/18 , G06F3/01 , G06F3/00 , G10L15/04 , G10L15/26 , G10L15/24
摘要: A method and system are provided. The method includes receiving, by a microphone and camera, user utterances indicative of user commands and associated user gestures for the user utterances. The method further includes parsing, by a hardware-based recognizer, sample utterances and the user utterances into verb parts and noun parts. The method also includes recognizing, by a hardware-based recognizer, the user utterances and the associated user gestures based on the sample utterances and descriptions of associated supporting gestures for the sample utterances. The recognizing step includes comparing the verb parts and the noun parts from the user utterances individually and as pairs to the verb parts and the noun parts of the sample utterances. The method additionally includes selectively performing a given one of the user commands responsive to a recognition result.
-
公开(公告)号:US20160239259A1
公开(公告)日:2016-08-18
申请号:US14748296
申请日:2015-06-24
CPC分类号: G06F3/167 , G06F3/005 , G06F3/017 , G06F3/0304 , G06F2203/0381 , G06N99/005 , G10L15/04 , G10L15/1822 , G10L15/22 , G10L15/24 , G10L15/265 , G10L2015/227
摘要: A method and system are provided. The method includes receiving, by a microphone and camera, user utterances indicative of user commands and associated user gestures for the user utterances. The method further includes parsing, by a hardware-based recognizer, sample utterances and the user utterances into verb parts and noun parts. The method also includes recognizing, by a hardware-based recognizer, the user utterances and the associated user gestures based on the sample utterances and descriptions of associated supporting gestures for the sample utterances. The recognizing step includes comparing the verb parts and the noun parts from the user utterances individually and as pairs to the verb parts and the noun parts of the sample utterances. The method additionally includes selectively performing a given one of the user commands responsive to a recognition result.
-
公开(公告)号:US10656910B2
公开(公告)日:2020-05-19
申请号:US16044171
申请日:2018-07-24
IPC分类号: G10L21/00 , G06F3/16 , G10L15/22 , G10L15/18 , G06F3/01 , G06F3/03 , G06N20/00 , G06F3/00 , G10L15/04 , G10L15/26 , G10L15/24
摘要: A method and system are provided. The method includes receiving, by a microphone and camera, user utterances indicative of user commands and associated user gestures for the user utterances. The method further includes parsing, by a hardware-based recognizer, sample utterances and the user utterances into verb parts and noun parts. The method also includes recognizing, by a hardware-based recognizer, the user utterances and the associated user gestures based on the sample utterances and descriptions of associated supporting gestures for the sample utterances. The recognizing step includes comparing the verb parts and the noun parts from the user utterances individually and as pairs to the verb parts and the noun parts of the sample utterances. The method additionally includes selectively performing a given one of the user commands responsive to a recognition result.
-
公开(公告)号:US20160239258A1
公开(公告)日:2016-08-18
申请号:US14623233
申请日:2015-02-16
CPC分类号: G06F3/167 , G06F3/005 , G06F3/017 , G06F3/0304 , G06F2203/0381 , G06N99/005 , G10L15/04 , G10L15/1822 , G10L15/22 , G10L15/24 , G10L15/265 , G10L2015/227
摘要: A method and system are provided. The method includes receiving, by a microphone and camera, user utterances indicative of user commands and associated user gestures for the user utterances. The method further includes parsing, by a hardware-based recognizer, sample utterances and the user utterances into verb parts and noun parts. The method also includes recognizing, by a hardware-based recognizer, the user utterances and the associated user gestures based on the sample utterances and descriptions of associated supporting gestures for the sample utterances. The recognizing step includes comparing the verb parts and the noun parts from the user utterances individually and as pairs to the verb parts and the noun parts of the sample utterances. The method additionally includes selectively performing a given one of the user commands responsive to a recognition result.
摘要翻译: 提供了一种方法和系统。 该方法包括通过麦克风和相机接收用户话语,其指示用户话语的用户命令和相关联的用户手势。 该方法还包括通过基于硬件的识别器将样本话语和用户话语解析为动词部分和名词部分。 该方法还包括基于硬件的识别器,基于用于样本话语的相关支持手势的样本话语和描述来识别用户话语和相关联的用户手势。 识别步骤包括将来自用户话语的动词部分和名词部分单独地和作为对的样本话语的动词部分和名词部分进行比较。 该方法还包括响应于识别结果选择性地执行给定的一个用户命令。
-
公开(公告)号:US20180329680A1
公开(公告)日:2018-11-15
申请号:US16044171
申请日:2018-07-24
CPC分类号: G06F3/167 , G06F3/005 , G06F3/017 , G06F3/0304 , G06F2203/0381 , G06N99/005 , G10L15/04 , G10L15/1822 , G10L15/22 , G10L15/24 , G10L15/265 , G10L2015/227
摘要: A method and system are provided. The method includes receiving, by a microphone and camera, user utterances indicative of user commands and associated user gestures for the user utterances. The method further includes parsing, by a hardware-based recognizer, sample utterances and the user utterances into verb parts and noun parts. The method also includes recognizing, by a hardware-based recognizer, the user utterances and the associated user gestures based on the sample utterances and descriptions of associated supporting gestures for the sample utterances. The recognizing step includes comparing the verb parts and the noun parts from the user utterances individually and as pairs to the verb parts and the noun parts of the sample utterances. The method additionally includes selectively performing a given one of the user commands responsive to a recognition result.
-
公开(公告)号:US10656909B2
公开(公告)日:2020-05-19
申请号:US16044114
申请日:2018-07-24
IPC分类号: G10L21/00 , G06F3/16 , G10L15/22 , G10L15/18 , G06F3/01 , G06F3/03 , G06N20/00 , G06F3/00 , G10L15/04 , G10L15/26 , G10L15/24
摘要: A method and system are provided. The method includes receiving, by a microphone and camera, user utterances indicative of user commands and associated user gestures for the user utterances. The method further includes parsing, by a hardware-based recognizer, sample utterances and the user utterances into verb parts and noun parts. The method also includes recognizing, by a hardware-based recognizer, the user utterances and the associated user gestures based on the sample utterances and descriptions of associated supporting gestures for the sample utterances. The recognizing step includes comparing the verb parts and the noun parts from the user utterances individually and as pairs to the verb parts and the noun parts of the sample utterances. The method additionally includes selectively performing a given one of the user commands responsive to a recognition result.
-
公开(公告)号:US20170193711A1
公开(公告)日:2017-07-06
申请号:US14984841
申请日:2015-12-30
摘要: A method for providing a remote user with an experience in an environment, comprising building a three-dimensional (3D) model of the environment, capturing one or more video feeds of at least a portion of the environment using one or more cameras in the environment, mapping the one or more video feeds onto one or more planes in the 3D model, providing a view of the mapped one or more video feeds on the one or more planes in the 3D model through a display device viewed by the remote user, capturing a gestural input from the remote user, and applying the gestural input to the portion of the environment.
-
公开(公告)号:US20180329679A1
公开(公告)日:2018-11-15
申请号:US16044114
申请日:2018-07-24
CPC分类号: G06F3/167 , G06F3/005 , G06F3/017 , G06F3/0304 , G06F2203/0381 , G06N99/005 , G10L15/04 , G10L15/1822 , G10L15/22 , G10L15/24 , G10L15/265 , G10L2015/227
摘要: A method and system are provided. The method includes receiving, by a microphone and camera, user utterances indicative of user commands and associated user gestures for the user utterances. The method further includes parsing, by a hardware-based recognizer, sample utterances and the user utterances into verb parts and noun parts. The method also includes recognizing, by a hardware-based recognizer, the user utterances and the associated user gestures based on the sample utterances and descriptions of associated supporting gestures for the sample utterances. The recognizing step includes comparing the verb parts and the noun parts from the user utterances individually and as pairs to the verb parts and the noun parts of the sample utterances. The method additionally includes selectively performing a given one of the user commands responsive to a recognition result.
-
公开(公告)号:US10048934B2
公开(公告)日:2018-08-14
申请号:US14623233
申请日:2015-02-16
IPC分类号: G10L21/00 , G06F3/16 , G10L15/22 , G10L15/18 , G06F3/01 , G06F3/00 , G10L15/04 , G10L15/26 , G10L15/24
摘要: A method and system are provided. The method includes receiving, by a microphone and camera, user utterances indicative of user commands and associated user gestures for the user utterances. The method further includes parsing, by a hardware-based recognizer, sample utterances and the user utterances into verb parts and noun parts. The method also includes recognizing, by a hardware-based recognizer, the user utterances and the associated user gestures based on the sample utterances and descriptions of associated supporting gestures for the sample utterances. The recognizing step includes comparing the verb parts and the noun parts from the user utterances individually and as pairs to the verb parts and the noun parts of the sample utterances. The method additionally includes selectively performing a given one of the user commands responsive to a recognition result.
-
公开(公告)号:US09785741B2
公开(公告)日:2017-10-10
申请号:US14984841
申请日:2015-12-30
摘要: A method for providing a remote user with an experience in an environment, comprising building a three-dimensional (3D) model of the environment, capturing one or more video feeds of at least a portion of the environment using one or more cameras in the environment, mapping the one or more video feeds onto one or more planes in the 3D model, providing a view of the mapped one or more video feeds on the one or more planes in the 3D model through a display device viewed by the remote user, capturing a gestural input from the remote user, and applying the gestural input to the portion of the environment.
-
-
-
-
-
-
-
-
-