-
公开(公告)号:US09591118B2
公开(公告)日:2017-03-07
申请号:US12347999
申请日:2009-01-01
申请人: David L. Graumann , Giuseppe Raffa , Lama Nachman
发明人: David L. Graumann , Giuseppe Raffa , Lama Nachman
CPC分类号: H04M1/7253 , G06F3/011 , G06F3/167 , H04M1/6066 , H04M2250/02 , H04M2250/12
摘要: Embodiments may comprise logic such as hardware and/or code to map content of a device such as a mobile device, a laptop, a desktop, or a server, to a two dimensional field or table and map user poses or movements to the coordinates within the table to offer quick access to the content by a user. Many embodiments, for example, utilize three wireless peripherals such as a watch, ring, and headset connected to a mobile Internet device (MID) comprising an audible user interface and an auditory mapper to access to the content. The audible user interface may communicatively couple with the peripherals to receive pose data that describes the motion or movements associated with one or more of the peripherals and to provide feedback such as audible items and, in some embodiments, other feedback.
摘要翻译: 实施例可以包括诸如硬件和/或代码之类的逻辑,以将诸如移动设备,膝上型计算机,桌面或服务器之类的设备的内容映射到二维场或表,并将用户姿态或运动映射到坐标内 该表提供用户快速访问内容。 例如,许多实施例利用连接到包括可听用户界面和听觉映射器的移动因特网设备(MID)的三个无线外围设备,例如手表,环和耳机来访问内容。 可听用户界面可以与外围设备通信地耦合以接收描述与一个或多个外围设备相关联的运动或运动的姿势数据,并提供诸如可听项目之类的反馈,并且在一些实施例中提供其他反馈。
-
公开(公告)号:US20100169075A1
公开(公告)日:2010-07-01
申请号:US12347977
申请日:2008-12-31
CPC分类号: G06F17/2775 , G10L13/00
摘要: Embodiments may be a standalone module or part of mobile devices, desktop computers, servers, stereo systems, or any other systems that might benefit from condensed audio presentations of item structures such as lists or tables. Embodiments may comprise logic such as hardware and/or code to adjust the temporal characteristics of items comprising words. The items maybe included in a structure such as a text listing or table, an audio listing or table, or a combination thereof, or may be individual words or phrases. For instance, embodiments may comprise a keyword extractor to extract keywords from the items and an abbreviations generator to generate abbreviations based upon the keywords. Further embodiments may comprise a text-to-speech generator to generate audible items based upon the abbreviations to render to a user while traversing the item structure.
摘要翻译: 实施例可以是独立模块或移动设备,台式计算机,服务器,立体声系统或可能受益于诸如列表或表的项目结构的聚合音频呈现的任何其他系统的独立模块或部分。 实施例可以包括诸如硬件和/或代码的逻辑,以调整包括单词的项目的时间特征。 项目可以包括在诸如文本列表或表格,音频列表或表格或其组合的结构中,或者可以是单独的单词或短语。 例如,实施例可以包括从项目中提取关键词的关键字提取器和缩写生成器,以基于关键字生成缩写。 另外的实施例可以包括文本到语音生成器,以便在遍历项目结构的同时基于缩写来生成可听见的项目以呈现给用户。
-
公开(公告)号:US09535506B2
公开(公告)日:2017-01-03
申请号:US14205210
申请日:2014-03-11
申请人: Giuseppe Raffa , Lama Nachman , Jinwon Lee
发明人: Giuseppe Raffa , Lama Nachman , Jinwon Lee
IPC分类号: G06F1/16 , G06F3/01 , G06F3/0346
CPC分类号: G06F3/017 , G01C19/00 , G01P15/18 , G06F1/1694 , G06F3/0346 , H04M2250/12
摘要: Embodiments of the invention describe a system to efficiently execute gesture recognition algorithms. Embodiments of the invention describe a power efficient staged gesture recognition pipeline including multimodal interaction detection, context based optimized recognition, and context based optimized training and continuous learning. Embodiments of the invention further describe a system to accommodate many types of algorithms depending on the type of gesture that is needed in any particular situation. Examples of recognition algorithms include but are not limited to, HMM for complex dynamic gestures (e.g. write a number in the air), Decision Trees (DT) for static poses, peak detection for coarse shake/whack gestures or inertial methods (INS) for pitch/roll detection.
摘要翻译: 本发明的实施例描述了一种有效执行手势识别算法的系统。 本发明的实施例描述了一种功率效率分级手势识别流水线,其包括多模式交互检测,基于上下文的优化识别和基于上下文的优化训练和连续学习。 本发明的实施例进一步描述了根据在任何特定情况下需要的手势类型来适应许多类型的算法的系统。 识别算法的示例包括但不限于用于复杂动态手势的HMM(例如在空中编写一个数字),用于静态姿势的决策树(DT),用于粗略摇动/打击手势的峰值检测或惯性方法(INS),用于 俯仰/滚动检测。
-
公开(公告)号:US20120016641A1
公开(公告)日:2012-01-19
申请号:US12835079
申请日:2010-07-13
申请人: Giuseppe Raffa , Lama Nachman , Jinwon Lee
发明人: Giuseppe Raffa , Lama Nachman , Jinwon Lee
CPC分类号: G06F3/017 , G01C19/00 , G01P15/18 , G06F1/1694 , G06F3/0346 , H04M2250/12
摘要: Embodiments of the invention describe a system to efficiently execute gesture recognition algorithms. Embodiments of the invention describe a power efficient staged gesture recognition pipeline including multimodal interaction detection, context based optimized recognition, and context based optimized training and continuous learning. Embodiments of the invention further describe a system to accommodate many types of algorithms depending on the type of gesture that is needed in any particular situation. Examples of recognition algorithms include but are not limited to, HMM for complex dynamic gestures (e.g. write a number in the air), Decision Trees (DT) for static poses, peak detection for coarse shake/whack gestures or inertial methods (INS) for pitch/roll detection.
摘要翻译: 本发明的实施例描述了一种有效执行手势识别算法的系统。 本发明的实施例描述了一种功率效率分级手势识别流水线,其包括多模式交互检测,基于上下文的优化识别和基于上下文的优化训练和连续学习。 本发明的实施例进一步描述了根据在任何特定情况下需要的手势类型来适应许多类型的算法的系统。 识别算法的示例包括但不限于用于复杂动态手势的HMM(例如在空中编写一个数字),用于静态姿势的决策树(DT),用于粗略摇动/打击手势的峰值检测或惯性方法(INS),用于 俯仰/滚动检测。
-
公开(公告)号:US20100169097A1
公开(公告)日:2010-07-01
申请号:US12347998
申请日:2008-12-31
IPC分类号: G10L21/00
CPC分类号: G06F3/0485 , G06F3/038 , G06F3/167 , G10L13/00
摘要: Many embodiments may comprise logic such as hardware and/or code to implement user interface for traversal of long sorted lists, via audible mapping of the lists, using sensor based gesture recognition, audio and tactile feedback and button selection while on the go. In several embodiments, such user interface modalities are physically small in size, enabling a user to be truly mobile by reducing the cognitive load required to operate the device. For some embodiments, the user interface may be divided across multiple worn devices, such as a mobile device, watch, earpiece, and ring. Rotation of the watch may be translated into navigation instructions, allowing the user to traverse the list while the user receives audio feedback via the earpiece to describe items in the list as well as audio feedback regarding the navigation state. Many embodiments offer the user a simple user interface to traverse the list without visual feedback.
摘要翻译: 许多实施例可以包括诸如硬件和/或代码的逻辑,以通过列表的可听映射,使用基于传感器的手势识别,音频和触觉反馈以及按钮选择来实现用于遍历长排序列表的用户界面。 在几个实施例中,这样的用户接口模态在物理上尺寸较小,使用户能够通过减少操作设备所需的认知负载来真正地移动。 对于一些实施例,用户界面可以在多个磨损的设备(例如移动设备,手表,耳机和环)上被划分。 手表的旋转可以转换为导航指令,允许用户遍历列表,同时用户经由耳机接收音频反馈以描述列表中的项目以及关于导航状态的音频反馈。 许多实施例为用户提供了一个简单的用户界面来遍历列表而无需视觉反馈。
-
公开(公告)号:US20170367634A1
公开(公告)日:2017-12-28
申请号:US15191997
申请日:2016-06-24
申请人: Rita H. Wouhaybi , Lama Nachman , Sangita Sharma , Giuseppe Raffa
发明人: Rita H. Wouhaybi , Lama Nachman , Sangita Sharma , Giuseppe Raffa
IPC分类号: A61B5/16 , A61B5/00 , A61B5/0205 , H04L29/08 , A61B5/024
CPC分类号: A61B5/165 , A61B2560/0242 , G16H10/60 , G16H40/63 , H04L67/18 , H04L67/306 , H04W4/021 , H04W4/029 , H04W4/21 , H04W4/38
摘要: A system for mapping user emotions includes a plurality of sensors for measuring user emotion indications and environmental data. A controller is coupled to the plurality of sensors. The controller reads the plurality of sensors to obtain at least one user emotion indication and environmental data coincident with the at least one user emotion indication. The controller further associates the environmental data with the user emotion indication.
-
公开(公告)号:US20140292807A1
公开(公告)日:2014-10-02
申请号:US13851394
申请日:2013-03-27
申请人: Giuseppe Raffa , Glen J. Anderson , Lama Nachman , Yi Wu , Rahul C. Shah
发明人: Giuseppe Raffa , Glen J. Anderson , Lama Nachman , Yi Wu , Rahul C. Shah
IPC分类号: G06T19/00
CPC分类号: G06T19/006 , G05B2219/32014
摘要: Apparatuses, systems, media and methods may provide for environment actuation by one or more augmented reality elements. A location module may determine a location of one or more networked devices in a real space and/or establish a location of the one or more augmented reality elements in a virtual space, which may be mapped to the real space. A coordinator module may coordinate a virtual action in the virtual space of the one or more augmented reality elements with an actuation event by the one or more networked devices in the real space. The actuation event may correspond to the virtual action in the virtual space and be discernible in the real space.
摘要翻译: 设备,系统,介质和方法可以通过一个或多个增强现实元件来提供环境致动。 位置模块可以确定实际空间中的一个或多个联网设备的位置和/或建立虚拟空间中的一个或多个增强现实元素的位置,虚拟空间可以映射到真实空间。 协调器模块可以通过实际空间中的一个或多个联网设备的致动事件来协调一个或多个增强现实元件的虚拟空间中的虚拟动作。 启动事件可以对应于虚拟空间中的虚拟动作,并且在实际空间中可辨别。
-
公开(公告)号:US08447609B2
公开(公告)日:2013-05-21
申请号:US12347977
申请日:2008-12-31
CPC分类号: G06F17/2775 , G10L13/00
摘要: Embodiments may be a standalone module or part of mobile devices, desktop computers, servers, stereo systems, or any other systems that might benefit from condensed audio presentations of item structures such as lists or tables. Embodiments may comprise logic such as hardware and/or code to adjust the temporal characteristics of items comprising words. The items maybe included in a structure such as a text listing or table, an audio listing or table, or a combination thereof, or may be individual words or phrases. For instance, embodiments may comprise a keyword extractor to extract keywords from the items and an abbreviations generator to generate abbreviations based upon the keywords. Further embodiments may comprise a text-to-speech generator to generate audible items based upon the abbreviations to render to a user while traversing the item structure.
摘要翻译: 实施例可以是独立模块或移动设备,台式计算机,服务器,立体声系统或可能受益于诸如列表或表的项目结构的聚合音频呈现的任何其他系统的独立模块或部分。 实施例可以包括诸如硬件和/或代码的逻辑,以调整包括单词的项目的时间特征。 项目可以包括在诸如文本列表或表格,音频列表或表格或其组合的结构中,或者可以是单独的单词或短语。 例如,实施例可以包括从项目中提取关键词的关键字提取器和缩写生成器,以基于关键字生成缩写。 另外的实施例可以包括文本到语音生成器,以便在遍历项目结构的同时基于缩写来生成可听见的项目以呈现给用户。
-
公开(公告)号:US20180096632A1
公开(公告)日:2018-04-05
申请号:US15282690
申请日:2016-09-30
申请人: Omar U. Florez , Rita H. Wouhaybi , Lenitra M. Durham , Giuseppe Raffa , Jonathan J. Huang , Chieh-Yih Wan , Lama Nachman
发明人: Omar U. Florez , Rita H. Wouhaybi , Lenitra M. Durham , Giuseppe Raffa , Jonathan J. Huang , Chieh-Yih Wan , Lama Nachman
CPC分类号: G09B21/007 , G06K9/00671 , G06K9/46 , G08B6/00 , G10L13/00 , G10L25/30 , G10L25/51
摘要: Systems, apparatuses and methods may leverage technology that generates textual descriptions of scenes based on visual content and audio content and generates haptic signals based on the textual descriptions if the textual descriptions satisfy a safety-related condition. Additionally, audio output signals may be generated based on the textual descriptions if the textual descriptions do not satisfy the safety-related conditions. In one example, a complex neural network (CNN) is trained and used to generate the textual descriptions in real-time.
-
公开(公告)号:US20170091628A1
公开(公告)日:2017-03-30
申请号:US14866889
申请日:2015-09-26
申请人: Lama Nachman , Ashwini Asokan , Giuseppe Raffa , Rita H. Wouhaybi , Saurav Sahay , Omar U. Florez , Rahul C. Shah , Chieh-Yih Wan , Jonathan J. Huang , Hong Lu , Sangita Sharma , Junaith Ahemed Shahabdeen , Douglas P. Bogia , Lenitra Durham
发明人: Lama Nachman , Ashwini Asokan , Giuseppe Raffa , Rita H. Wouhaybi , Saurav Sahay , Omar U. Florez , Rahul C. Shah , Chieh-Yih Wan , Jonathan J. Huang , Hong Lu , Sangita Sharma , Junaith Ahemed Shahabdeen , Douglas P. Bogia , Lenitra Durham
CPC分类号: G06F17/2785 , G06F16/9535 , G06N5/022
摘要: Technologies for automated context-aware media curation include a computing device that captures context data associated with media objects. The context data may include location data, proximity data, behavior data of the user, and social activity data. The computing device generates inferred context data using one or more cognitive or machine learning algorithms. The inferred context data may include semantic time or location data, activity data, or sentiment data. The computing device updates a user context model and an expanded media object graph based on the context data and the inferred context data. The computing device selects one or more target media objects using the user context model and the expanded media object graph. The computing device may present context-aware media experiences to the user with the target media objects. Context-aware media experiences may include contextual semantic search and contextual media browsing. Other embodiments are described and claimed.
-
-
-
-
-
-
-
-
-