-
公开(公告)号:US08284157B2
公开(公告)日:2012-10-09
申请号:US12688804
申请日:2010-01-15
申请人: Relja Markovic , Stephen G Latta , Kevin A Geisner , Christopher Vuchetich , Darren A Bennett , Brian S Murphy , Shawn C Wright
发明人: Relja Markovic , Stephen G Latta , Kevin A Geisner , Christopher Vuchetich , Darren A Bennett , Brian S Murphy , Shawn C Wright
IPC分类号: G09G5/00
CPC分类号: G06F3/017 , A63F13/06 , A63F13/10 , A63F2300/1081 , A63F2300/1087 , A63F2300/305 , A63F2300/61
摘要: Techniques for enhancing the use of a motion capture system are provided. A motion capture system tracks movement and audio inputs from a person in a physical space, and provides the inputs to an application, which displays a virtual space on a display. Bodily movements can be used to define traits of an avatar in the virtual space. The person can be directed to perform the movements by a coaching avatar, or visual or audio cues in the virtual space. The application can respond to the detected movements and voice commands or voice volume of the person to define avatar traits and initiate pre-scripted audio-visual events in the virtual space to provide an entertaining experience. A performance in the virtual space can be captured and played back with automatic modifications, such as alterations to the avatar's voice or appearance, or modifications made by another person.
摘要翻译: 提供了用于增强运动捕捉系统的使用的技术。 运动捕捉系统跟踪来自物理空间中的人的移动和音频输入,并将输入提供给在显示器上显示虚拟空间的应用。 身体动作可用于定义虚拟空间中化身的特征。 可以通过辅导化身或虚拟空间中的视觉或音频提示来指导人员执行动作。 应用程序可以响应检测到的人的移动和语音命令或语音量来定义化身特征,并在虚拟空间中发起预先编写的视听事件以提供娱乐体验。 可以通过自动修改(例如对化身的声音或外观的更改)或其他人进行的修改来捕获和播放虚拟空间中的演奏。
-
公开(公告)号:US08465108B2
公开(公告)日:2013-06-18
申请号:US13603912
申请日:2012-09-05
申请人: Relja Markovic , Stephen G Latta , Kevin A Geisner , Christopher Vuchetich , Darren A Bennett , Brian S Murphy , Shawn C Wright
发明人: Relja Markovic , Stephen G Latta , Kevin A Geisner , Christopher Vuchetich , Darren A Bennett , Brian S Murphy , Shawn C Wright
IPC分类号: G09G5/00
CPC分类号: G06F3/017 , A63F13/06 , A63F13/10 , A63F2300/1081 , A63F2300/1087 , A63F2300/305 , A63F2300/61
摘要: Techniques for enhancing the use of a motion capture system are provided. A motion capture system tracks movement and audio inputs from a person in a physical space, and provides the inputs to an application, which displays a virtual space on a display. Bodily movements can be used to define traits of an avatar in the virtual space. The person can be directed to perform the movements by a coaching avatar, or visual or audio cues in the virtual space. The application can respond to the detected movements and voice commands or voice volume of the person to define avatar traits and initiate pre-scripted audio-visual events in the virtual space to provide an entertaining experience. A performance in the virtual space can be captured and played back with automatic modifications, such as alterations to the avatar's voice or appearance, or modifications made by another person.
摘要翻译: 提供了用于增强运动捕捉系统的使用的技术。 运动捕捉系统跟踪来自物理空间中的人的移动和音频输入,并将输入提供给在显示器上显示虚拟空间的应用。 身体动作可用于定义虚拟空间中化身的特征。 可以通过辅导化身或虚拟空间中的视觉或音频提示来指导人员执行动作。 应用程序可以响应检测到的人的移动和语音命令或语音量来定义化身特征,并在虚拟空间中发起预先编写的视听事件以提供娱乐体验。 可以通过自动修改(例如对化身的声音或外观的更改)或其他人进行的修改来捕获和播放虚拟空间中的演奏。
-
公开(公告)号:US07961174B1
公开(公告)日:2011-06-14
申请号:US12847133
申请日:2010-07-30
申请人: Relja Markovic , Stephen G Latta , Kevin A Geisner , David Hill , Darren A Bennett , David C Haley , Brian S Murphy , Shawn C Wright
发明人: Relja Markovic , Stephen G Latta , Kevin A Geisner , David Hill , Darren A Bennett , David C Haley , Brian S Murphy , Shawn C Wright
IPC分类号: G06F3/033
CPC分类号: A63F13/424 , A63F13/06 , A63F13/10 , A63F13/213 , A63F13/803 , A63F2300/1093 , A63F2300/6045 , A63F2300/6072 , A63F2300/8017 , A63F2300/8023 , G06F3/017 , G06F3/038
摘要: In a motion capture system, a unitary input is provided to an application based on detected movement and/or location of a group of people. Audio information from the group can also be used as an input. The application can provide real-time feedback to the person or group via a display and audio output. The group can control the movement of an avatar in a virtual space based on the movement of each person in the group, such as in a steering or balancing game. To avoid a discontinuous or confusing output by the application, missing data can be generated for a person who is occluded or partially out of the field of view. A wait time can be set for activating a new person and deactivating a currently-active person. The wait time can be adaptive based on a first detected position or a last detected position of the person.
摘要翻译: 在运动捕捉系统中,基于检测到的一组人的移动和/或位置,向应用提供单一输入。 组中的音频信息也可以用作输入。 应用程序可以通过显示和音频输出向人员或组提供实时反馈。 该组可以基于每个人在组中的移动来控制虚拟空间中的化身的移动,诸如在转向或平衡游戏中。 为了避免应用程序的不连续或混乱的输出,可以为被遮挡或部分超出视野的人员生成丢失的数据。 可以设置等待时间来激活新人员并停用当前活跃的人员。 等待时间可以基于人的第一检测位置或最后检测到的位置来适应。
-
公开(公告)号:US08334842B2
公开(公告)日:2012-12-18
申请号:US12688808
申请日:2010-01-15
申请人: Relja Markovic , Stephen G Latta , Kevin A Geisner , Jonathan T Steed , Darren A Bennett , Amos D Vance
发明人: Relja Markovic , Stephen G Latta , Kevin A Geisner , Jonathan T Steed , Darren A Bennett , Amos D Vance
摘要: Techniques for facilitating interaction with an application in a motion capture system allow a person to easily begin interacting without manual setup. A depth camera system tracks a person in physical space and evaluates the person's intent to engage with the application. Factors such as location, stance, movement and voice data can be evaluated. Absolute location in a field of view of the depth camera, and location relative to another person, can be evaluated. Stance can include facing a depth camera, indicating a willingness to interact. Movements can include moving toward or away from a central area in the physical space, walking through the field of view, and movements which occur while standing generally in one location, such as moving one's arms around, gesturing, or shifting weight from one foot to another. Voice data can include volume as well as words which are detected by speech recognition.
摘要翻译: 用于促进与运动捕捉系统中的应用的交互的技术允许人们容易地开始在没有手动设置的情况下进行交互。 深度摄像机系统跟踪物理空间中的人物,并评估人员与应用程序接触的意图。 可以评估位置,姿态,运动和语音数据等因素。 深度摄像机的视野中的绝对位置以及相对于另一人的位置可以进行评估。 立场可以包括面对深度相机,表示愿意交互。 运动可以包括朝着或离开物理空间中的中心区域,走过视野,以及一般站立在一个位置时发生的运动,例如将手臂移动,打手势或将重量从一只脚移动到 另一个。 语音数据可以包括音量以及通过语音识别检测到的单词。
-
公开(公告)号:US09498720B2
公开(公告)日:2016-11-22
申请号:US13445616
申请日:2012-04-12
申请人: Kevin A Geisner , Stephen G Latta , Ben J Sugden , Benjamin I Vaught , Alex Aben-Athar Kipman , Kathryn Stone Perez , Ryan L Hastings , Jason Scott , Darren A Bennett , John Clavin , Daniel McCulloch
发明人: Kevin A Geisner , Stephen G Latta , Ben J Sugden , Benjamin I Vaught , Alex Aben-Athar Kipman , Kathryn Stone Perez , Ryan L Hastings , Jason Scott , Darren A Bennett , John Clavin , Daniel McCulloch
IPC分类号: A63F13/65 , A63F13/213 , A63F13/98 , A63F13/40 , A63F13/216 , A63F13/30
CPC分类号: A63F13/65 , A63F13/02 , A63F13/10 , A63F13/12 , A63F13/213 , A63F13/216 , A63F2300/1031 , A63F2300/301 , A63F2300/308
摘要: A game can be created, shared and played using a personal audio/visual apparatus such as a head-mounted display device (HMDD). Rules of the game, and a configuration of the game space, can be standard or custom. Boundary points of the game can be defined by a gaze direction of the HMDD, by the user's location, by a model of a physical game space such as an instrumented court or by a template. Players can be identified and notified of the availability of a game using a server push technology. For example, a user in a particular location may be notified of the availability of a game at that location. A server manages the game, including storing the rules, boundaries and a game state. The game state can identify players and their scores. Real world objects can be imaged and provided as virtual objects in the game space.
摘要翻译: 可以使用诸如头戴式显示装置(HMDD)的个人音频/视频装置来创建,共享和播放游戏。 游戏规则和游戏空间的配置可以是标准的或习惯的。 游戏的边界点可以通过HMDD的注视方向,用户的位置,物理游戏空间的模型,如仪器法庭或模板来定义。 使用服务器推送技术,玩家可以识别和通知游戏的可用性。 例如,可以向特定位置的用户通知该位置处的游戏的可用性。 服务器管理游戏,包括存储规则,边界和游戏状态。 游戏状态可以识别玩家及其成绩。 真实世界的对象可以被成像并作为虚拟对象提供给游戏空间。
-
公开(公告)号:US09128520B2
公开(公告)日:2015-09-08
申请号:US13436511
申请日:2012-03-30
申请人: Kevin A Geisner , Kathryn Stone Perez , Stephen G. Latta , Ben J Sugden , Benjamin I Vaught , Jeffrey B Cole , Alex Aben-Athar Kipman , Ian D McIntyre , Daniel McCulloch
发明人: Kevin A Geisner , Kathryn Stone Perez , Stephen G. Latta , Ben J Sugden , Benjamin I Vaught , Jeffrey B Cole , Alex Aben-Athar Kipman , Ian D McIntyre , Daniel McCulloch
CPC分类号: G06F3/011 , G02B27/017 , G02B2027/0138 , G02B2027/014 , G02B2027/0187 , G06F3/013 , G06T19/006 , G09G3/003 , G09G5/363 , G09G2340/14 , G09G2340/145 , G09G2360/02 , G09G2370/022 , G09G2370/16 , G09G2380/00 , G09G2380/10
摘要: A collaborative on-demand system allows a user of a head-mounted display device (HMDD) to obtain assistance with an activity from a qualified service provider. In a session, the user and service provider exchange camera-captured images and augmented reality images. A gaze-detection capability of the HMDD allows the user to mark areas of interest in a scene. The service provider can similarly mark areas of the scene, as well as provide camera-captured images of the service provider's hand or arm pointing to or touching an object of the scene. The service provider can also select an animation or text to be displayed on the HMDD. A server can match user requests with qualified service providers which meet parameters regarding fee, location, rating and other preferences. Or, service providers can review open requests and self-select appropriate requests, initiating contact with a user.
摘要翻译: 协作式按需系统允许头戴式显示设备(HMDD)的用户获得来自合格服务提供商的活动的帮助。 在会话中,用户和服务提供商交换摄像机拍摄的图像和增强的现实图像。 HMDD的注视检测功能允许用户标记场景中的感兴趣区域。 服务提供商可以类似地标记场景的区域,以及提供指向或触摸场景的对象的服务提供者的手或手臂的照相机拍摄的图像。 服务提供商还可以选择要显示在HMDD上的动画或文本。 服务器可以将符合用户要求的合格服务提供商与符合费用,位置,评级和其他偏好的参数相匹配。 或者,服务提供商可以查看开放请求并自行选择适当的请求,启动与用户的联系。
-
公开(公告)号:US09053483B2
公开(公告)日:2015-06-09
申请号:US13436526
申请日:2012-03-30
申请人: Kevin A Geisner , Kathryn Stonw Perez , Stephen G Latta , Ben J Sugden , Benjamin I Vaught , Alex Aben-Athar Kipman , Cameron G Brown , Holly A Hirzel , Brian J Mount , Daniel McCulloch
发明人: Kevin A Geisner , Kathryn Stonw Perez , Stephen G Latta , Ben J Sugden , Benjamin I Vaught , Alex Aben-Athar Kipman , Cameron G Brown , Holly A Hirzel , Brian J Mount , Daniel McCulloch
CPC分类号: G06Q30/00 , G02B27/017 , G02B2027/0138 , G02B2027/014
摘要: A system provides a recommendation of food items to a user based on nutritional preferences of the user, using a head-mounted display device (HMDD) worn by the user. In a store, a forward-facing camera of the HMDD captures an image of a food item. The food item can be identified by the image, such as based on packaging of the food item. Nutritional parameters of the food item are compared to nutritional preferences of the user to determine whether the food item is recommended. The HMDD displays an augmented reality image to the user indicating whether the food item is recommended. If the food item is not recommended, a substitute food item can be identified. The nutritional preferences can indicate food allergies, preferences for low calorie foods and so forth. In a restaurant, the HMDD can recommend menu selections for a user.
摘要翻译: 系统使用由用户佩戴的头戴式显示装置(HMDD),基于使用者的营养偏好向使用者提供食品的推荐。 在商店中,HMDD的面向前的照相机捕获食物的图像。 食物可以通过图像来识别,例如基于食品的包装。 将食物的营养参数与用户的营养偏好进行比较,以确定食品是否被推荐。 HMDD向用户显示增强现实图像,指示食品是否被推荐。 如果不推荐食品,可以确定替代食品。 营养偏好可以指示食物过敏,低热量食物的喜好等等。 在餐厅,HMDD可以为用户推荐菜单选择。
-
-
-
-
-
-