-
公开(公告)号:US08284157B2
公开(公告)日:2012-10-09
申请号:US12688804
申请日:2010-01-15
申请人: Relja Markovic , Stephen G Latta , Kevin A Geisner , Christopher Vuchetich , Darren A Bennett , Brian S Murphy , Shawn C Wright
发明人: Relja Markovic , Stephen G Latta , Kevin A Geisner , Christopher Vuchetich , Darren A Bennett , Brian S Murphy , Shawn C Wright
IPC分类号: G09G5/00
CPC分类号: G06F3/017 , A63F13/06 , A63F13/10 , A63F2300/1081 , A63F2300/1087 , A63F2300/305 , A63F2300/61
摘要: Techniques for enhancing the use of a motion capture system are provided. A motion capture system tracks movement and audio inputs from a person in a physical space, and provides the inputs to an application, which displays a virtual space on a display. Bodily movements can be used to define traits of an avatar in the virtual space. The person can be directed to perform the movements by a coaching avatar, or visual or audio cues in the virtual space. The application can respond to the detected movements and voice commands or voice volume of the person to define avatar traits and initiate pre-scripted audio-visual events in the virtual space to provide an entertaining experience. A performance in the virtual space can be captured and played back with automatic modifications, such as alterations to the avatar's voice or appearance, or modifications made by another person.
摘要翻译: 提供了用于增强运动捕捉系统的使用的技术。 运动捕捉系统跟踪来自物理空间中的人的移动和音频输入,并将输入提供给在显示器上显示虚拟空间的应用。 身体动作可用于定义虚拟空间中化身的特征。 可以通过辅导化身或虚拟空间中的视觉或音频提示来指导人员执行动作。 应用程序可以响应检测到的人的移动和语音命令或语音量来定义化身特征,并在虚拟空间中发起预先编写的视听事件以提供娱乐体验。 可以通过自动修改(例如对化身的声音或外观的更改)或其他人进行的修改来捕获和播放虚拟空间中的演奏。
-
公开(公告)号:US09280203B2
公开(公告)日:2016-03-08
申请号:US13196618
申请日:2011-08-02
CPC分类号: G06F3/011 , A63F13/00 , A63F2300/1012 , A63F2300/1093 , A63F2300/6045 , G06F3/017 , G06F3/033 , G06F3/04883 , G06K9/00342 , G06K9/00389
摘要: Systems, methods and computer readable media are disclosed for a gesture recognizer system architecture. A recognizer engine is provided, which receives user motion data and provides that data to a plurality of filters. A filter corresponds to a gesture, that may then be tuned by an application receiving information from the gesture recognizer so that the specific parameters of the gesture—such as an arm acceleration for a throwing gesture—may be set on a per-application level, or multiple times within a single application. Each filter may output to an application using it a confidence level that the corresponding gesture occurred, as well as further details about the user motion data.
摘要翻译: 公开了用于手势识别器系统架构的系统,方法和计算机可读介质。 提供识别引擎,其接收用户运动数据并将该数据提供给多个滤波器。 过滤器对应于手势,然后可以通过应用从手势识别器接收信息进行调整,使得手势的特定参数(例如用于投掷手势的手臂加速度)可以在每个应用程序级设置, 或在单个应用程序中多次。 每个滤波器可以使用它来输出相应手势发生的置信水平的应用,以及关于用户运动数据的进一步细节。
-
公开(公告)号:US20130002813A1
公开(公告)日:2013-01-03
申请号:US13172633
申请日:2011-06-29
申请人: Benjamin I. Vaught , Alex Aben-Athar Kipman , Michael J. Scavezze , Arthur C. Tomlin , Relja Markovic , Darren Bennett , Stephen G. Latta
发明人: Benjamin I. Vaught , Alex Aben-Athar Kipman , Michael J. Scavezze , Arthur C. Tomlin , Relja Markovic , Darren Bennett , Stephen G. Latta
CPC分类号: H04N13/161 , H04N13/194 , H04N13/344 , H04N13/383 , H04N21/2187 , H04N21/274
摘要: Techniques are provided for viewing windows for video streams. A video stream from a video capture device is accessed. Data that describes movement or position of a person is accessed. A viewing window is placed in the video stream based on the data that describes movement or position of the person. The viewing window is provided to a display device in accordance with the placement of the viewing window in the video stream. Motion sensors can detect motion of the person carrying the video capture device in order to dampen the motion such that the video on the remote display does not suffer from motion artifacts. Sensors can also track the eye gaze of either the person carrying the mobile video capture device or the remote display device to enable control of the spatial region of the video stream shown at the display device.
摘要翻译: 提供技术来查看视频流的窗口。 来自视频采集设备的视频流被访问。 访问描述人的移动或位置的数据。 基于描述人的移动或位置的数据将观看窗口放置在视频流中。 根据观看窗口在视频流中的放置,将观看窗口提供给显示设备。 运动传感器可以检测携带视频捕获设备的人的运动,以便抑制运动,使得远程显示器上的视频不会受到运动伪像的影响。 传感器还可以跟踪携带移动视频捕获设备或远程显示设备的人的眼睛注视,以便能够控制显示设备上显示的视频流的空间区域。
-
公开(公告)号:US09288468B2
公开(公告)日:2016-03-15
申请号:US13172633
申请日:2011-06-29
申请人: Benjamin I. Vaught , Alex Aben-Athar Kipman , Michael J. Scavezze , Arthur C. Tomlin , Relja Markovic , Darren Bennett , Stephen G. Latta
发明人: Benjamin I. Vaught , Alex Aben-Athar Kipman , Michael J. Scavezze , Arthur C. Tomlin , Relja Markovic , Darren Bennett , Stephen G. Latta
IPC分类号: H04N13/00 , H04N13/04 , G09G5/00 , H04N21/2187 , H04N21/274
CPC分类号: H04N13/161 , H04N13/194 , H04N13/344 , H04N13/383 , H04N21/2187 , H04N21/274
摘要: Techniques are provided for viewing windows for video streams. A video stream from a video capture device is accessed. Data that describes movement or position of a person is accessed. A viewing window is placed in the video stream based on the data that describes movement or position of the person. The viewing window is provided to a display device in accordance with the placement of the viewing window in the video stream. Motion sensors can detect motion of the person carrying the video capture device in order to dampen the motion such that the video on the remote display does not suffer from motion artifacts. Sensors can also track the eye gaze of either the person carrying the mobile video capture device or the remote display device to enable control of the spatial region of the video stream shown at the display device.
摘要翻译: 提供技术来查看视频流的窗口。 来自视频采集设备的视频流被访问。 访问描述人的移动或位置的数据。 基于描述人的移动或位置的数据将观看窗口放置在视频流中。 根据观看窗口在视频流中的放置,将观看窗口提供给显示设备。 运动传感器可以检测携带视频捕获设备的人的运动,以便抑制运动,使得远程显示器上的视频不会受到运动伪像的影响。 传感器还可以跟踪携带移动视频捕获设备或远程显示设备的人的眼睛注视,以便能够控制显示设备上显示的视频流的空间区域。
-
公开(公告)号:US08933884B2
公开(公告)日:2015-01-13
申请号:US12688793
申请日:2010-01-15
申请人: Relja Markovic , Stephen G. Latta , Kevin A. Geisner , David Hill , Darren A. Bennett , David C. Haley, Jr. , Brian S. Murphy , Shawn C. Wright
发明人: Relja Markovic , Stephen G. Latta , Kevin A. Geisner , David Hill , Darren A. Bennett , David C. Haley, Jr. , Brian S. Murphy , Shawn C. Wright
CPC分类号: A63F13/424 , A63F13/06 , A63F13/10 , A63F13/213 , A63F13/803 , A63F2300/1093 , A63F2300/6045 , A63F2300/6072 , A63F2300/8017 , A63F2300/8023 , G06F3/017 , G06F3/038
摘要: In a motion capture system, a unitary input is provided to an application based on detected movement and/or location of a group of people. Audio information from the group can also be used as an input. The application can provide real-time feedback to the person or group via a display and audio output. The group can control the movement of an avatar in a virtual space based on the movement of each person in the group, such as in a steering or balancing game. To avoid a discontinuous or confusing output by the application, missing data can be generated for a person who is occluded or partially out of the field of view. A wait time can be set for activating a new person and deactivating a currently-active person. The wait time can be adaptive based on a first detected position or a last detected position of the person.
摘要翻译: 在运动捕捉系统中,基于检测到的一组人的移动和/或位置,向应用提供单一输入。 组中的音频信息也可以用作输入。 应用程序可以通过显示和音频输出向人员或组提供实时反馈。 该组可以基于每个人在组中的移动来控制虚拟空间中的化身的移动,诸如在转向或平衡游戏中。 为了避免应用程序的不连续或混乱的输出,可以为被遮挡或部分超出视野的人员生成丢失的数据。 可以设置等待时间来激活新人员并停用当前活跃的人员。 等待时间可以基于人的第一检测位置或最后检测到的位置来适应。
-
公开(公告)号:US20130177296A1
公开(公告)日:2013-07-11
申请号:US13689413
申请日:2012-11-29
IPC分类号: H04N9/80
CPC分类号: H04N9/80 , H04N5/772 , H04N9/8205
摘要: A system and method for efficiently managing life experiences captured by one or more sensors (e.g., video or still camera, image sensors including RGB sensors and depth sensors). A “life recorder” is a recording device that continuously captures life experiences, including unanticipated life experiences, in image, video, and/or audio recordings. In some embodiments, video and/or audio recordings captured by a life recorder are automatically analyzed, tagged with a set of one or more metadata, indexed, and stored for future use. By tagging and indexing life recordings, a life recorder may search for and acquire life recordings generated by itself or another life recorder, thereby allowing life experiences to be shared minutes or even years later.
摘要翻译: 一种用于有效地管理由一个或多个传感器(例如,视频或静态照相机,包括RGB传感器和深度传感器的图像传感器)捕获的生活体验的系统和方法。 “生命记录器”是在图像,视频和/或音频记录中不断捕捉生活经历(包括意外的生活体验)的记录装置。 在一些实施例中,由生命记录器捕获的视频和/或音频记录被自动分析,用一组一个或多个元数据标记,索引并存储以备将来使用。 通过对生活记录进行标签和索引,生命记录器可以搜索并获取自身或其他生命记录器生成的生命记录,从而允许在几分钟甚至几年之后共享生活体验。
-
公开(公告)号:US20110285620A1
公开(公告)日:2011-11-24
申请号:US13196588
申请日:2011-08-02
IPC分类号: G09G5/00
CPC分类号: G06F3/011 , A63F13/00 , A63F2300/1012 , A63F2300/1093 , A63F2300/6045 , G06F3/017 , G06F3/033 , G06F3/04883 , G06K9/00342 , G06K9/00389
摘要: Systems, methods and computer readable media are disclosed for a gesture recognizer system architecture. A recognizer engine is provided, which receives user motion data and provides that data to a plurality of filters. A filter corresponds to a gesture, that may then be tuned by an application receiving information from the gesture recognizer so that the specific parameters of the gesture—such as an arm acceleration for a throwing gesture—may be set on a per-application level, or multiple times within a single application. Each filter may output to an application using it a confidence level that the corresponding gesture occurred, as well as further details about the user motion data.
摘要翻译: 公开了用于手势识别器系统架构的系统,方法和计算机可读介质。 提供识别引擎,其接收用户运动数据并将该数据提供给多个滤波器。 过滤器对应于手势,然后可以通过应用从手势识别器接收信息进行调整,使得手势的特定参数(例如用于投掷手势的手臂加速度)可以在每个应用程序级设置, 或在单个应用程序中多次。 每个滤波器可以使用它来输出相应手势发生的置信水平的应用,以及关于用户运动数据的进一步细节。
-
公开(公告)号:US07996793B2
公开(公告)日:2011-08-09
申请号:US12422661
申请日:2009-04-13
CPC分类号: G06F3/011 , A63F13/00 , A63F2300/1012 , A63F2300/1093 , A63F2300/6045 , G06F3/017 , G06F3/033 , G06F3/04883 , G06K9/00342 , G06K9/00389
摘要: Systems, methods and computer readable media are disclosed for a gesture recognizer system architecture. A recognizer engine is provided, which receives user motion data and provides that data to a plurality of filters. A filter corresponds to a gesture, that may then be tuned by an application receiving information from the gesture recognizer so that the specific parameters of the gesture—such as an arm acceleration for a throwing gesture—may be set on a per-application level, or multiple times within a single application. Each filter may output to an application using it a confidence level that the corresponding gesture occurred, as well as further details about the user motion data.
摘要翻译: 公开了用于手势识别器系统架构的系统,方法和计算机可读介质。 提供识别引擎,其接收用户运动数据并将该数据提供给多个滤波器。 过滤器对应于手势,然后可以通过应用从手势识别器接收信息进行调整,使得手势的特定参数(例如用于投掷手势的手臂加速度)可以在每个应用程序级设置, 或在单个应用程序中多次。 每个滤波器可以使用它来输出相应手势发生的置信水平的应用,以及关于用户运动数据的进一步细节。
-
公开(公告)号:US20110175801A1
公开(公告)日:2011-07-21
申请号:US12688804
申请日:2010-01-15
申请人: Relja Markovic , Stephen G. Latta , Kevin A. Geisner , Christopher Vuchetich , Darren A. Bennett , Brian S. Murphy , Shawn C. Wright
发明人: Relja Markovic , Stephen G. Latta , Kevin A. Geisner , Christopher Vuchetich , Darren A. Bennett , Brian S. Murphy , Shawn C. Wright
CPC分类号: G06F3/017 , A63F13/06 , A63F13/10 , A63F2300/1081 , A63F2300/1087 , A63F2300/305 , A63F2300/61
摘要: Techniques for enhancing the use of a motion capture system are provided. A motion capture system tracks movement and audio inputs from a person in a physical space, and provides the inputs to an application, which displays a virtual space on a display. Bodily movements can be used to define traits of an avatar in the virtual space. The person can be directed to perform the movements by a coaching avatar, or visual or audio cues in the virtual space. The application can respond to the detected movements and voice commands or voice volume of the person to define avatar traits and initiate pre-scripted audio-visual events in the virtual space to provide an entertaining experience. A performance in the virtual space can be captured and played back with automatic modifications, such as alterations to the avatar's voice or appearance, or modifications made by another person.
摘要翻译: 提供了用于增强运动捕捉系统的使用的技术。 运动捕捉系统跟踪来自物理空间中的人的移动和音频输入,并将输入提供给在显示器上显示虚拟空间的应用。 身体动作可用于定义虚拟空间中化身的特征。 可以通过辅导化身或虚拟空间中的视觉或音频提示来指导人员执行动作。 应用程序可以响应检测到的人的移动和语音命令或语音量来定义化身特征,并在虚拟空间中发起预先编写的视听事件以提供娱乐体验。 可以通过自动修改(例如对化身的声音或外观的更改)或其他人进行的修改来捕获和播放虚拟空间中的演奏。
-
公开(公告)号:US20100199230A1
公开(公告)日:2010-08-05
申请号:US12422661
申请日:2009-04-13
IPC分类号: G06F3/033
CPC分类号: G06F3/011 , A63F13/00 , A63F2300/1012 , A63F2300/1093 , A63F2300/6045 , G06F3/017 , G06F3/033 , G06F3/04883 , G06K9/00342 , G06K9/00389
摘要: Systems, methods and computer readable media are disclosed for a gesture recognizer system architecture. A recognizer engine is provided, which receives user motion data and provides that data to a plurality of filters. A filter corresponds to a gesture, that may then be tuned by an application receiving information from the gesture recognizer so that the specific parameters of the gesture—such as an arm acceleration for a throwing gesture—may be set on a per-application level, or multiple times within a single application. Each filter may output to an application using it a confidence level that the corresponding gesture occurred, as well as further details about the user motion data.
摘要翻译: 公开了用于手势识别器系统架构的系统,方法和计算机可读介质。 提供识别引擎,其接收用户运动数据并将该数据提供给多个滤波器。 过滤器对应于手势,然后可以通过应用从手势识别器接收信息进行调整,使得手势的特定参数(例如用于投掷手势的手臂加速度)可以在每个应用程序级设置, 或在单个应用程序中多次。 每个滤波器可以使用它来输出相应手势发生的置信水平的应用,以及关于用户运动数据的进一步细节。
-
-
-
-
-
-
-
-
-