-
公开(公告)号:US08675067B2
公开(公告)日:2014-03-18
申请号:US13100504
申请日:2011-05-04
申请人: Philip A. Chou , Zhengyou Zhang , Cha Zhang , Dinei A. Florencio , Zicheng Liu , Rajesh K. Hegde , Nirupama Chandrasekaran
发明人: Philip A. Chou , Zhengyou Zhang , Cha Zhang , Dinei A. Florencio , Zicheng Liu , Rajesh K. Hegde , Nirupama Chandrasekaran
IPC分类号: H04N7/18
CPC分类号: H04L12/1827 , H04N7/147 , H04N7/157
摘要: The subject disclosure is directed towards an immersive conference, in which participants in separate locations are brought together into a common virtual environment (scene), such that they appear to each other to be in a common space, with geometry, appearance, and real-time natural interaction (e.g., gestures) preserved. In one aspect, depth data and video data are processed to place remote participants in the common scene from the first person point of view of a local participant. Sound data may be spatially controlled, and parallax computed to provide a realistic experience. The scene may be augmented with various data, videos and other effects/animations.
摘要翻译: 本发明涉及一种身临其境的会议,其中分开的位置的参与者被聚集到一个共同的虚拟环境(场景)中,使得它们彼此看起来处于共同的空间中,具有几何,外观和实时性, 保留时间自然的相互作用(如手势)。 在一个方面,深度数据和视频数据被处理以将远程参与者从本地参与者的第一人的角度放置在公共场景中。 声音数据可以是空间控制的,并且计算视差以提供真实的体验。 场景可能会增加各种数据,视频和其他效果/动画。
-
公开(公告)号:US08537196B2
公开(公告)日:2013-09-17
申请号:US12245774
申请日:2008-10-06
申请人: Rajesh K. Hegde , Zhengyou Zhang , Philip A. Chou , Cha Zhang , Zicheng Liu , Sasa Junuzovic
发明人: Rajesh K. Hegde , Zhengyou Zhang , Philip A. Chou , Cha Zhang , Zicheng Liu , Sasa Junuzovic
摘要: Multi-device capture and spatial browsing of conferences is described. In one implementation, a system detects cameras and microphones, such as the webcams on participants' notebook computers, in a conference room, group meeting, or table game, and enlists an ad-hoc array of available devices to capture each participant and the spatial relationships between participants. A video stream composited from the array is browsable by a user to navigate a 3-dimensional representation of the meeting. Each participant may be represented by a video pane, a foreground object, or a 3-D geometric model of the participant's face or body displayed in spatial relation to the other participants in a 3-dimensional arrangement analogous to the spatial arrangement of the meeting. The system may automatically re-orient the 3-dimensional representation as needed to best show the currently interesting event such as current speaker or may extend navigation controls to a user for manually viewing selected participants or nuanced interactions between participants.
摘要翻译: 描述会议的多设备捕获和空间浏览。 在一个实现中,系统检测相机和麦克风,例如参与者的笔记本计算机上的网络摄像机,会议室,组会议或桌面游戏,并且招募可用设备的特设阵列以捕获每个参与者和空间 参与者之间的关系。 从阵列合成的视频流可由用户浏览以浏览会议的三维表示。 每个参与者可以以类似于会议的空间安排的三维布置的视频窗格,前景对象或与其他参与者以空间关系显示的三维几何模型来表示。 该系统可以根据需要自动重新定向三维表示,以最佳地显示当前有趣的事件,例如当前的扬声器,或者可以将导航控件扩展到用户,以便手动地观看选定的参与者或参与者之间微妙的交互。
-
公开(公告)号:US08276195B2
公开(公告)日:2012-09-25
申请号:US11968194
申请日:2008-01-02
申请人: Rajesh K. Hegde , Cha Zhang , Philip A. Chou , Zicheng Liu
发明人: Rajesh K. Hegde , Cha Zhang , Philip A. Chou , Zicheng Liu
CPC分类号: G06F21/6209
摘要: Described herein is a method that includes receiving multiple requests for access to an exposed media object, wherein the exposed media object represents a live media stream that is being generated by a media source. The method also includes receiving data associated with each entity that provided a request, and determining, for each entity, whether the entities that provided the request are authorized to access the media stream based at least in part upon the received data and splitting the media stream into multiple media streams, wherein a number of media streams corresponds to a number of authorized entities. The method also includes automatically applying at least one policy to at least one of the split media streams based at least in part upon the received data.
摘要翻译: 这里描述的方法包括接收对暴露的媒体对象的访问的多个请求,其中所述暴露的媒体对象表示正由媒体源生成的实况媒体流。 该方法还包括接收与提供请求的每个实体相关联的数据,以及为每个实体确定提供该请求的实体是否被授权至少部分地基于所接收的数据和分割媒体流来访问媒体流 转换成多个媒体流,其中多个媒体流对应于多个授权实体。 该方法还包括至少部分地基于所接收的数据自动地将至少一个策略应用于至少一个分离媒体流。
-
公开(公告)号:US20090172779A1
公开(公告)日:2009-07-02
申请号:US11968194
申请日:2008-01-02
申请人: Rajesh K. Hegde , Cha Zhang , Philip A. Chou , Zicheng Liu
发明人: Rajesh K. Hegde , Cha Zhang , Philip A. Chou , Zicheng Liu
IPC分类号: G06F21/00
CPC分类号: G06F21/6209
摘要: Described herein is a method that includes receiving multiple requests for access to an exposed media object, wherein the exposed media object represents a live media stream that is being generated by a media source. The method also includes receiving data associated with each entity that provided a request, and determining, for each entity, whether the entities that provided the request are authorized to access the media stream based at least in part upon the received data and splitting the media stream into multiple media streams, wherein a number of media streams corresponds to a number of authorized entities. The method also includes automatically applying at least one policy to at least one of the split media streams based at least in part upon the received data.
摘要翻译: 这里描述的方法包括接收对暴露的媒体对象的访问的多个请求,其中所述暴露的媒体对象表示正由媒体源生成的实况媒体流。 该方法还包括接收与提供请求的每个实体相关联的数据,以及为每个实体确定提供该请求的实体是否被授权至少部分地基于所接收的数据和分割媒体流来访问媒体流 转换成多个媒体流,其中多个媒体流对应于多个授权实体。 该方法还包括至少部分地基于所接收的数据自动地将至少一个策略应用于至少一个分离媒体流。
-
公开(公告)号:US20120281059A1
公开(公告)日:2012-11-08
申请号:US13100504
申请日:2011-05-04
申请人: Philip A. Chou , Zhengyou Zhang , Cha Zhang , Dinei A. Florencio , Zicheng Liu , Rajesh K. Hegde , Nirupama Chandrasekaran
发明人: Philip A. Chou , Zhengyou Zhang , Cha Zhang , Dinei A. Florencio , Zicheng Liu , Rajesh K. Hegde , Nirupama Chandrasekaran
IPC分类号: H04N7/15
CPC分类号: H04L12/1827 , H04N7/147 , H04N7/157
摘要: The subject disclosure is directed towards an immersive conference, in which participants in separate locations are brought together into a common virtual environment (scene), such that they appear to each other to be in a common space, with geometry, appearance, and real-time natural interaction (e.g., gestures) preserved. In one aspect, depth data and video data are processed to place remote participants in the common scene from the first person point of view of a local participant. Sound data may be spatially controlled, and parallax computed to provide a realistic experience. The scene may be augmented with various data, videos and other effects/animations.
摘要翻译: 本发明涉及一种身临其境的会议,其中分开的位置的参与者被聚集到一个共同的虚拟环境(场景)中,使得它们彼此看起来处于共同的空间中,具有几何,外观和实时性, 保留时间自然的相互作用(如手势)。 在一个方面,深度数据和视频数据被处理以将远程参与者从本地参与者的第一人的角度放置在公共场景中。 声音数据可以是空间控制的,并且计算视差以提供真实的体验。 场景可能会增加各种数据,视频和其他效果/动画。
-
公开(公告)号:US20100085416A1
公开(公告)日:2010-04-08
申请号:US12245774
申请日:2008-10-06
申请人: Rajesh K. Hegde , Zhengyou Zhang , Philip A. Chou , Cha Zhang , Zicheng Liu , Sasa Junuzovic
发明人: Rajesh K. Hegde , Zhengyou Zhang , Philip A. Chou , Cha Zhang , Zicheng Liu , Sasa Junuzovic
IPC分类号: H04N7/14
摘要: Multi-device capture and spatial browsing of conferences is described. In one implementation, a system detects cameras and microphones, such as the webcams on participants' notebook computers, in a conference room, group meeting, or table game, and enlists an ad-hoc array of available devices to capture each participant and the spatial relationships between participants. A video stream composited from the array is browsable by a user to navigate a 3-dimensional representation of the meeting. Each participant may be represented by a video pane, a foreground object, or a 3-D geometric model of the participant's face or body displayed in spatial relation to the other participants in a 3-dimensional arrangement analogous to the spatial arrangement of the meeting. The system may automatically re-orient the 3-dimensional representation as needed to best show the currently interesting event such as current speaker or may extend navigation controls to a user for manually viewing selected participants or nuanced interactions between participants.
摘要翻译: 描述会议的多设备捕获和空间浏览。 在一个实现中,系统检测相机和麦克风,例如参与者的笔记本计算机上的网络摄像机,会议室,组会议或桌面游戏,并且招募可用设备的特设阵列以捕获每个参与者和空间 参与者之间的关系。 从阵列合成的视频流可由用户浏览以浏览会议的三维表示。 每个参与者可以以类似于会议的空间安排的三维布置的视频窗格,前景对象或与其他参与者以空间关系显示的三维几何模型来表示。 该系统可以根据需要自动重新定向三维表示,以最佳地显示当前有趣的事件,例如当前的扬声器,或者可以将导航控件扩展到用户,以便手动地观看选定的参与者或参与者之间微妙的交互。
-
公开(公告)号:US08140715B2
公开(公告)日:2012-03-20
申请号:US12473298
申请日:2009-05-28
申请人: Zicheng Liu , Rajesh K. Hegde , Philip A. Chou
发明人: Zicheng Liu , Rajesh K. Hegde , Philip A. Chou
摘要: A virtual media device is described for processing one or more input signals from one or more physical media input devices, to thereby generate an output signal for use by a consuming application module. The consuming application module interacts with the virtual media device as if it were a physical media input device. The virtual media device thereby frees the application module and its user from the burden of having to take specific account of the physical media input devices that are connected to a computing environment. The virtual media device can be coupled to one or more microphone devices, one or more video input devices, or a combination of audio and video input devices, etc. The virtual media device can apply any number of processing modules to generate the output signal, each performing a different respective operation.
摘要翻译: 描述了一种用于处理来自一个或多个物理介质输入设备的一个或多个输入信号的虚拟介质设备,从而生成输出信号供消费应用模块使用。 消费应用模块与虚拟媒体设备交互,就像它是物理媒体输入设备一样。 因此,虚拟媒体设备使应用模块及其用户免于不必特别地考虑连接到计算环境的物理媒体输入设备的负担。 虚拟媒体设备可以耦合到一个或多个麦克风设备,一个或多个视频输入设备,或音频和视频输入设备的组合等。虚拟介质设备可以应用任意数量的处理模块来产生输出信号, 每个执行不同的相应操作。
-
公开(公告)号:US20100302462A1
公开(公告)日:2010-12-02
申请号:US12473298
申请日:2009-05-28
申请人: Zicheng Liu , Rajesh K. Hegde , Philip A. Chou
发明人: Zicheng Liu , Rajesh K. Hegde , Philip A. Chou
IPC分类号: H04N5/60
摘要: A virtual media device is described for processing one or more input signals from one or more physical media input devices, to thereby generate an output signal for use by a consuming application module. The consuming application module interacts with the virtual media device as if it were a physical media input device. The virtual media device thereby frees the application module and its user from the burden of having to take specific account of the physical media input devices that are connected to a computing environment. The virtual media device can be coupled to one or more microphone devices, one or more video input devices, or a combination of audio and video input devices, etc. The virtual media device can apply any number of processing modules to generate the output signal, each performing a different respective operation.
摘要翻译: 描述了一种用于处理来自一个或多个物理介质输入设备的一个或多个输入信号的虚拟介质设备,从而生成输出信号供消费应用模块使用。 消费应用模块与虚拟媒体设备交互,就像它是物理媒体输入设备一样。 因此,虚拟媒体设备使应用模块及其用户免于不必特别地考虑连接到计算环境的物理媒体输入设备的负担。 虚拟媒体设备可以耦合到一个或多个麦克风设备,一个或多个视频输入设备,或音频和视频输入设备的组合等。虚拟介质设备可以应用任意数量的处理模块来产生输出信号, 每个执行不同的相应操作。
-
公开(公告)号:US07840638B2
公开(公告)日:2010-11-23
申请号:US12147603
申请日:2008-06-27
申请人: Zhengyou Zhang , Xuedong David Huang , Zicheng Liu , Cha Zhang , Philip A. Chou , Christian Huitema
发明人: Zhengyou Zhang , Xuedong David Huang , Zicheng Liu , Cha Zhang , Philip A. Chou , Christian Huitema
摘要: A multimedia conference technique is disclosed that allows physically remote users to participate in an immersive telecollaborative environment by synchronizing multiple data, images and sounds. The multimedia conference implementation provides users with the perception of being in the same room visually as well as acoustically according to an orientation plan which reflects each remote user's position within the multimedia conference environment.
摘要翻译: 公开了一种多媒体会议技术,其允许物理上的远程用户通过同步多个数据,图像和声音来参与沉浸式的电视解码环境。 多媒体会议实现为用户提供了根据反映每个远程用户在多媒体会议环境中的位置的方向计划在视觉上和声学上在同一房间中的感觉。
-
公开(公告)号:US20090327418A1
公开(公告)日:2009-12-31
申请号:US12147603
申请日:2008-06-27
申请人: Zhengyou Zhang , Xuedong David Huang , Zicheng Liu , Cha Zhang , Philip A. Chou , Christian Huitema
发明人: Zhengyou Zhang , Xuedong David Huang , Zicheng Liu , Cha Zhang , Philip A. Chou , Christian Huitema
IPC分类号: G06F15/16
摘要: A multimedia conference technique is disclosed that allows physically remote users to participate in an immersive telecollaborative environment by synchronizing multiple data, images and sounds. The multimedia conference implementation provides users with the perception of being in the same room visually as well as acoustically according to an orientation plan which reflects each remote user's position within the multimedia conference environment.
摘要翻译: 公开了一种多媒体会议技术,其允许物理上的远程用户通过同步多个数据,图像和声音来参与沉浸式的电视解码环境。 多媒体会议实现为用户提供了根据反映每个远程用户在多媒体会议环境中的位置的方向计划在视觉上和声学上在同一房间中的感觉。
-
-
-
-
-
-
-
-
-