公开(公告)号：US06750860B1

公开(公告)日：2004-06-15

申请号：US09309753

申请日：1999-05-11

申请人： Heung-Yeung Shum ,  Li-Wei He ,  Qifa Ke

发明人： Heung-Yeung Shum ,  Li-Wei He ,  Qifa Ke

IPC分类号： G06T1500

CPC分类号： G06T3/4007 ,  G06T3/4038

摘要： An image based system and process for rendering novel views of a real or synthesized 3D scene based on a series of concentric mosaics depicting the scene. In one embodiment, each concentric mosaic represents a collection of consecutive slit images of the surrounding 3D scene taken from a different viewpoint tangent to a circle on a plane within the scene. Novel views from viewpoints within circular regions of the aforementioned circle plane defined by the concentric mosaics are rendered using these concentric mosaics. Specifically, a slit image can be identified by a ray originating at its viewpoint on the circle plane and extending toward the longitudinal midline of the slit image. Each of the rays associated with the slit images needed to construct a novel view will either coincide with one of the rays associated with a previously captured slit image, or it will pass between two of the concentric circles on the circle plane. If it coincides, then the previously captured slit image associated with the coinciding ray can be used directly to construct part of the novel view. If the ray passes between two of the concentric circles of the plane, then the needed slit image is interpolated using the two previously captured slit images associated with the rays originating from the adjacent concentric circles that are parallel to the non-coinciding ray. If the objects in the 3D scene are close to the camera, depth correction is applied to reduce image distortion for pixels located above and below the circle plane. In another embodiment, a single camera is used to capture a sequence of images. Each image includes image data that has a ray direction associated therewith. To render an image at a novel viewpoint, multiple ray directions from the novel viewpoint are chosen. Image data is combined from the sequence of images by selecting image data that has a ray direction substantially aligning with the ray direction from the novel viewpoint.

摘要翻译： 基于图像的系统和过程，用于基于描绘场景的一系列同心的马赛克来呈现真实或合成的3D场景的新颖视图。 在一个实施例中，每个同心马赛克表示从与场景内的平面上的圆的切线相切的不同视点拍摄的围绕3D场景的连续狭缝图像的集合。 由同心马赛克定义的上述圆形平面的圆形区域内的观点的新观点使用这些同心马赛克。 具体地说，狭缝图像可以通过其在圆平面上的视点产生的射线来识别，并且朝向狭缝图像的纵向中线延伸。 与构建新视图所需的狭缝图像相关联的每个光线将与与先前捕获的狭缝图像相关联的一条光线重合，或者它将在圆平面上的两个同心圆之间通过。 如果它一致，则可以直接使用与重合光线相关联的先前捕获的狭缝图像来构造新颖视图的一部分。 如果光线穿过平面的两个同心圆之间，则使用与源于与不一致的光线平行的相邻同心圆的光线相关联的两个先前捕获的狭缝图像来插值所需的狭缝图像。 如果3D场景中的对象靠近相机，则应用深度校正来减少位于圆平面上方和下方的像素的图像失真。 在另一个实施例中，单个照相机用于捕获一系列图像。 每个图像包括具有与其相关联的射线方向的图像数据。 为了以新的观点呈现图像，从新观点选择多个射线方向。 从新颖的视点，通过选择具有与射线方向基本对准的射线方向的图像数据，从图像序列组合图像数据。

公开(公告)号：US07739715B2

公开(公告)日：2010-06-15

申请号：US10602847

申请日：2003-06-24

申请人： Li-Wei He ,  Adil Sherwani ,  Patrick N. Nelson ,  Richard William Saunders ,  Jonathan M. Cain ,  Anders E. Klemets

发明人： Li-Wei He ,  Adil Sherwani ,  Patrick N. Nelson ,  Richard William Saunders ,  Jonathan M. Cain ,  Anders E. Klemets

IPC分类号： H04N7/173

CPC分类号： H04L65/4092 ,  H04L29/06027 ,  H04L65/80

摘要： Systems and methods are described that support variable play speed control for media streams. The variable play speed control for media streams discussed herein provides an end-to-end solution for media stream delivery, playback, and user interface that enables end users and software developers to dynamically control the playback speed of media streams without losing the ability to comprehend the media content.

摘要翻译： 描述了支持媒体流的可变播放速度控制的系统和方法。 本文讨论的媒体流的可变播放速度控制提供了用于媒体流传送，回放和用户界面的端到端解决方案，其使终端用户和软件开发者能够动态地控制媒体流的播放速度，而不失去理解的能力 媒体内容。

公开(公告)号：US20060098013A1

公开(公告)日：2006-05-11

申请号：US11311870

申请日：2005-12-19

申请人： Curtis Wong ,  Steven Drucker ,  Michael Cohen ,  Li-Wei He ,  Asta Glatzer ,  Steven De Mar

发明人： Curtis Wong ,  Steven Drucker ,  Michael Cohen ,  Li-Wei He ,  Asta Glatzer ,  Steven De Mar

IPC分类号： G06T15/70 ,  G06T13/00

CPC分类号： A63F13/86 ,  A63F13/12 ,  A63F13/5252 ,  A63F13/5255 ,  A63F2300/577 ,  Y10S345/952

摘要： A spectator experience corresponding to an occurrence of one or more games or events is generated based on each associated occurrence. The occurrence of a game or event varies in response to contributions and/or interactions of one or more participants of the game or event. The spectator experience enables users thereof to observe an augmented version of the game or event, such as by implementing enhanced viewpoint controls and/or other spectator related effects. In a particular aspect, the spectator experience can provide an indication of the spectator' presence, which is made available to the spectators and/or to the participants of the game.

摘要翻译： 基于每个相关联的事件生成对应于一个或多个游戏或事件的发生的观众体验。 游戏或事件的发生响应于游戏或事件的一个或多个参与者的贡献和/或交互而变化。 观众体验使其用户能够观察游戏或事件的增强版本，例如通过实施增强的视点控制和/或其他观众相关效果。 在特定方面，观众体验可以提供观众的存在的指示，这是向观众和/或游戏参与者提供的。

公开(公告)号：US20050058145A1

公开(公告)日：2005-03-17

申请号：US10663390

申请日：2003-09-15

申请人： Dinei Florencio ,  Philip Chou ,  Li-Wei He

发明人： Dinei Florencio ,  Philip Chou ,  Li-Wei He

IPC分类号： G10L19/00 ,  H04L12/56

CPC分类号： H04N21/4392 ,  G10L19/005 ,  H04N21/4394 ,  H04N21/4396 ,  H04N21/4398

摘要： An “adaptive audio playback controller” operates by decoding and reading received packets of an audio signal into a signal buffer. Samples of the decoded audio signal are then played out of the signal buffer according to the needs of a player device. Jitter control and packet loss concealment are accomplished by continuously analyzing buffer content in real-time, and determining whether to provide unmodified playback from the buffer contents, whether to compress buffer content, stretch buffer content, or whether to provide for packet loss concealment for overly delayed or lost packets as a function of buffer content. Further, the adaptive audio playback controller also determines where to stretch or compress particular frames or signal segments in the signal buffer, and how much to stretch or compress such segments in order to optimize perceived playback quality.

摘要翻译： “自适应音频播放控制器”通过将音频信号的接收分组解码并读取到信号缓冲器来进行操作。 然后根据播放器设备的需要从信号缓冲器中播放经解码的音频信号的样本。 抖动控制和分组丢失隐藏是通过实时连续分析缓冲区内容来实现的，并且确定是否从缓冲器内容中提供未修改的重放，是否压缩缓冲区内容，扩展缓冲区内容，还是提供丢包隐藏 延迟或丢失的数据包作为缓冲区内容的函数。 此外，自适应音频重放控制器还确定在哪里拉伸或压缩信号缓冲器中的特定帧或信号段，以及拉伸或压缩这些段以便优化感知的播放质量。

公开(公告)号：US20050055204A1

公开(公告)日：2005-03-10

申请号：US10660325

申请日：2003-09-10

申请人： Dinei Florencio ,  Philip Chou ,  Li-Wei He

发明人： Dinei Florencio ,  Philip Chou ,  Li-Wei He

IPC分类号： G10L19/00 ,  G01L19/00 ,  G10L11/06 ,  G10L21/04 ,  H03M7/30 ,  G10L15/00

CPC分类号： G10L21/04 ,  G10L2025/935

摘要： An adaptive “temporal audio scaler” is provided for automatically stretching and compressing frames of audio signals received across a packet-based network. Prior to stretching or compressing segments of a current frame, the temporal audio scaler first computes a pitch period for each frame for sizing signal templates used for matching operations in stretching and compressing segments. Further, the temporal audio scaler also determines the type or types of segments comprising each frame. These segment types include “voiced” segments, “unvoiced” segments, and “mixed” segments which include both voiced and unvoiced portions. The stretching or compression methods applied to segments of each frame are then dependent upon the type of segments comprising each frame. Further, the amount of stretching and compression applied to particular segments is automatically variable for minimizing signal artifacts while still ensuring that an overall target stretching or compression ratio is maintained for each frame.

摘要翻译： 提供了一种自适应“时间音频缩放器”，用于自动地拉伸和压缩通过基于分组的网络接收的音频信号的帧。 在拉伸或压缩当前帧的段之前，时间音频缩放器首先计算用于每个帧的音调周期，用于调整用于拉伸和压缩段中的匹配操作的信号模板。 此外，时间音频缩放器还确定包括每个帧的片段的类型或类型。 这些段类型包括“有声”段，“无声”段和包括有声和无声部分的“混合”段。 然后，应用于每个帧的段的拉伸或压缩方法取决于包括每个帧的段的类型。 此外，施加到特定段的拉伸和压缩量可自动变化以最小化信号伪影，同时仍然确保为每个帧维持整体目标拉伸或压缩比。