Synchronization aspects of interactive multimedia presentation management
    1.
    发明授权
    Synchronization aspects of interactive multimedia presentation management 有权
    交互式多媒体演示管理的同步方面

    公开(公告)号:US08799757B2

    公开(公告)日:2014-08-05

    申请号:US11355209

    申请日:2006-02-15

    IPC分类号: G06F17/00 G06F17/30 G11B27/10

    摘要: An interactive multimedia presentation has a predetermined presentation play duration, a video content component (which may include video, audio, data, or any combination thereof), and an interactive content component. Methods and systems for playing the presentation include specifying a time when a particular media object is renderable. The time is specifiable using an application instruction that references either a first timing signal having a rate that is based on the play speed of the presentation, or a second timing signal having a continuous rate. One example of an application instruction usable as described above is an element associated with an XML data structure. An attribute of the element, such as the clock attribute, may be used to provide time values for the element that reference either timing signal. The attribute is used to maintain frame-accurate synchronization between the video and the interactive content components of the presentation.

    摘要翻译: 交互式多媒体呈现具有预定的呈现播放持续时间,视频内容组件(其可以包括视频,音频,数据或其任何组合)和交互式内容组件。 播放演示文稿的方法和系统包括指定特定媒体对象可呈现的时间。 可以使用参考具有基于演示的播放速度的速率的第一定时信号或具有连续速率的第二定时信号来指定时间。 可以如上所述使用的应用指令的一个示例是与XML数据结构相关联的元素。 诸如时钟属性的元素的属性可以用于为引用任一定时信号的元件提供时间值。 该属性用于维护视频和演示文稿的交互内容组件之间的帧精确同步。

    Shared memory pool allocation during media rendering
    2.
    发明授权
    Shared memory pool allocation during media rendering 有权
    在媒体渲染期间共享内存池分配

    公开(公告)号:US07698528B2

    公开(公告)日:2010-04-13

    申请号:US11823510

    申请日:2007-06-28

    IPC分类号: G06F12/00

    摘要: Memory management techniques involve establishing a memory pool having an amount of sharable memory, and dynamically allocating the sharable memory to concurrently manage multiple sets of sequenced units of digital data. In an exemplary scenario, the sets of sequenced units of digital data are sets of time-ordered media samples forming clips of media content, and the techniques are applied when media samples from two or more clips are simultaneously presentable to a user as independently-controlled streams. Variable amounts of sharable memory are dynamically allocated for preparing upcoming media samples for presentation to the user. In one possible implementation, a ratio of average data rates of individual streams is calculated, and amounts of sharable memory are allocated to rendering each stream based on the ratio. Then, the sharable memory allocated to rendering individual streams is reserved as needed to prepare particular upcoming media samples for presentation to the user.

    摘要翻译: 存储器管理技术涉及建立具有可共享存储量的存储器池,以及动态分配可共享存储器以同时管理多组排序的数字数据单元。 在示例性场景中,数字数据的排序单元组是形成媒体内容剪辑的时间有序的媒体样本集合,并且当来自两个或多个剪辑的媒体样本可以独立控制地同时呈现给用户时,应用该技术 流。 动态地分配可变量的共享存储器以准备即将到来的媒体样本以呈现给用户。 在一个可能的实现中,计算各个流的平均数据速率的比率,并且基于该比率分配可共享存储器的量来渲染每个流。 然后,分配用于渲染各个流的可共享存储器根据需要被保留以准备特定的即将到来的媒体样本以呈现给用户。

    Aspects of media content rendering
    3.
    发明授权
    Aspects of media content rendering 有权
    媒体内容呈现方面

    公开(公告)号:US07500175B2

    公开(公告)日:2009-03-03

    申请号:US11405816

    申请日:2006-04-18

    IPC分类号: G06F17/00

    摘要: Media content is arranged into a number of sets of video, audio, or data samples, referred to as clips, which are rendered by a media content manager. A playlist, which is handled by a presentation manager, specifies the time-ordered sequence of clips playable to a user. Certain actions are taken during media content play to minimize glitches perceived by the user, including determining a time offset value that is used to decide how far in advance of a scheduled play time to begin pre-rendering an upcoming clip. The time offset value is determined using one or more static characteristics associated with a media source for the upcoming clip, such as the location of the media source, codec parameters, or encryption complexity, and one or more dynamic characteristics of the presentation system, such as retrieval states, (including play speeds) of media clips, processing loads, or clock frequencies.

    摘要翻译: 媒体内容被布置成由媒体内容管理器呈现的多组视频,音频或数据样本,被称为剪辑。 由演示管理器处理的播放列表指定可播放给用户的剪辑的时间顺序序列。 在媒体内容播放期间采取某些动作以最小化用户感知到的毛刺,包括确定时间偏移值,该时间偏移值用于确定预定播放时间之前的距离以开始预呈现即将到来的剪辑。 使用与用于即将到来的剪辑的媒体源相关联的一个或多个静态特性来确定时间偏移值,例如媒体源的位置,编解码器参数或加密复杂度以及呈现系统的一个或多个动态特性,例如 作为媒体剪辑,处理负载或时钟频率的检索状态(包括播放速度)。

    Digital data management using shared memory pool
    4.
    发明申请
    Digital data management using shared memory pool 有权
    使用共享内存池进行数字数据管理

    公开(公告)号:US20090006771A1

    公开(公告)日:2009-01-01

    申请号:US11823510

    申请日:2007-06-28

    IPC分类号: G06F12/00

    摘要: Memory management techniques involve establishing a memory pool having an amount of sharable memory, and dynamically allocating the sharable memory to concurrently manage multiple sets of sequenced units of digital data. In an exemplary scenario, the sets of sequenced units of digital data are sets of time-ordered media samples forming clips of media content, and the techniques are applied when media samples from two or more clips are simultaneously presentable to a user as independently-controlled streams. Variable amounts of sharable memory are dynamically allocated for preparing upcoming media samples for presentation to the user. In one possible implementation, a ratio of average data rates of individual streams is calculated, and amounts of sharable memory are allocated to rendering each stream based on the ratio. Then, the sharable memory allocated to rendering individual streams is reserved as needed to prepare particular upcoming media samples for presentation to the user.

    摘要翻译: 存储器管理技术涉及建立具有可共享存储量的存储器池,以及动态分配可共享存储器以同时管理多组排序的数字数据单元。 在示例性场景中,数字数据的排序单元组是形成媒体内容剪辑的时间有序的媒体样本集合,并且当来自两个或多个剪辑的媒体样本可以独立控制地同时呈现给用户时,应用该技术 流。 动态地分配可变量的共享存储器以准备即将到来的媒体样本以呈现给用户。 在一个可能的实现中,计算各个流的平均数据速率的比率,并且基于该比率分配可共享存储器的量来渲染每个流。 然后,分配用于渲染各个流的可共享存储器根据需要被保留以准备特定的即将到来的媒体样本以呈现给用户。

    Rendering and compositing multiple applications in an interactive media environment
    5.
    发明授权
    Rendering and compositing multiple applications in an interactive media environment 有权
    在交互式媒体环境中渲染和合成多个应用程序

    公开(公告)号:US08305398B2

    公开(公告)日:2012-11-06

    申请号:US11352575

    申请日:2006-02-13

    IPC分类号: G09G5/00 G06T15/40

    CPC分类号: G06T15/405

    摘要: In an interactive media environment, a model is provided where applications, each comprising zero or more script components and zero or more markup components, are themselves handled as visual elements having a Z order. A resource-efficient rendering order is provided where the application that has focus in an interactive media environment (by virtue of its receipt of user events) is rendered first. The remaining applications are rendered in top down order, i.e., in reverse Z order. Rendering is performed by drawing into one or more graphics buffers associated with respective applications. Frames for applications are composited from the graphics buffers bottoms up, in Z order, to provide the display with the correct appearance.

    摘要翻译: 在交互式媒体环境中,提供了一种模型,其中每个包含零个或多个脚本组件和零个或多个标记组件的应用程序本身被视为具有Z次序的视觉元素。 提供资源有效的渲染顺序,其中首先呈现在交互式媒体环境中(通过其接收用户事件)关注的应用程序。 剩余的应用程序以自上而下的顺序呈现,即以相反的Z顺序渲染。 通过绘制与相应应用相关联的一个或多个图形缓冲器来执行呈现。 应用程序的框架从图形缓冲区按Z顺序合并,以提供正确的显示。

    Distributing input events to multiple applications in an interactive media environment
    6.
    发明授权
    Distributing input events to multiple applications in an interactive media environment 有权
    在交互式媒体环境中将输入事件分发到多个应用程序

    公开(公告)号:US08108787B2

    公开(公告)日:2012-01-31

    申请号:US11351374

    申请日:2006-02-10

    IPC分类号: G06F3/048

    摘要: In an interactive media environment, input events are distributed to a plurality of applications where each application includes zero or more script components and zero or more markup files and has a Z order which corresponds to the position of the applications' visual elements on a display. An input event processing order is utilized where the application that has focus in an interactive media environment (by virtue of its receipt of user events) is provided with the first opportunity to consume the input event. If the focused application does not consume the input event, it is then delivered to the remaining applications in top down, inverse Z order. Each application is enabled with the ability to consume an input event, pass it on to lower Z ordered applications, hide it from lower Z ordered applications, or otherwise handle it. Input event processing stops when an application consumes the input event.

    摘要翻译: 在交互式媒体环境中,输入事件被分发到多个应用程序,其中每个应用程序包括零个或多个脚本组件和零个或多个标记文件,并且具有对应于应用程序在显示器上的视觉元素的位置的Z次序。 使用输入事件处理顺序,其中在交互式媒体环境(通过其接收用户事件)中具有焦点的应用被提供有消费输入事件的第一个机会。 如果聚焦的应用程序不消耗输入事件,那么它将以自上而下的逆Z顺序传递给其余的应用程序。 每个应用程序都能够使用输入事件,将其传递给较低的Z订单应用程序,将其从较低的Z订单应用程序隐藏,或以其他方式处理。 当应用程序消耗输入事件时,输入事件处理停止。

    Queueing events in an interactive media environment
    7.
    发明授权
    Queueing events in an interactive media environment 有权
    在互动媒体环境中排队事件

    公开(公告)号:US08656268B2

    公开(公告)日:2014-02-18

    申请号:US11351085

    申请日:2006-02-09

    IPC分类号: G06F17/00

    CPC分类号: G06F9/542 G06F9/4843

    摘要: An arrangement is provided where all applications in an interactive media environment run on a single application thread in a media player. Event queues are utilized to schedule the application thread's processing of workitems corresponding to events that occur in the environment. Workitems include methods to be invoked when the workitem is processed and arguments for the method. Workitems further include a begin time and an end time and are ordered in the event queue first by begin time followed by the order in which they were inserted into the queue. The application thread marks workitems whose begin times corresponds to the current or previous time and then processes marked workitems from the queue in order. Such processing is committed so that once the application thread begins processing of a workitem it does not stop. Workitems are dropped from the event queue if their end times have been passed.

    摘要翻译: 提供了一种布置,其中交互式媒体环境中的所有应用在媒体播放器中的单个应用程序线程上运行。 事件队列用于调度应用程序线程对与环境中发生的事件相对应的工作项的处理。 工作项包括处理工作项时要调用的方法和方法的参数。 工作进一步包括开始时间和结束时间,并在事件队列中首先按开始时间排序,然后按照它们插入队列的顺序进行排序。 应用程序线程标记其开始时间对应于当前或之前时间的工作项,然后按顺序处理来自队列的标记工作项。 这样的处理被提交,一旦应用程序线程开始处理工作项,它就不会停止。 如果事件队列的结束时间已过,工作项将从事件队列中删除。

    Synchronization aspects of interactive multimedia presentation management
    8.
    发明授权
    Synchronization aspects of interactive multimedia presentation management 有权
    交互式多媒体演示管理的同步方面

    公开(公告)号:US07721308B2

    公开(公告)日:2010-05-18

    申请号:US11355609

    申请日:2006-02-16

    IPC分类号: G06F15/00

    摘要: Playing an interactive multimedia presentation involves pre-rendering a media object at certain times based on a frame rate of the interactive content, a frame rate of the video content (which may include video, audio, data, or any combination thereof), and a play speed of the presentation. Certain actions taken include calculating a current elapsed play time representing an amount of the presentation's play duration that has passed. Based on the calculated time, a current interactive content presentation time is ascertained from an interactive content timeline. The interactive content timeline represents times at which the media object is presentable. A subsequent interactive content presentation time is selected from the interactive content timeline. The presentation state of the media object is predicted for the subsequent interactive content presentation time. The media object is pre-rendered within a time offset period before the subsequent interactive content presentation time occurs.

    摘要翻译: 播放交互式多媒体呈现涉及基于交互式内容的帧速率,视频内容(可包括视频,音频,数据或其任何组合)的帧速率在某些时间预先呈现媒体对象,并且 播放速度的演示文稿。 采取的某些措施包括计算表示已经通过的演示文稿播放持续时间的数量的当前播放时间。 基于所计算的时间,从交互式内容时间线确定当前交互式内容呈现时间。 交互式内容时间轴表示媒体对象可呈现的时间。 从交互式内容时间轴中选择随后的交互式内容呈现时间。 预测媒体对象的呈现状态用于随后的交互式内容呈现时间。 媒体对象在随后的交互式内容呈现时间发生之前的时间偏移时段内被预渲染。

    Arrangement for anonymous API downloaded resources for advanced content
    9.
    发明授权
    Arrangement for anonymous API downloaded resources for advanced content 有权
    安排匿名API下载资源的高级内容

    公开(公告)号:US08086562B2

    公开(公告)日:2011-12-27

    申请号:US12165616

    申请日:2008-06-30

    IPC分类号: G06F17/00

    CPC分类号: G06F17/30 Y10S707/913

    摘要: Provided are arrangements for downloading resources and managing downloaded resources. A file is requested from a HTTP server, the file associated with an original URI. The file is downloaded and assigned a handle. The file is then stored in a storage location such as a file cache or in a persistent storage location. Upon command of an advanced content playlist or sequence, the file is called by calling the handle of the file. The storing of the file may include storing the file in a location where the file is subject to an automatic removal operation. The file may be an image file or any other type of file, especially multimedia files. The automatic removal operation may occur upon a quitting or restarting of the application. If another request is made for another file, the prior downloaded file may be replaced.

    摘要翻译: 提供下载资源和管理下载的资源的安排。 从HTTP服务器请求一个与原始URI关联的文件。 该文件被下载并分配一个句柄。 然后将该文件存储在诸如文件高速缓存或永久存储位置的存储位置中。 在指定高级内容播放列表或序列时,通过调用文件的句柄来调用该文件。 文件的存储可以包括将文件存储在文件进行自动删除操作的位置。 该文件可以是图像文件或任何其他类型的文件,特别是多媒体文件。 自动移除操作可能会在退出或重新启动应用程序时发生。 如果另一个请求是针对另一个文件,则可能会替换以前下载的文件。

    Timing aspects of media content rendering
    10.
    发明授权
    Timing aspects of media content rendering 有权
    媒体内容呈现的时间方面

    公开(公告)号:US07861150B2

    公开(公告)日:2010-12-28

    申请号:US11594352

    申请日:2006-11-07

    IPC分类号: G06F17/00

    摘要: Timing for execution of certain user inputs and application instructions occurring during play of an interactive multimedia presentation is discussed. A current state is defined by a state of the presentation system at the time a current media sample is being played to a user. A predicted state is defined by a state of the presentation system one or more future play times. Examples of current and predicted states include media retrieval states and media presentation states. An instruction or user input that is based on the current state is identified, and the predicted state is used to determine an effect of the instruction or input. The effect may then be executed at a predetermined time, such as after the next playable media sample is played to the user.

    摘要翻译: 讨论了在播放交互式多媒体呈现期间执行某些用户输入和应用指令的时序。 当前状态由在向用户播放当前媒体样本时的呈现系统的状态定义。 预测状态由呈现系统的状态定义一个或多个未来播放时间。 当前和预测状态的示例包括媒体检索状态和媒体呈现状态。 识别基于当前状态的指令或用户输入,并且使用预测状态来确定指令或输入的影响。 然后可以在预定时间(例如在向用户播放下一可播放媒体样本之后)执行该效果。