公开(公告)号：US07777749B2

公开(公告)日：2010-08-17

申请号：US11560630

申请日：2006-11-16

申请人： Chris Yoochang Chung ,  Donglok Kim ,  Yongmin Kim

发明人： Chris Yoochang Chung ,  Donglok Kim ,  Yongmin Kim

IPC分类号： G06T1/20 ,  G06T1/00 ,  G06T11/40 ,  G06F15/167 ,  G09G5/00

CPC分类号： G09G5/363 ,  G06T1/20 ,  G06T15/005

摘要： A programmable graphics pipeline and method for processing multiple partitioned multimedia data, such as graphics data, image data, video data, or audio data. A preferred embodiment of the programmable graphics pipeline includes an instruction cache, a register file, and a vector functional unit that perform partitioned instructions. In addition, an enhanced rasterization unit is used to generate inverse-mapped source coordinates in addition to destination output coordinates for graphics and other media processing. An enhanced texture address unit generates corresponding memory addresses of source texture data for graphics processing and source media data for media processing. Data retrieved from memory are stored in an enhanced texture cache for use by the vector functional unit. A vector output unit includes a blending unit for graphics data and an output buffer for wide media data.

摘要翻译： 一种用于处理多个分割的多媒体数据（诸如图形数据，图像数据，视频数据或音频数据）的可编程图形流水线和方法。 可编程图形流水线的优选实施例包括执行分区指令的指令高速缓存，寄存器文件和向量功能单元。 此外，增强的光栅化单元除了用于图形和其他媒体处理的目的地输出坐标之外还用于生成反映射源坐标。 增强的纹理地址单元产生用于图形处理的源纹理数据的相应存储器地址和用于媒体处理的源媒体数据。 从存储器检索的数据存储在增强的纹理高速缓存中以供向量功能单元使用。 向量输出单元包括用于图形数据的混合单元和用于宽媒体数据的输出缓冲器。

公开(公告)号：US06842177B2

公开(公告)日：2005-01-11

申请号：US10020684

申请日：2001-12-14

申请人： Rohit Garg ,  Chris Yoochang Chung ,  Coskun Mermer ,  Donglok Kim ,  Yongmin Kim

发明人： Rohit Garg ,  Chris Yoochang Chung ,  Coskun Mermer ,  Donglok Kim ,  Yongmin Kim

IPC分类号： G06T9/00 ,  G06T11/20

CPC分类号： H04N21/4143 ,  G06T9/007

摘要： A boundary macroblock of a video object is padded without significant synchronization overhead between a host processor and an existing coprocessor. The host processor determines horizontal and vertical graphics primitives as a function of shape data stored in a host memory. The shape data determine whether a dot, a line, or a rectangle primitive should be used to pad transparent pixels in the macroblock. The host processor communicates the primitives to a coprocessor, which renders the primitives in an interleaved pipeline fashion to pad transparent pixels of the macroblock based on texture data stored in video memory. The flow of primitives is in one direction from the host processor to the graphics coprocessor, and the texture data is not transferred back and forth between the host processor and coprocessor. This technique is especially useful for enabling acceleration of MPEG-4 video decoding utilizing existing coprocessors capable of accelerating MPEG-1/2 video decoding.

摘要翻译： 视频对象的边界宏块在主机处理器和现有的协处理器之间被填充而没有显着的同步开销。 主处理器根据存储在主机存储器中的形状数据确定水平和垂直图形基元。 形状数据确定是否应使用点，线或矩形基元来填充宏块中的透明像素。 主机处理器将原语传送到协处理器，协处理器以基于交织的流水线方式呈现原语，以便基于存储在视频存储器中的纹理数据来缓冲宏块的透明像素。 原语的流程在主处理器到图形协处理器的一个方向上，并且纹理数据不会在主处理器和协处理器之间来回传送。 该技术对于使用能够加速MPEG-1/2视频解码的现有协处理器的MPEG-4视频解码的加速特别有用。

公开(公告)号：US06681043B1

公开(公告)日：2004-01-20

申请号：US09375825

申请日：1999-08-16

申请人： Christopher Lau ,  Donglok Kim ,  Yongmin Kim

发明人： Christopher Lau ,  Donglok Kim ,  Yongmin Kim

IPC分类号： G06K934

CPC分类号： H04N19/20 ,  G06F3/0481 ,  G06F17/30805 ,  G06F17/30823 ,  G06F2203/04806 ,  G11B27/034 ,  G11B27/34

摘要： A video processing environment includes a user interface and processing shell from which various video processing ‘plug-in’ programs are accessed. The shell insulates the plug-ins from the intricacies of reading various file formats. The user interface allows an operator to load a video sequence, define and view one or more video objects on any one or more frames of the video sequence, edit existing video object segmentations, view video objects across a series of video frames, and encode video objects among a video sequence in a desired format. Various encoding parameters can be adjusted allowing the operator to view the video sequence encoded at the various parameter settings. The user interface includes a video window, a time-line window, a zoom window, a set of menus including a menu of plug-in programs, and a set of dialogue boxes, including encoding parameter dialogue boxes.

摘要翻译： 视频处理环境包括用户界面和处理外壳，从中可以访问各种视频处理“插件”程序。 shell将插件从读取各种文件格式的复杂性中隔离开来。 用户界面允许操作者加载视频序列，定义和查看视频序列的任何一个或多个帧上的一个或多个视频对象，编辑现有的视频对象分割，在一系列视频帧中查看视频对象，以及编码视频 视频序列中的所需格式的对象。 可以调整各种编码参数，允许操作者观看以各种参数设置编码的视频序列。 用户界面包括视频窗口，时间线窗口，缩放窗口，包括插件程序的菜单的一组菜单，以及包括编码参数对话框的一组对话框。

公开(公告)号：US06633309B2

公开(公告)日：2003-10-14

申请号：US09375822

申请日：1999-08-16

申请人： Christopher Lau ,  Donglok Kim ,  Yongmin Kim

发明人： Christopher Lau ,  Donglok Kim ,  Yongmin Kim

IPC分类号： G09G500

CPC分类号： G11B27/34 ,  G06F3/0481 ,  G06F9/451 ,  G06F2203/04806 ,  G11B27/034 ,  H04N19/20

摘要： A video processing environment includes a user interface and processing shell from which various video processing ‘plug-in’ programs are accessed. The shell insulates the plug-ins from the intricacies of reading various file formats. The user interface allows an operator to load a video sequence, define and view one or more video objects on any one or more frames of the video sequence, edit existing video object segmentations, view video objects across a series of video frames, and encode video objects among a video sequence in a desired format. Various encoding parameters can be adjusted allowing the operator to view the video sequence encoded at the various parameter settings. The user interface includes a video window, a time-line window, a zoom window, a set of menus including a menu of plug-in programs, and a set of dialogue boxes, including encoding parameter dialogue boxes.

摘要翻译： 视频处理环境包括用户界面和处理外壳，从中可以访问各种视频处理“插件”程序。 shell将插件从读取各种文件格式的复杂性中隔离开来。 用户界面允许操作者加载视频序列，定义和查看视频序列的任何一个或多个帧上的一个或多个视频对象，编辑现有的视频对象分割，在一系列视频帧中查看视频对象，以及编码视频 视频序列中的所需格式的对象。 可以调整各种编码参数，允许操作者观看以各种参数设置编码的视频序列。 用户界面包括视频窗口，时间线窗口，缩放窗口，包括插件程序菜单的一组菜单，以及一组对话框，包括编码参数对话框。

公开(公告)号：US07209141B2

公开(公告)日：2007-04-24

申请号：US10919627

申请日：2004-08-17

申请人： Rohit Garg ,  Chris Yoochang Chung ,  Coskun Mermer ,  Donglok Kim ,  Yongmin Kim

发明人： Rohit Garg ,  Chris Yoochang Chung ,  Coskun Mermer ,  Donglok Kim ,  Yongmin Kim

IPC分类号： G06T11/00

CPC分类号： H04N21/4143 ,  G06T9/007

摘要： A boundary macroblock of a video object is padded without significant synchronization overhead between a host processor and an existing coprocessor. The host processor determines horizontal and vertical graphics primitives as a function of shape data stored in a host memory. The shape data determine whether a dot, a line, or a rectangle primitive should be used to pad transparent pixels in the macroblock. The host processor communicates the primitives to a coprocessor, which renders the primitives in an interleaved pipeline fashion to pad transparent pixels of the macroblock based on texture data stored in video memory. The flow of primitives is in one direction from the host processor to the graphics coprocessor, and the texture data is not transferred back and forth between the host processor and coprocessor. This technique is especially useful for enabling acceleration of MPEG-4 video decoding utilizing existing coprocessors capable of accelerating MPEG-1/2 video decoding.

摘要翻译： 视频对象的边界宏块在主机处理器和现有的协处理器之间被填充而没有显着的同步开销。 主处理器根据存储在主机存储器中的形状数据确定水平和垂直图形基元。 形状数据确定是否应使用点，线或矩形基元来填充宏块中的透明像素。 主机处理器将原语传送到协处理器，协处理器以基于交织的流水线方式呈现原语，以便基于存储在视频存储器中的纹理数据来缓冲宏块的透明像素。 原语的流程在主处理器到图形协处理器的一个方向上，并且纹理数据不会在主处理器和协处理器之间来回传送。 该技术对于使用能够加速MPEG-1/2视频解码的现有协处理器的MPEG-4视频解码的加速特别有用。

公开(公告)号：US07158141B2

公开(公告)日：2007-01-02

申请号：US10053431

申请日：2002-01-17

申请人： Chris Yoochang Chung ,  Donglok Kim ,  Yongmin Kim

发明人： Chris Yoochang Chung ,  Donglok Kim ,  Yongmin Kim

IPC分类号： G06T1/20 ,  G06T11/40 ,  G06F12/167 ,  G06F12/02

CPC分类号： G09G5/363 ,  G06T1/20 ,  G06T15/005

摘要： A programmable graphics pipeline and method for processing multiple partitioned multimedia data, such as graphics data, image data, video data, or audio data. A preferred embodiment of the programmable graphics pipeline includes an instruction cache, a register file, and a vector functional unit that perform partitioned instructions. In addition, an enhanced rasterization unit is used to generate inverse-mapped source coordinates in addition to destination output coordinates for graphics and other media processing. An enhanced texture address unit generates corresponding memory addresses of source texture data for graphics processing and source media data for media processing. Data retrieved from memory are stored in an enhanced texture cache for use by the vector functional unit. A vector output unit includes a blending unit for graphics data and an output buffer for wide media data.

摘要翻译： 一种用于处理多个分割的多媒体数据（诸如图形数据，图像数据，视频数据或音频数据）的可编程图形流水线和方法。 可编程图形流水线的优选实施例包括执行分区指令的指令高速缓存，寄存器文件和向量功能单元。 此外，增强的光栅化单元除了用于图形和其他媒体处理的目的地输出坐标之外还用于生成反映射源坐标。 增强的纹理地址单元产生用于图形处理的源纹理数据的相应存储器地址和用于媒体处理的源媒体数据。 从存储器检索的数据存储在增强的纹理高速缓存中以供向量功能单元使用。 向量输出单元包括用于图形数据的混合单元和用于宽媒体数据的输出缓冲器。

公开(公告)号：US20070070079A1

公开(公告)日：2007-03-29

申请号：US11560630

申请日：2006-11-16

申请人： Chris Chung ,  Donglok Kim ,  Yongmin Kim

发明人： Chris Chung ,  Donglok Kim ,  Yongmin Kim

IPC分类号： G09G5/00

CPC分类号： G09G5/363 ,  G06T1/20 ,  G06T15/005

摘要： A programmable graphics pipeline and method for processing multiple partitioned multimedia data, such as graphics data, image data, video data, or audio data. A preferred embodiment of the programmable graphics pipeline includes an instruction cache, a register file, and a vector functional unit that perform partitioned instructions. In addition, an enhanced rasterization unit is used to generate inverse-mapped source coordinates in addition to destination output coordinates for graphics and other media processing. An enhanced texture address unit generates corresponding memory addresses of source texture data for graphics processing and source media data for media processing. Data retrieved from memory are stored in an enhanced texture cache for use by the vector functional unit. A vector output unit includes a blending unit for graphics data and an output buffer for wide media data.

摘要翻译： 一种用于处理多个分割的多媒体数据（诸如图形数据，图像数据，视频数据或音频数据）的可编程图形流水线和方法。 可编程图形流水线的优选实施例包括执行分区指令的指令高速缓存，寄存器文件和向量功能单元。 此外，增强的光栅化单元除了用于图形和其他媒体处理的目的地输出坐标之外还用于生成反映射源坐标。 增强的纹理地址单元产生用于图形处理的源纹理数据的相应存储器地址和用于媒体处理的源媒体数据。 从存储器检索的数据存储在增强的纹理高速缓存中以供向量功能单元使用。 向量输出单元包括用于图形数据的混合单元和用于宽媒体数据的输出缓冲器。

公开(公告)号：US06888892B2

公开(公告)日：2005-05-03

申请号：US10015329

申请日：2001-12-10

申请人： Chris Yoochang Chung ,  Kerem Karadayi ,  Rohit Garg ,  Donglok Kim ,  Yongmin Kim

发明人： Chris Yoochang Chung ,  Kerem Karadayi ,  Rohit Garg ,  Donglok Kim ,  Yongmin Kim

IPC分类号： G06T11/00 ,  H04N7/26 ,  H04N7/12

CPC分类号： G06T9/20 ,  G06T9/00 ,  G06T11/001 ,  H04N19/20

摘要： A method for efficiently padding a macroblock of a video object plane employs two new instructions. The instructions, PadToRight and PadToLeft, are applied in alternating sequence during a PadPass 1 operation and a PadPass 2 operation. The results of these two operations are then averaged to pad each transparent pixel in each row of a macroblock that includes at least one opaque pixel. A Shift_in register is used to temporarily store data to facilitate the operation implemented by these instructions. Once the transparent pixels in each row have been padded horizontally, pixels in rows having shape data equal to zero (indicating all pixels in the row are transparent) are padded in a pre-processing step, followed by an upward propagation step. The two instructions are preferably implemented using 2:1 multiplexers implemented with an arithmetic logic unit. The method is particularly useful in set-top boxes, games, and other video applications.

摘要翻译： 一种用于有效地填充视频对象平面的宏块的方法采用两个新的指令。 在PadPass 1操作和PadPass 2操作期间，指令PadToRight和PadToLeft以交替顺序应用。 然后对这两个操作的结果进行平均以填补包括至少一个不透明像素的宏块的每一行中的每个透明像素。 一个Shift_in寄存器用于临时存储数据，以便于这些指令执行的操作。 一旦每行中的透明像素已经被水平填充，则具有等于零的形状数据的行中的像素（指示行中的所有像素是透明的）在预处理步骤中被填充，随后是向上传播步骤。 两个指令优选地使用由算术逻辑单元实现的2:1复用器来实现。 该方法在机顶盒，游戏和其他视频应用中特别有用。

公开(公告)号：US20050035968A1

公开(公告)日：2005-02-17

申请号：US10919627

申请日：2004-08-17

申请人： Rohit Garg ,  Chris Chung ,  Coskun Mermer ,  Donglok Kim ,  Yongmin Kim

发明人： Rohit Garg ,  Chris Chung ,  Coskun Mermer ,  Donglok Kim ,  Yongmin Kim

IPC分类号： G06T9/00 ,  G06F15/00 ,  G06T1/00

CPC分类号： H04N21/4143 ,  G06T9/007

摘要： A boundary macroblock of a video object is padded without significant synchronization overhead between a host processor and an existing coprocessor. The host processor determines horizontal and vertical graphics primitives as a function of shape data stored in a host memory. The shape data determine whether a dot, a line, or a rectangle primitive should be used to pad transparent pixels in the macroblock. The host processor communicates the primitives to a coprocessor, which renders the primitives in an interleaved pipeline fashion to pad transparent pixels of the macroblock based on texture data stored in video memory. The flow of primitives is in one direction from the host processor to the graphics coprocessor, and the texture data is not transferred back and forth between the host processor and coprocessor. This technique is especially useful for enabling acceleration of MPEG-4 video decoding utilizing existing coprocessors capable of accelerating MPEG-1/2 video decoding.

公开(公告)号：US06525746B1

公开(公告)日：2003-02-25

申请号：US09375823

申请日：1999-08-16

申请人： Christopher Lau ,  Donglok Kim ,  Yongmin Kim

发明人： Christopher Lau ,  Donglok Kim ,  Yongmin Kim

IPC分类号： G09G500

CPC分类号： G06F3/0481 ,  G06F9/451 ,  G06F2203/04806 ,  G11B27/034 ,  G11B27/34 ,  H04N19/20

摘要： A video processing environment includes a user interface and processing shell from which various video processing ‘plug-in’ programs are accessed. The shell insulates the plug-ins from the intricacies of reading various file formats. The user interface allows an operator to load a video sequence, define and view one or more video objects on any one or more frames of the video sequence, edit existing video object segmentations, view video objects across a series of video frames, and encode video objects among a video sequence in a desired format. Various encoding parameters can be adjusted allowing the operator to view the video sequence encoded at the various parameter settings. The user interface includes a video window, a time-line window, a zoom window, a set of menus including a menu of plug-in programs, and a set of dialogue boxes, including encoding parameter dialogue boxes.

摘要翻译： 视频处理环境包括用户界面和处理外壳，从中可以访问各种视频处理“插件”程序，外壳将插件从读取各种文件格式的复杂性中分离出来，用户界面允许操作员加载 视频序列，定义和查看视频序列的任何一个或多个帧上的一个或多个视频对象，编辑现有视频对象分割，跨越一系列视频帧查看视频对象，以及以期望格式在视频序列之间编码视频对象 可以调整各种编码参数，允许操作者观看以各种参数设置编码的视频序列，用户界面包括视频窗口，时间线窗口，缩放窗口，一组菜单，包括插件 - 在程序中，还有一组对话框，包括编码参数对话框。