公开(公告)号：US20110149019A1

公开(公告)日：2011-06-23

申请号：US12689356

申请日：2010-01-19

申请人： Marcus Kellerman ,  Xuemin Chen ,  Samir Hulyalkar ,  Ilya Klebanov

发明人： Marcus Kellerman ,  Xuemin Chen ,  Samir Hulyalkar ,  Ilya Klebanov

IPC分类号： H04N13/00

CPC分类号： G06T3/4007 ,  G06T2207/10021

摘要： A video processing device may generate a two dimensional (2D) output video stream from a three dimensional (3D) input video stream that comprises a plurality of view sequences. The plurality of view sequences may comprise sequences of stereoscopic left and right reference fields or frames. A view sequence may initially be selected as a base sequence for the 2D output video stream, and the 2D output video stream may be enhanced using video content and/or information from unselected view sequences. The video content and/or information utilized in enhancing the 2D output video stream may comprise depth information, and/or foreground and/or background information. The enhancement of the 2D input video stream may comprise improving depth, contrast, sharpness, and/or rate upconversion using frame and/or field based interpolation of images in the 2D output video stream.

摘要翻译： 视频处理设备可以从包括多个视图序列的三维（3D）输入视频流生成二维（2D）输出视频流。 多个视图序列可以包括立体左右参考场或帧的序列。 可以最初选择视图序列作为2D输出视频流的基本序列，并且可以使用来自未选择的视图序列的视频内容和/或信息来增强2D输出视频流。 用于增强2D输出视频流的视频内容和/或信息可以包括深度信息和/或前景和/或背景信息。 2D输入视频流的增强可以包括使用2D输出视频流中的图像的基于帧和/或场的内插来提高深度，对比度，清晰度和/或上变频率。

公开(公告)号：US20110081133A1

公开(公告)日：2011-04-07

申请号：US12573771

申请日：2009-10-05

申请人： Xuemin Chen ,  Samir Hulyalkar ,  Marcus Kellerman ,  Ilya Klebanov

发明人： Xuemin Chen ,  Samir Hulyalkar ,  Marcus Kellerman ,  Ilya Klebanov

IPC分类号： H04N7/26 ,  H04N13/00 ,  H04N7/12 ,  H04N5/783 ,  H04N5/917 ,  H04N11/02

CPC分类号： H04N9/8227 ,  G11B27/005 ,  H04N5/765 ,  H04N9/8042 ,  H04N9/8205 ,  H04N19/187 ,  H04N19/44 ,  H04N19/597

摘要： Receiver receives a compressed 3D video comprising a base view video and an enhancement view video. The video receiver determines a random access that occurs at a two-view misaligned base view RAP to start decoding activities on the received compressed 3D video based on a corresponding two-view aligned random access point (RAP). The corresponding two-view aligned RAP is adjacent to the two-view misaligned base view RAP. Pictures in the received compressed 3D video are buffered for the two-view misaligned base view RAP to be decoded staring from the corresponding two-view aligned RAP. One or more pictures in the enhancement view video are interpolated based on the two-view misaligned base view RAP. The video receiver selects a portion of the buffered pictures to be decoded to facilitate a trick mode in personal video recording (PVR) operations for random access at the two-view misaligned RAP.

摘要翻译： 接收器接收包括基本视图视频和增强视图视频的压缩3D视频。 视频接收器确定在双视角未对准基视图RAP处发生的随机接入，以基于对应的两视图对准随机接入点（RAP）开始对所接收的压缩3D视频的解码活动。 相应的双视图对齐的RAP与两视角未对准的基本视图RAP相邻。 接收到的压缩3D视频中的图像被缓冲，用于从对应的双视图对准的RAP进行解码的两视角未对准基视图RAP。 基于双视图未对准基本视图RAP，内插增强视图视频中的一个或多个图像。 视频接收器选择要解码的缓冲图像的一部分，以促进用于在两视角不对准RAP的随机访问的个人视频记录（PVR）操作中的特技模式。

公开(公告)号：US20110080948A1

公开(公告)日：2011-04-07

申请号：US12573746

申请日：2009-10-05

申请人： Xuemin Chen ,  Samir Hulyalkar ,  Marcus Kellerman ,  Ilya Klebanov

发明人： Xuemin Chen ,  Samir Hulyalkar ,  Marcus Kellerman ,  Ilya Klebanov

IPC分类号： H04N7/32

CPC分类号： H04N19/436 ,  H04N19/105 ,  H04N19/187 ,  H04N19/30 ,  H04N19/44 ,  H04N19/597 ,  H04N19/61

摘要： A video receiver receives a layered and predicted compressed 3D video comprising a base view video and an enhancement view video. A portion of pictures in the received compressed 3D video are selected to be decoded for display at an intended pace. Pictures in the received compressed 3D video are generated based on a tier system framework with tiers ordered hierarchically according to corresponding decodability. Each picture in the base view and enhancement view videos belongs to one of the plurality of tiers. A picture in a particular tier does not depend directly or indirectly on pictures in a higher tier. Each tier comprises one or more pictures with the same coding order. The video receiver decodes the pictures with the same coding order in parallel, and adaptively decodes the selected pictures according to corresponding coding layer information. The selected pictures are determined based on a particular display rate.

摘要翻译： 视频接收器接收包括基本视图视频和增强视图视频的分层和预测的压缩3D视频。 选择接收到的压缩3D视频中的图像的一部分被解码以按预期的速度显示。 接收到的压缩3D视频中的图像是基于层次系统框架生成的，层级按照相应的可解码性顺序排列。 基本视图和增强视图视频中的每个图片属于多个层之一。 特定层次的图片不直接或间接地依赖于较高层次的图片。 每层包括一个或多个具有相同编码顺序的图片。 视频接收机以相同的编码顺序对图像进行并行解码，并根据相应的编码层信息自适应地对所选择的图像进行解码。 所选择的图像基于特定的显示速率来确定。

公开(公告)号：US20110063298A1

公开(公告)日：2011-03-17

申请号：US12604980

申请日：2009-10-23

申请人： Samir Hulyalkar ,  Xuemin Chen ,  Marcus Kellerman ,  Ilya Klebanov

发明人： Samir Hulyalkar ,  Xuemin Chen ,  Marcus Kellerman ,  Ilya Klebanov

IPC分类号： G06T15/20

CPC分类号： H04N13/139 ,  H04N13/161 ,  H04N13/183 ,  H04N13/194 ,  H04N13/332 ,  H04N13/337 ,  H04N13/341

摘要： A first 3D graphics and/or 3D video processing device generates left and right view 3D graphics frames comprising 3D content which are communicated to a 3D display device for display. The 3D frames are generated based on a display format utilized by the 3D display device. The first 3D device may comprise a set-top-box and/or computer. The left and/or right 3D graphics frames may be generated based on time sequential display and/or polarizing display. Sub-sampling 3D graphics frames may be based on odd and even row display polarization patterns and/or checkerboard polarization patterns. Left and right 3D graphics pixels may be blended with video pixels. Left and/or right 3D graphics frames may be displayed sequentially in time. Left and/or right 3D graphics frames may be sub-sampled in complimentary pixel patterns, interleaved in a single frame and displayed utilizing varying polarization orientations for left and right pixels.

摘要翻译： 第一3D图形和/或3D视频处理装置产生包括3D内容的左视图和右视图3D图形帧，所述三维内容被传送到3D显示装置以进行显示。 基于由3D显示装置使用的显示格式生成3D帧。 第一3D设备可以包括机顶盒和/或计算机。 可以基于时间顺序显示和/或偏振显示来生成左和/或右3D图形帧。 次采样3D图形帧可以基于奇偶行显示偏振图案和/或棋盘偏振图案。 左右3D图形像素可能与视频像素混合。 可以在时间上顺序地显示左和/或右三维图形帧。 左和/或右三维图形帧可以以互补像素图案进行子采样，在单个帧中进行交织，并利用左右像素的变化偏振方向显示。

公开(公告)号：US09414080B2

公开(公告)日：2016-08-09

申请号：US12545679

申请日：2009-08-21

申请人： Xuemin Chen ,  Samir Hulyalkar ,  Marcus Kellerman ,  Ilya Klebanov

发明人： Xuemin Chen ,  Samir Hulyalkar ,  Marcus Kellerman ,  Ilya Klebanov

IPC分类号： H04N7/12 ,  H04N19/187 ,  H04N19/597 ,  H04N19/159 ,  H04N19/172 ,  H04N19/30 ,  H04N19/115 ,  H04N19/61

CPC分类号： H04N19/187 ,  H04N19/115 ,  H04N19/159 ,  H04N19/172 ,  H04N19/30 ,  H04N19/597 ,  H04N19/61

摘要： A video transmitter compresses an uncompressed 3D video into a base view video and an enhancement view video using MPEG-4 MVC standard. The video transmitter allocates bits to compressed pictures of the uncompressed 3D video based on corresponding picture type. More bits are allocated to I-pictures than P-pictures, and more bits are allocated to P-pictures than B-pictures in a given coding view. More bits are allocated to a compressed picture of the base view video than a same type compressed picture of the enhancement view video. The correlation level between the base view video and the enhancement view video is utilized for bit-allocation in video compression. More bits are allocated to a picture in a lower coding layer than to the same type picture in a higher coding layer in a given coding view. Pictures with the same cording order are identified from different view videos for a joint bit-allocation.

摘要翻译： 视频发射机使用MPEG-4 MVC标准将未压缩的3D视频压缩为基本视图视频和增强视图视频。 视频发送器基于相应的图像类型将比特分配给未压缩3D视频的压缩图像。 在给定的编码视图中，比P图像分配更多的比特到比P图像更多的比特分配给P图像而不是B图像。 比增强视图视频的相同类型的压缩图像更多的比特被分配给基本视图视频的压缩图像。 基视图视频和增强视图视频之间的相关电平用于视频压缩中的位分配。 在给定的编码视图中，较低编码层中的比较分配给较高编码层中的相同类型图像的更多比特分配给图像。 从不同的视图视频识别具有相同线序的照片，用于联合位分配。

公开(公告)号：US08803906B2

公开(公告)日：2014-08-12

申请号：US12546644

申请日：2009-08-24

申请人： Xuemin Chen ,  Samir Hulyalkar ,  Marcus Kellerman ,  Ilya Klebanov

发明人： Xuemin Chen ,  Samir Hulyalkar ,  Marcus Kellerman ,  Ilya Klebanov

IPC分类号： G09G5/00

CPC分类号： H04N21/812 ,  G06Q30/02 ,  H04N5/91 ,  H04N9/8205 ,  H04N9/8227 ,  H04N13/161 ,  H04N21/4341 ,  H04N21/44016 ,  H04N21/845

摘要： A video receiver receives a compound transport stream (TS) comprising 3D program video streams and spliced advertising streams. The received one or more 3D program video streams are extracted and decoded. Targeted advertising streams are extracted from the received advertising streams according to user criteria. Targeted advertising graphic objects of the extracted or replaced targeted advertising streams are spliced into the decoded 3D program video streams. The decoded 3D program video with the spliced targeted advertising graphic objects is presented in a 2D video. The extracted or replaced targeted advertising streams are processed to generate the targeted advertising graphic objects to be spliced based on focal point of view. The generated targeted advertising graphic objects are located according to associated scene graph information. The decoded 3D program video streams and the spliced targeted advertising graphic objects are converted into a 2D video for display.

摘要翻译： 视频接收器接收包括3D节目视频流和拼接广告流的复合传输流（TS）。 提取并解码所接收的一个或多个3D节目视频流。 根据用户标准从接收到的广告流中提取目标广告流。 提取或替换的目标广告流的目标广告图形对象被拼接成解码的3D节目视频流。 具有拼接的目标广告图形对象的解码的3D节目视频被呈现在2D视频中。 处理提取或替换的目标广告流以基于焦点来生成要拼接的目标广告图形对象。 生成的目标广告图形对象根据相关联的场景图信息来定位。 解码的3D程序视频流和拼接的目标广告图形对象被转换成2D视频以供显示。

公开(公告)号：US08300881B2

公开(公告)日：2012-10-30

申请号：US12560578

申请日：2009-09-16

申请人： Xuemin Chen ,  Samir Hulyalkar ,  Marcus Kellerman ,  Ilya Klebanov

发明人： Xuemin Chen ,  Samir Hulyalkar ,  Marcus Kellerman ,  Ilya Klebanov

IPC分类号： G06K9/00

CPC分类号： H04N21/2351 ,  G06T1/0085 ,  G06T2201/0053 ,  H04N19/467 ,  H04N19/597

摘要： A video transmitter identifies regions in pictures in a compressed three-dimensional (3D) video comprising a base view video and an enhancement view video. The identified regions are not referenced by other pictures in the compressed 3D video. The identified regions are watermarked. Pictures such as a high layer picture in the base view video and the enhancement view video are identified for watermarking. The identified regions in the base view and/or enhancement view videos are watermarked and multiplexed into a transport stream for transmission. An intended video receiver extracts the base view video, the enhancement view video and corresponding watermark data from the received transport stream. The corresponding extracted watermark data are synchronized with the extracted base view video and the extracted enhancement view video, respectively, for watermark insertion. The resulting base view and enhancement view videos are decoded into a left view video and a right view video, respectively.

摘要翻译： 视频发射器识别包括基本视图视频和增强视图视频的压缩三维（3D）视频中的图像中的区域。 识别的区域不被压缩3D视频中的其他图像引用。 所识别的区域被加水印。 识别基本视图视频和增强视图视频中的高层图像等图像以进行水印处理。 基本视图和/或增强视图视频中的识别的区域被加水印和多路复用到传输流中以进行传输。 预期的视频接收器从接收的传输流中提取基本视图视频，增强视图视频和对应的水印数据。 相应的提取的水印数据分别与提取的基本视图视频和提取的增强视图视频同步，用于水印插入。 所得到的基本视图和增强视图视频分别解码为左视图视频和右视图视频。

公开(公告)号：US20110115883A1

公开(公告)日：2011-05-19

申请号：US12619461

申请日：2009-11-16

申请人： Marcus Kellerman ,  Xuemin Chen ,  Samir Hulyalkar ,  Ilya Klebanov

发明人： Marcus Kellerman ,  Xuemin Chen ,  Samir Hulyalkar ,  Ilya Klebanov

IPC分类号： H04N13/02 ,  H04N5/225

CPC分类号： H04N13/383 ,  G06F3/012 ,  G06F3/013 ,  G06F3/04815 ,  G06F3/0485 ,  G06F2203/04806

摘要： A 2D and/or 3D video processing device comprising a camera and a display captures images of a viewer as the viewer observes displayed 2D and/or 3D video content in a viewport. Face and/or eye tracking of viewer images is utilized to generate a different viewport. Current and different viewports may comprise 2D and/or 3D video content from a single source or from different sources. The sources of 2D and/or 3D content may be scrolled, zoomed and/or navigated through for generating the different viewport. Content for the different viewport may be processed. Images of a viewer's positions, angles and/or movements of face, facial expression, eyes and/or physical gestures are captured by the camera and interpreted by face and/or eye tracking. The different viewport may be generated for navigating through 3D content and/or for rotating a 3D object. The 2D and/or 3D video processing device communicates via wire, wireless and/or optical interfaces.

摘要翻译： 包括相机和显示器的2D和/或3D视频处理设备在观察者观察视口中显示的2D和/或3D视频内容时捕获观看者的图像。 利用观看者图像的面部和/或眼睛跟踪来生成不同的视口。 当前和不同的视口可以包括来自单个源或来自不同来源的2D和/或3D视频内容。 2D和/或3D内容的来源可以被滚动，缩放和/或导航以用于生成不同的视口。 可以处理不同视口的内容。 观看者的位置，角度和/或脸部运动，脸部表情，眼睛和/或身体手势的图像由相机拍摄并通过脸部和/或眼睛跟踪进行解释。 可以生成用于通过3D内容和/或旋转3D对象的不同视口。 2D和/或3D视频处理设备通过有线，无线和/或光接口进行通信。

公开(公告)号：US20110058016A1

公开(公告)日：2011-03-10

申请号：US12554416

申请日：2009-09-04

申请人： Samir Hulyalkar ,  Xuemin Chen ,  Marcus Kellerman ,  Ilya Klebanov

发明人： Samir Hulyalkar ,  Xuemin Chen ,  Marcus Kellerman ,  Ilya Klebanov

IPC分类号： H04N13/00

CPC分类号： H04N19/597 ,  H04N13/139

摘要： A video processor decompresses stereoscopic left and right reference frames of compressed 3D video. New left and right frames are interpolated. The frames may be stored and/or communicated for display. The left and right frames are combined into a single frame of a single stream or may be sequenced in separate left and right streams. The left and right frames are interpolated based on the combined single stream and/or based on the separate left and right streams. Motion vectors are determined for one of the separate left or right streams. The frames are interpolated utilizing motion compensation. Areas of occlusion are determined in the separate left and right streams. Pixels are interpolated for occluded areas of left or right frames of separate streams from uncovered areas in corresponding opposite side frames. The left and right interpolated and/or reference frames are displayed as 3D and/or 2D video.

摘要翻译： 视频处理器解压缩压缩3D视频的立体左右参考帧。 新的左和右帧被内插。 可以存储和/或传送帧以进行显示。 左和右帧被组合成单个流的单个帧，或者可以在单独的左和右流中排序。 基于组合的单个流和/或基于单独的左流和右流来内插左和右帧。 为单独的左流或右流之一确定运动矢量。 使用运动补偿内插帧。 在单独的左和右流中确定遮挡区域。 对于相应的相对侧框架中的未覆盖区域，将单独流的左帧或右帧的遮挡区域插入像素。 左和右插入和/或参考帧被显示为3D和/或2D视频。

公开(公告)号：US20110043524A1

公开(公告)日：2011-02-24

申请号：US12546644

申请日：2009-08-24

申请人： Xuemin Chen ,  Samir Hulyalkar ,  Marcus Kellerman ,  Ilya Klebanov

发明人： Xuemin Chen ,  Samir Hulyalkar ,  Marcus Kellerman ,  Ilya Klebanov

IPC分类号： G06T15/10

CPC分类号： H04N21/812 ,  G06Q30/02 ,  H04N5/91 ,  H04N9/8205 ,  H04N9/8227 ,  H04N13/161 ,  H04N21/4341 ,  H04N21/44016 ,  H04N21/845

摘要： A video receiver receives a compound transport stream (TS) comprising 3D program video streams and spliced advertising streams. The received one or more 3D program video streams are extracted and decoded. Targeted advertising streams are extracted from the received advertising streams according to user criteria. Targeted advertising graphic objects of the extracted or replaced targeted advertising streams are spliced into the decoded 3D program video streams. The decoded 3D program video with the spliced targeted advertising graphic objects is presented in a 2D video. The extracted or replaced targeted advertising streams are processed to generate the targeted advertising graphic objects to be spliced based on focal point of view. The generated targeted advertising graphic objects are located according to associated scene graph information. The decoded 3D program video streams and the spliced targeted advertising graphic objects are converted into a 2D video for display.

摘要翻译： 视频接收器接收包括3D节目视频流和拼接广告流的复合传输流（TS）。 提取并解码所接收的一个或多个3D节目视频流。 根据用户标准从接收到的广告流中提取目标广告流。 提取或替换的目标广告流的目标广告图形对象被拼接成解码的3D节目视频流。 具有拼接的目标广告图形对象的解码的3D节目视频被呈现在2D视频中。 处理提取或替换的目标广告流以基于焦点来生成要拼接的目标广告图形对象。 生成的目标广告图形对象根据相关联的场景图信息来定位。 解码的3D程序视频流和拼接的目标广告图形对象被转换成2D视频以供显示。