公开(公告)号：US09218644B2

公开(公告)日：2015-12-22

申请号：US12689356

申请日：2010-01-19

申请人： Marcus Kellerman ,  Xuemin Chen ,  Samir Hulyalkar ,  Ilya Klebanov

发明人： Marcus Kellerman ,  Xuemin Chen ,  Samir Hulyalkar ,  Ilya Klebanov

IPC分类号： G06T3/40

CPC分类号： G06T3/4007 ,  G06T2207/10021

摘要： A video processing device may generate a two dimensional (2D) output video stream from a three dimensional (3D) input video stream that comprises a plurality of view sequences. The plurality of view sequences may comprise sequences of stereoscopic left and right reference fields or frames. A view sequence may initially be selected as a base sequence for the 2D output video stream, and the 2D output video stream may be enhanced using video content and/or information from unselected view sequences. The video content and/or information utilized in enhancing the 2D output video stream may comprise depth information, and/or foreground and/or background information. The enhancement of the 2D input video stream may comprise improving depth, contrast, sharpness, and/or rate upconversion using frame and/or field based interpolation of images in the 2D output video stream.

摘要翻译： 视频处理设备可以从包括多个视图序列的三维（3D）输入视频流生成二维（2D）输出视频流。 多个视图序列可以包括立体左右参考场或帧的序列。 可以最初选择视图序列作为2D输出视频流的基本序列，并且可以使用来自未选择的视图序列的视频内容和/或信息来增强2D输出视频流。 用于增强2D输出视频流的视频内容和/或信息可以包括深度信息和/或前景和/或背景信息。 2D输入视频流的增强可以包括使用2D输出视频流中的图像的基于帧和/或场的内插来提高深度，对比度，清晰度和/或上变频率。

公开(公告)号：US08704932B2

公开(公告)日：2014-04-22

申请号：US12604936

申请日：2009-10-23

申请人： Samir Hulyalkar ,  Xuemin Chen ,  Marcus Kellerman ,  Ilya Klebanov

发明人： Samir Hulyalkar ,  Xuemin Chen ,  Marcus Kellerman ,  Ilya Klebanov

IPC分类号： H04N5/225

CPC分类号： G06T5/002 ,  G06T2207/10012 ,  H04N13/122

摘要： A video processing system receives left and right 3D video and/or graphics frames and generates noise reduced left 3D video, right 3D video and/or graphics frames based on parallax compensated left and right frames. Displacement of imagery and/or pixel structures is determined relative to opposite side left and/or right frames. Parallax vectors are determined for parallax compensated left 3D video, right 3D video and/or graphics frames. A search area for displacement may be bounded by parallax limitations. Left 3D frames may be blended with the parallax compensated right 3D frames. Right 3D frames may be blended with the parallax compensated left 3D frames. The left 3D video, right 3D video and/or graphics frames comprise images that are captured, representative of and/or are displayed at a same time instant or at different time instants. Motion estimation, motion adaptation and/or motion compensation techniques may be utilized with parallax techniques.

摘要翻译： 视频处理系统接收左和右3D视频和/或图形帧，并且基于视差补偿的左右帧产生噪声降低的左3D视频，右3D视频和/或图形帧。 图像和/或像素结构的位移相对于相对的左侧和/或右侧框架确定。 为视差补偿的左3D视频，右3D视频和/或图形帧确定视差向量。 用于位移的搜索区域可能受视差限制的限制。 可以将左3D帧与视差补偿的右3D帧混合。 可以将右3D帧与视差补偿的左3D帧混合。 左3D视频，右3D视频和/或图形帧包括在同一时刻或不同时刻被捕获，代表和/或显示的图像。 运动估计，运动适应和/或运动补偿技术可以利用视差技术。

公开(公告)号：US20110063414A1

公开(公告)日：2011-03-17

申请号：US12560554

申请日：2009-09-16

申请人： Xuemin Chen ,  Marcus Kellerman ,  Samir Hulyalkar ,  Ilya Klebanov

发明人： Xuemin Chen ,  Marcus Kellerman ,  Samir Hulyalkar ,  Ilya Klebanov

IPC分类号： H04N13/00 ,  H04N7/12

CPC分类号： H04N13/161 ,  H04N19/10 ,  H04N19/127 ,  H04N19/132 ,  H04N19/152 ,  H04N19/156 ,  H04N19/172 ,  H04N19/176 ,  H04N19/20 ,  H04N19/31 ,  H04N19/40 ,  H04N19/426 ,  H04N19/51 ,  H04N19/577 ,  H04N19/597

摘要： A video receiver receives a compressed 3D video comprising a base view video and a residual view video from a video transmitter. The video receiver decodes the received base view video and an enhancement view video of the received compressed 3D video into a left view video and a right view video. Base view pictures are generated selectively based on available memory resource. The residual view video is generated by subtracting base view pictures from corresponding enhancement view pictures. The received base view and residual view videos are buffered for video decoding. Pictures in the buffered residual view video are added to corresponding pictures in the buffered base view video for enhancement view decoding. The left view video and/or the right view video are generated from the resulting decoded base view and enhancement view pictures. A motion vector used for a disparity predicted macroblock is applied to adjacent macroblock pre-fetching.

摘要翻译： 视频接收器从视频发送器接收包括基本视图视频和残余视图视频的压缩3D视频。 视频接收机将接收到的基本视图视频和接收到的压缩3D视频的增强视图视频解码为左视图视频和右视图视频。 基于可用的存储器资源选择性地生成基本视图图。 通过从相应的增强视图图像中减去基本视图图来产生残差视图。 接收到的基本视图和残余视图视频被缓冲用于视频解码。 将缓冲残差视图中的图像添加到缓冲基视图视频中的相应图像中，以进行增强视图解码。 从所得到的经解码的基本视图和增强视图图像中生成左视图视频和/或右视图视频。 将用于视差预测宏块的运动矢量应用于相邻宏块预取。

公开(公告)号：US08472625B2

公开(公告)日：2013-06-25

申请号：US12560592

申请日：2009-09-16

申请人： Xuemin Chen ,  Samir Hulyalkar ,  Marcus Kellerman ,  Ilya Klebanov

发明人： Xuemin Chen ,  Samir Hulyalkar ,  Marcus Kellerman ,  Ilya Klebanov

IPC分类号： G06F21/00

CPC分类号： H04N7/1675 ,  H04N19/597 ,  H04N21/234327 ,  H04N21/2347 ,  H04N21/4405 ,  H04N21/835

摘要： A video receiver receives a compressed 3D video comprising a base view video and an enhancement view video. The base view video and the enhancement view video are encrypted using same encryption engine and buffered into corresponding coded data buffers (CDBs), respectively. The buffered base view and enhancement view videos are decrypted using same decryption engine corresponding to the encryption engine. The decrypted base view and enhancement view videos are decoded for viewing. The video receiver is also operable to encrypt video content of the received compressed 3D video according to corresponding view information and/or coding layer information. The resulting encrypted video content and unencrypted video content of the received compressed 3D video are buffered into corresponding CDBs, respectively. The buffered encrypted video content are decrypted and are decoded together with the buffered unencrypted video content of the received compressed 3D video for reviewing.

摘要翻译： 视频接收器接收包括基本视图视频和增强视图视频的压缩3D视频。 基本视图视频和增强视图视频使用相同的加密引擎进行加密并缓存到相应的编码数据缓冲器（CDB）中。 缓冲的基本视图和增强视图视频使用与加密引擎对应的相同的解密引擎进行解密。 解密的基本视图和增强视图视频被解码以供观看。 视频接收机还可操作以根据对应的视图信息和/或编码层信息来加密接收到的压缩3D视频的视频内容。 所得到的加密视频内容和接收到的压缩3D视频的未加密视频内容分别被缓存到相应的CDB中。 缓冲的加密视频内容被解密并与接收到的压缩3D视频的经缓冲的未加密的视频内容一起解码以进行审查。

公开(公告)号：US20110149040A1

公开(公告)日：2011-06-23

申请号：US12698776

申请日：2010-02-02

申请人： Ilya Klebanov ,  Xuemin Chen ,  Samir Hulyalkar ,  Marcus Kellerman

发明人： Ilya Klebanov ,  Xuemin Chen ,  Samir Hulyalkar ,  Marcus Kellerman

IPC分类号： H04N13/02

CPC分类号： H04N19/597 ,  H04N13/139 ,  H04N13/161 ,  H04N13/189 ,  H04N13/194

摘要： A video processing device may generate and/or capture a plurality of view sequences of video frames, decimate at least some of the plurality of view sequences, and may generating a three-dimension (3D) video stream comprising the plurality of view sequences based on that decimation. The decimation may be achieved by converting one or more of the plurality of view sequences from progressive to interlaced video. The interlacing may be performed by removing top or bottom fields in each frame of those one or more view sequences during the conversion to interlaced video. The removed fields may be selected based on corresponding conversion to interlaced video of one or more corresponding view sequences. The video processing device may determine bandwidth limitations existing during direct and/or indirect transfer or communication of the generated 3D video stream. The decimation may be performed based on this determination of bandwidth limitations.

摘要翻译： 视频处理设备可以生成和/或捕获视频帧的多个视图序列，抽取多个视图序列中的至少一些视图序列，并且可以生成包括多个视图序列的三维（3D）视频流，基于 那个抽奖。 可以通过将多个视图序列中的一个或多个从逐行视频转换为隔行视频来实现抽取。 可以通过在转换成隔行视频期间去除那些一个或多个视图序列的每个帧中的顶部或底部场，来执行隔行扫描。 可以基于对一个或多个对应视图序列的隔行视频的对应转换来选择被去除的字段。 视频处理设备可以确定在所生成的3D视频流的直接和/或间接传送或通信期间存在的带宽限制。 可以基于带宽限制的这种确定来执行抽取。

公开(公告)号：US20110149020A1

公开(公告)日：2011-06-23

申请号：US12689388

申请日：2010-01-19

申请人： Ilya Klebanov ,  Xuemin Chen ,  Samir Hulyalkar ,  Marcus Kellerman

发明人： Ilya Klebanov ,  Xuemin Chen ,  Samir Hulyalkar ,  Marcus Kellerman

IPC分类号： H04N13/00 ,  H04N5/91

CPC分类号： H04N5/85 ,  H04N13/161 ,  H04N13/189 ,  H04N13/194 ,  H04N19/597

摘要： A media player may read three-dimensional (3D) video data comprising a plurality of view sequences of frames or fields from a media storage device, and may decimate one or more of the view sequences to enable transferring the video data to a display device. The media player may determine operational parameter(s) and/or transfer limitation(s) of a connecting subsystem used to transfer the video data to the display device. The decimation may be performed based on this determination of transfer limitation(s). The decimation may be performed temporally and/or spatially. The plurality of view sequences may comprise sequences of stereoscopic left and right view reference frames or fields. The decimation may be performed such that the removed data for each view sequence may be reconstructed, after reception, based on remaining data in the same view sequence and/or video data of other corresponding view sequences.

摘要翻译： 媒体播放器可以从媒体存储设备读取包括多个视图序列的帧或场的三维（3D）视频数据，并且可以对一个或多个视图序列进行抽取以使视频数据传送到显示设备。 媒体播放器可以确定用于将视频数据传送到显示设备的连接子系统的操作参数和/或传送限制。 可以基于传输限制的确定来执行抽取。 抽取可以在时间上和/或空间上进行。 多个视图序列可以包括立体左视图参考帧或右视图参考帧或场的序列。 可以执行抽取，使得可以在接收之后基于相同视图序列中的剩余数据和/或其他对应视图序列的视频数据来重构每个视图序列的去除数据。

公开(公告)号：US20110096146A1

公开(公告)日：2011-04-28

申请号：US12605039

申请日：2009-10-23

申请人： Samir Hulyalkar ,  Xuemin Chen ,  Marcus Kellerman ,  Ilya Klebanov ,  Sunkwang Hong

发明人： Samir Hulyalkar ,  Xuemin Chen ,  Marcus Kellerman ,  Ilya Klebanov ,  Sunkwang Hong

IPC分类号： H04N13/00

CPC分类号： H04N13/341 ,  H04N13/275 ,  H04N13/30 ,  H04N21/6125

摘要： A sequential pattern comprising contiguous black frames inserted between left and right 3D video and/or graphics frames may be displayed on an LCD display. The pattern may comprise two or three contiguous left frames followed by contiguous black frames followed by two or three contiguous right frames followed by contiguous black frames. The left and/or right frames may comprise interpolated frames and/or may be displayed in ascending order. The contiguous black frames are displayed longer than liquid crystal response time. 3D shutter glasses are synchronized with the black frames. A left lens transmits light when left frames followed by contiguous black frames are displayed and a right lens transmits light when right frames followed by contiguous black frames are displayed. A 3D pair of 24 Hz frames or two 3D pairs of 60 Hz frames per pattern are displayed on a 240 Hz display.

摘要翻译： 可以在LCD显示器上显示包括插入在左和右3D视频和/或图形帧之间的连续黑框的顺序图案。 该图案可以包括两个或三个连续的左帧，随后是连续的黑色帧，随后是两个或三个连续的右帧，随后是连续的黑色帧。 左和/或右帧可以包括内插帧和/或可以按升序显示。 连续的黑框显示比液晶响应时间长。 3D快门眼镜与黑框同步。 左侧镜头会在显示左侧框架，然后显示连续的黑色框架时显示光线，而右侧镜头会在显示连续黑色框架的右侧框架时发出光线。 在240Hz显示屏上显示每对图案的一对24 Hz帧或每组60 Hz帧的3D对。

公开(公告)号：US20110064262A1

公开(公告)日：2011-03-17

申请号：US12560578

申请日：2009-09-16

申请人： Xuemin Chen ,  Samir Hulyalkar ,  Marcus Kellerman ,  Ilya Klebanov

发明人： Xuemin Chen ,  Samir Hulyalkar ,  Marcus Kellerman ,  Ilya Klebanov

IPC分类号： H04N13/00 ,  H04N7/12 ,  G06T1/00 ,  G06K9/00

CPC分类号： H04N21/2351 ,  G06T1/0085 ,  G06T2201/0053 ,  H04N19/467 ,  H04N19/597

摘要： A video transmitter identifies regions in pictures in a compressed three-dimensional (3D) video comprising a base view video and an enhancement view video. The identified regions are not referenced by other pictures in the compressed 3D video. The identified regions are watermarked. Pictures such as a high layer picture in the base view video and the enhancement view video are identified for watermarking. The identified regions in the base view and/or enhancement view videos are watermarked and multiplexed into a transport stream for transmission. An intended video receiver extracts the base view video, the enhancement view video and corresponding watermark data from the received transport stream. The corresponding extracted watermark data are synchronized with the extracted base view video and the extracted enhancement view video, respectively, for watermark insertion. The resulting base view and enhancement view videos are decoded into a left view video and a right view video, respectively.

摘要翻译： 视频发射器识别包括基本视图视频和增强视图视频的压缩三维（3D）视频中的图像中的区域。 识别的区域不被压缩3D视频中的其他图像引用。 所识别的区域被加水印。 识别基本视图视频和增强视图视频中的高层图像等图像以进行水印处理。 基本视图和/或增强视图视频中的识别的区域被加水印并被多路复用到传输流中以进行传输。 预期的视频接收器从接收的传输流中提取基本视图视频，增强视图视频和对应的水印数据。 相应的提取的水印数据分别与提取的基本视图视频和提取的增强视图视频同步，用于水印插入。 所得到的基本视图和增强视图视频分别解码为左视图视频和右视图视频。

公开(公告)号：US08762846B2

公开(公告)日：2014-06-24

申请号：US12619461

申请日：2009-11-16

申请人： Marcus Kellerman ,  Xuemin Chen ,  Samir Hulyalkar ,  Ilya Klebanov

发明人： Marcus Kellerman ,  Xuemin Chen ,  Samir Hulyalkar ,  Ilya Klebanov

IPC分类号： G06F3/00

CPC分类号： H04N13/383 ,  G06F3/012 ,  G06F3/013 ,  G06F3/04815 ,  G06F3/0485 ,  G06F2203/04806

摘要： A 2D and/or 3D video processing device comprising a camera and a display captures images of a viewer as the viewer observes displayed 2D and/or 3D video content in a viewport. Face and/or eye tracking of viewer images is utilized to generate a different viewport. Current and different viewports may comprise 2D and/or 3D video content from a single source or from different sources. The sources of 2D and/or 3D content may be scrolled, zoomed and/or navigated through for generating the different viewport. Content for the different viewport may be processed. Images of a viewer's positions, angles and/or movements of face, facial expression, eyes and/or physical gestures are captured by the camera and interpreted by face and/or eye tracking. The different viewport may be generated for navigating through 3D content and/or for rotating a 3D object. The 2D and/or 3D video processing device communicates via wire, wireless and/or optical interfaces.

摘要翻译： 包括相机和显示器的2D和/或3D视频处理设备在观察者观察视口中显示的2D和/或3D视频内容时捕获观看者的图像。 利用观看者图像的面部和/或眼睛跟踪来生成不同的视口。 当前和不同的视口可以包括来自单个源或来自不同来源的2D和/或3D视频内容。 2D和/或3D内容的来源可以被滚动，缩放和/或导航以用于生成不同的视口。 可以处理不同视口的内容。 观看者的位置，角度和/或脸部运动，脸部表情，眼睛和/或身体手势的图像由相机拍摄并通过脸部和/或眼睛跟踪进行解释。 可以生成用于通过3D内容和/或旋转3D对象的不同视口。 2D和/或3D视频处理设备通过有线，无线和/或光接口进行通信。

公开(公告)号：US08487981B2

公开(公告)日：2013-07-16

申请号：US12554416

申请日：2009-09-04

申请人： Samir Hulyalkar ,  Xuemin Chen ,  Marcus Kellerman ,  Ilya Klebanov

发明人： Samir Hulyalkar ,  Xuemin Chen ,  Marcus Kellerman ,  Ilya Klebanov

IPC分类号： H04N13/00

CPC分类号： H04N19/597 ,  H04N13/139

摘要： A video processor decompresses stereoscopic left and right reference frames of compressed 3D video. New left and right frames are interpolated. The frames may be stored and/or communicated for display. The left and right frames are combined into a single frame of a single stream or may be sequenced in separate left and right streams. The left and right frames are interpolated based on the combined single stream and/or based on the separate left and right streams. Motion vectors are determined for one of the separate left or right streams. The frames are interpolated utilizing motion compensation. Areas of occlusion are determined in the separate left and right streams. Pixels are interpolated for occluded areas of left or right frames of separate streams from uncovered areas in corresponding opposite side frames. The left and right interpolated and/or reference frames are displayed as 3D and/or 2D video.

摘要翻译： 视频处理器解压缩压缩3D视频的立体左右参考帧。 新的左和右帧被内插。 可以存储和/或传送帧以进行显示。 左和右帧被组合成单个流的单个帧，或者可以在单独的左和右流中排序。 基于组合的单个流和/或基于单独的左流和右流来内插左和右帧。 为单独的左流或右流之一确定运动矢量。 使用运动补偿内插帧。 在单独的左和右流中确定遮挡区域。 对于相应的相对侧框架中的未覆盖区域，将单独流的左帧或右帧的遮挡区域插入像素。 左和右插入和/或参考帧被显示为3D和/或2D视频。