Method and apparatus for calibrating video camera
    1.
    发明授权
    Method and apparatus for calibrating video camera 有权
    校准摄像机的方法和装置

    公开(公告)号:US08436904B2

    公开(公告)日:2013-05-07

    申请号:US12757211

    申请日:2010-04-09

    IPC分类号: H04N13/02 H04N17/00

    CPC分类号: G06T7/80 G06T2207/30208

    摘要: A method for calibrating the video camera includes: obtaining the internal and external parameters of the video camera according to a reference template; recording data of a reference object in the scene; obtaining images of the reference object from at least two perspectives; and obtaining the internal and external parameters of the video camera according to the recorded data of the reference object. An apparatus for calibrating the video camera includes: a preliminary calibration unit, configured to obtain the internal and external parameters of the video camera according to a reference template, and record the data of a reference object in the scene; a recalibration unit, configured to obtain images of the reference object from at least two perspectives, and obtain the internal and external parameters of the video camera according to the recorded data of the reference object. The invention is applicable to various scenes and features simple operations.

    摘要翻译: 用于校准摄像机的方法包括:根据参考模板获得摄像机的内部和外部参数; 在场景中记录参考对象的数据; 从至少两个角度获取参考对象的图像; 以及根据参考对象的记录数据获得摄像机的内部和外部参数。 用于校准摄像机的装置包括:初步校准单元,被配置为根据参考模板获得摄像机的内部和外部参数,并将参考对象的数据记录在场景中; 重新校正单元,被配置为从至少两个角度获得参考对象的图像,并且根据参考对象的记录数据获得摄像机的内部和外部参数。 本发明适用于各种场景和功能简单的操作。

    Method and system for rectifying images
    2.
    发明授权
    Method and system for rectifying images 有权
    校正图像的方法和系统

    公开(公告)号:US08849010B2

    公开(公告)日:2014-09-30

    申请号:US12874468

    申请日:2010-09-02

    IPC分类号: G06K9/00 G06T5/00 G06T3/00

    摘要: The present invention relates to a method and a system for rectifying images. An original stereo image pair is obtained, and the epipolar lines corresponding to the original stereo image pair are parallelized to obtain a first transformed stereo image pair. Epipolar lines corresponding to the first transformed stereo image pair are collinearized to obtain a second transformed stereo image pair. The present invention parallelizes and collinearizes the epipolar lines corresponding to the stereo image pair after the images are rectified.

    摘要翻译: 本发明涉及一种整流图像的方法和系统。 获得原始立体图像对,并且对应于原始立体图像对的对极线被并行以获得第一变换立体图像对。 对应于第一变换立体图像对的对极线共线以获得第二变换立体图像对。 本发明在对图像进行整流之后,对应于立体图像对的对极线并行化并共线。

    COMMUNICATION TERMINAL AND INFORMATION SYSTEM
    3.
    发明申请
    COMMUNICATION TERMINAL AND INFORMATION SYSTEM 审中-公开
    通信终端和信息系统

    公开(公告)号:US20100053307A1

    公开(公告)日:2010-03-04

    申请号:US12617914

    申请日:2009-11-13

    IPC分类号: H04N13/02 H04N13/04

    摘要: A communication terminal includes: an image or video collecting and generating module, adapted to collect and generate 3D image or video data; a communication module, adapted to send or receive image or video and generated 3D image or video data; and an image or video display module, adapted to display the 3D image or video according to the collected or received and generated 3D image or video data. An information system includes a 3D image or video information center. The 3D image or video information center further includes: a 3D image or video information relay, adapted to interact with the communication terminal; and a 3D image or video information server, adapted to store 3D image or video information and convert between 3D image or video information and SMS. The communication terminal features simple structure and good performance. The information system supports communication through 3D image or video information.

    摘要翻译: 通信终端包括:适于收集和生成3D图像或视频数据的图像或视频采集和生成模块; 通信模块,适于发送或接收图像或视频并生成3D图像或视频数据; 以及图像或视频显示模块,适于根据收集或接收和生成的3D图像或视频数据来显示3D图像或视频。 信息系统包括3D图像或视频信息中心。 3D图像或视频信息中心还包括:适于与通信终端交互的3D图像或视频信息中继; 以及适于存储3D图像或视频信息并在3D图像或视频信息与SMS之间进行转换的3D图像或视频信息服务器。 通信终端结构简单,性能好。 信息系统支持通过3D图像或视频信息进行通信。

    VIDEO ENCODING DECODING METHOD AND DEVICE AND VIDEO
    4.
    发明申请
    VIDEO ENCODING DECODING METHOD AND DEVICE AND VIDEO 审中-公开
    视频编码解码方法和设备和视频

    公开(公告)号:US20100202535A1

    公开(公告)日:2010-08-12

    申请号:US12761991

    申请日:2010-04-16

    IPC分类号: H04N7/50 H04N7/32 H04N7/26

    摘要: A video encoding decoding method and device and a video codec are provided. The video encoding method includes the following steps. A first view picture is basic-layer encoded as a reference view picture, prediction information is extracted in combination with a second view picture, and the second view picture is re-created. A residual value is calculated according to a re-created second view picture and the original second view picture. When the residual value is greater than a threshold, both the residual value and the prediction information are enhanced-layer encoded simultaneously; otherwise, only the prediction information is enhanced-layer encoded. Encoded information is obtained by multiplexing the enhanced-layer encoding with the basic-layer encoding of the first video picture. The video decoding method includes the following steps. After de-multiplex, basic-layer encoded information and enhanced-layer encoded information are decoded respectively to obtain a first view picture, prediction information, and a residual value, and then a second view picture is re-created. The embodiments of the invention can realize the effective compression of stereo video data, reduce an encoding complexity, and are compatible with the conventional two dimensional displaying, so as to correctly and easily re-create a stereo view picture.

    摘要翻译: 提供视频编码解码方法和设备以及视频编解码器。 视频编码方法包括以下步骤。 第一视图图像被基本层编码为参考视图图像,与第二视图组合提取预测信息,并且重新创建第二视图图像。 根据重新创建的第二视图图像和原始第二视图图像来计算残差值。 当残差值大于阈值时,残差值和预测信息同时增强层编码; 否则仅增强层编码预测信息。 通过将增强层编码与第一视频图像的基本层编码进行复用来获得编码信息。 视频解码方法包括以下步骤。 在解复用之后,分别对基本层编码信息和增强层编码信息进行解码以获得第一视图图像,预测信息和残差值,然后重新创建第二视图图像。 本发明的实施例可以实现立体视频数据的有效压缩,降低编码复杂度,并且与常规二维显示兼容,以便正确且容易地重新创建立体视图图像。

    3D video communication method, sending device and system, image reconstruction method and system
    5.
    发明授权
    3D video communication method, sending device and system, image reconstruction method and system 有权
    3D视频通信方式,发送设备和系统,图像重建方法和系统

    公开(公告)号:US09060165B2

    公开(公告)日:2015-06-16

    申请号:US13038055

    申请日:2011-03-01

    摘要: The disclosure includes a 3-dimensional (3D) video communication method, a 3D video sending device, a 3D video communication system, an image reconstruction method, and an image reconstruction system. The method includes: obtaining timestamped video image data of a scene collected by image collecting apparatuses, where the video image data includes at least one depth image and at least two color images; and encoding the video image data and sending the encoded video image data. The system includes a sending device and a receiving device. The sending device obtains at least one depth image and at least two color images of the scene through the image collecting apparatuses, the obtained depth images are accurate and reliable, and the collection of the video images is highly real-time. When reconstructing the images at the viewpoints, the receiving device can repair the reconstructed images by using the obtained color images.

    摘要翻译: 本公开包括三维(3D)视频通信方法,3D视频发送设备,3D视频通信系统,图像重建方法和图像重建系统。 该方法包括:获取由图像采集装置收集的场景的时间戳视频图像数据,其中视频图像数据包括至少一个深度图像和至少两个彩色图像; 并对视频图像数据进行编码并发送编码的视频图像数据。 该系统包括发送设备和接收设备。 发送装置通过图像采集装置获得场景的至少一个深度图像和至少两个彩色图像,所获得的深度图像准确可靠,并且视频图像的收集是高度实时的。 当在视点重建图像时,接收装置可以通过使用获得的彩色图像来修复重建的图像。

    METHOD AND APPARATUS FOR PROCESSING VIDEO IMAGE DATA AND VIDEOCONFERENCING SYSTEM AND VIDEOCONFERENCING TERMINAL
    6.
    发明申请
    METHOD AND APPARATUS FOR PROCESSING VIDEO IMAGE DATA AND VIDEOCONFERENCING SYSTEM AND VIDEOCONFERENCING TERMINAL 审中-公开
    用于处理视频图像数据和视频监控系统和视频终端的方法和装置

    公开(公告)号:US20120169829A1

    公开(公告)日:2012-07-05

    申请号:US13416919

    申请日:2012-03-09

    IPC分类号: H04N7/15 H04N9/74

    CPC分类号: H04N7/15 H04N7/142

    摘要: A method and an apparatus for processing video image data are disclosed in the embodiments of the present invention. The method includes: obtaining multiple channels of correlative video image data and correlative information; combining the multiple channels of correlative video image data into a single channel of panoramic video image data by using the correlative information; and after recombining the panoramic video image data into multiple channels of video image data satisfying a display requirement of multiple display devices, respectively sending each channel of recombined video image data to each display device for display. Therefore, an overlapping phenomenon existing in images shot by a camera may be allowed, so that requirements on a location where a camera is placed and a distance between a user and a camera set are lowered.

    摘要翻译: 在本发明的实施例中公开了一种用于处理视频图像数据的方法和装置。 该方法包括:获得多个相关视频图像数据和相关信息的通道; 通过使用相关信息将相关视频图像数据的多个通道组合成单个通道的全景视频图像数据; 并且将全景视频图像数据重新组合成满足多个显示装置的显示要求的多个视频图像数据通道,分别将每个重新组合的视频图像数据通道发送到每个显示装置以进行显示。 因此,可以允许由相机拍摄的图像中存在的重叠现象,从而降低了放置相机的位置和用户与相机组之间的距离的要求。

    3D VIDEO COMMUNICATION METHOD, SENDING DEVICE AND SYSTEM, IMAGE RECONSTRUCTION METHOD AND SYSTEM
    7.
    发明申请
    3D VIDEO COMMUNICATION METHOD, SENDING DEVICE AND SYSTEM, IMAGE RECONSTRUCTION METHOD AND SYSTEM 有权
    3D视频通信方法,发送设备和系统,图像重建方法和系统

    公开(公告)号:US20110150101A1

    公开(公告)日:2011-06-23

    申请号:US13038055

    申请日:2011-03-01

    IPC分类号: H04N13/00 H04N7/26 G06K9/00

    摘要: The present invention relates to a 3-dimensional (3D) video communication method, a 3D video sending device, a 3D video communication system, an image reconstruction method, and an image reconstruction system. The 3D video communication method includes: obtaining video image data of a scene collected by image collecting apparatuses, where the video image data includes at least one depth image and at least two color images; and encoding the video image data and sending the encoded video image data. The system includes a sending device and a receiving device. The sending device obtains at least one depth image and at least two color images of the scene through the image collecting apparatuses, the obtained depth images are accurate and reliable, and the collection of the video images is highly real-time. At the time of reconstructing the images at the viewpoints, the receiving device can repair the reconstructed images by using the obtained color images, thus improving the effect of reconstructed images and making the reconstructed images highly practical and real-time.

    摘要翻译: 本发明涉及三维(3D)视频通信方法,3D视频发送设备,3D视频通信系统,图像重建方法和图像重建系统。 3D视频通信方法包括:获取由图像采集装置收集的场景的视频图像数据,其中视频图像数据包括至少一个深度图像和至少两个彩色图像; 并对视频图像数据进行编码并发送编码的视频图像数据。 该系统包括发送设备和接收设备。 发送装置通过图像采集装置获得场景的至少一个深度图像和至少两个彩色图像,所获得的深度图像准确可靠,并且视频图像的收集是高度实时的。 在视点重建图像时,接收装置可以通过使用所获得的彩色图像来修复重建的图像,从而改善重建图像的效果并使得重建的图像高度实用和实时。

    Method and device for generating 3D panoramic video streams, and videoconference method and device
    8.
    发明授权
    Method and device for generating 3D panoramic video streams, and videoconference method and device 有权
    用于生成3D全景视频流的方法和设备,以及视频会议方法和设备

    公开(公告)号:US08717405B2

    公开(公告)日:2014-05-06

    申请号:US13172193

    申请日:2011-06-29

    IPC分类号: H04N7/14

    摘要: A method and a device for generating 3-dimensional (3D) panoramic video streams, a videoconference method, and a videoconference device are disclosed. The method includes: obtaining depth information of at least two video images; obtaining image data in multiple depth positions from a corresponding video image according to the depth information of each video image; stitching data of the video images according to the obtained image data in multiple depth positions, and generating 3D panoramic video streams. The technical solution of the present invention provides users with high-resolution 3D panoramic seamless telepresence conference video images based on different display modes of different display devices.

    摘要翻译: 公开了一种用于产生三维(3D)全景视频流的方法和装置,视频会议方法和视频会议装置。 该方法包括:获取至少两个视频图像的深度信息; 根据每个视频图像的深度信息从相应的视频图像获得多个深度位置的图像数据; 根据所获得的多个深度位置的图像数据拼接视频图像的数据,并生成3D全景视频流。 本发明的技术方案为用户提供了基于不同显示设备的不同显示模式的高分辨率3D全景无线远程呈现会议视频图像。

    Method and apparatus for processing image
    9.
    发明授权
    Method and apparatus for processing image 有权
    图像处理方法及装置

    公开(公告)号:US08355062B2

    公开(公告)日:2013-01-15

    申请号:US13189058

    申请日:2011-07-22

    IPC分类号: H04N5/262 G06K9/32

    CPC分类号: G06T15/20 G06T3/0012

    摘要: A method for processing an image includes: obtaining depth values of an image including a target region and a non-target region; obtaining a scaling ratio of the target region; obtaining a scaling ratio of the non-target region according to the depth values of the image and the scaling ratio of the target region; scaling respectively the target region and the non-target region according to the scaling ratio of the target region and the scaling ratio of the non-target region, and obtaining a scaled image.

    摘要翻译: 一种处理图像的方法包括:获得包括目标区域和非目标区域的图像的深度值; 获得目标区域的缩放比例; 根据图像的深度值和目标区域的缩放比例获得非目标区域的缩放比例; 根据目标区域的缩放比率和非目标区域的缩放比例,分别对目标区域和非目标区域进行缩放,并获得缩放图像。

    Image processing method and device
    10.
    发明授权
    Image processing method and device 有权
    图像处理方法及装置

    公开(公告)号:US08558869B2

    公开(公告)日:2013-10-15

    申请号:US13417752

    申请日:2012-03-12

    IPC分类号: H04N7/15

    CPC分类号: H04N7/15 H04N7/142 H04N7/147

    摘要: Embodiments of the present invention provide an image processing method and device, relating to the field of communications technology. The method includes: receiving at least two channels of images transmitted from a remote conference site; if there is a blind area in splicing of the at least two channels of images, comparing the width of the blind area with the sum of the widths of a left border and a right border of a display apparatus in a local conference site; processing the at least two channels of images separately according to a comparison result; outputting the at least two channels of processed images separately to the display apparatuses in the local conference site for displaying. In the embodiments of the present invention, the optimal image display effect may be achieved and the user experience in a telepresence video conference may be improved.

    摘要翻译: 本发明的实施例提供了一种涉及通信技术领域的图像处理方法和装置。 该方法包括:从远程会场接收至少两个信道的图像; 如果存在至少两个通道的图像拼接的盲区,则将盲区的宽度与本地会场中的显示装置的左边界和右边界的宽度之和进行比较; 根据比较结果分别处理至少两个通道的图像; 将所处理的图像的至少两个信道分别输出到本地会场的显示装置以进行显示。 在本发明的实施例中,可以实现最佳图像显示效果,并且可以提高远程呈现视频会议中的用户体验。