-
公开(公告)号:US20090251594A1
公开(公告)日:2009-10-08
申请号:US12060890
申请日:2008-04-02
申请人: Gang Hua , Cha Zhang , Zhengyou Zhang , Zicheng Liu , Ying Shan
发明人: Gang Hua , Cha Zhang , Zhengyou Zhang , Zicheng Liu , Ying Shan
IPC分类号: H04N7/01
CPC分类号: G06T11/00 , H04N1/3875 , H04N7/0122 , H04N21/2662
摘要: Videos are retargeted to a target display for viewing with little to no geometric distortion or video information loss. Salient regions of video frames may be determined using scale-space spatiotemporal information. Video information loss may be a result of spatial loss, due to cropping, and resolution loss, due to resizing. A desired cropping window may be determined using a coarse-to-fine searching strategy. Video frames may be cropped with a window that matches an aspect ratio of the target display, and resized isotropically to match a size of the target display.
摘要翻译: 视频被重定向到目标显示器,用于观看几乎没有几何失真或视频信息丢失。 可以使用尺度空间时空信息来确定视频帧的显着区域。 视频信息丢失可能是由于调整大小而导致的空间损失,由于裁剪和分辨率损失造成的。 可以使用粗略到精细的搜索策略来确定期望的裁剪窗口。 可以用与目标显示器的纵横比匹配的窗口裁剪视频帧,并且各向同性地调整大小以匹配目标显示器的大小。
-
公开(公告)号:US09240056B2
公开(公告)日:2016-01-19
申请号:US12060890
申请日:2008-04-02
申请人: Gang Hua , Cha Zhang , Zhengyou Zhang , Zicheng Liu , Ying Shan
发明人: Gang Hua , Cha Zhang , Zhengyou Zhang , Zicheng Liu , Ying Shan
CPC分类号: G06T11/00 , H04N1/3875 , H04N7/0122 , H04N21/2662
摘要: Videos are retargeted to a target display for viewing with little to no geometric distortion or video information loss. Salient regions of video frames may be determined using scale-space spatiotemporal information. Video information loss may be a result of spatial loss, due to cropping, and resolution loss, due to resizing. A desired cropping window may be determined using a coarse-to-fine searching strategy. Video frames may be cropped with a window that matches an aspect ratio of the target display, and resized isotropically to match a size of the target display.
摘要翻译: 视频被重定向到目标显示器,用于观看几乎没有几何失真或视频信息丢失。 可以使用尺度空间时空信息来确定视频帧的显着区域。 视频信息丢失可能是由于调整大小而导致的空间损失,由于裁剪和分辨率损失造成的。 可以使用粗略到精细的搜索策略来确定期望的裁剪窗口。 可以用与目标显示器的纵横比匹配的窗口裁剪视频帧,并且各向同性地调整大小以匹配目标显示器的大小。
-
公开(公告)号:US20090220165A1
公开(公告)日:2009-09-03
申请号:US12039741
申请日:2008-02-29
申请人: Zicheng Liu , Ying Shan , Cha Zhang , Gang Hua , Zhengyou Zhang
发明人: Zicheng Liu , Ying Shan , Cha Zhang , Gang Hua , Zhengyou Zhang
CPC分类号: G06F16/9577
摘要: Efficient image display on a display screen (e.g., in terms of number, space, resolution, and/or distortion) is facilitated by implementing one or more specialized select and pack routines for images. That is, representative images are selected from an image database, based on desired resolution and distortion, then resized and packed into a display arrangement that enhances use of display screen space. This allows, for example, images to be sent to a user from an image database more quickly, with more desirable resolution, and less distortion than traditional display techniques.
摘要翻译: 通过为图像实现一个或多个专门的选择和包程序,便于在显示屏幕上(例如,在数量,空间,分辨率和/或失真方面)上的高效图像显示。 也就是说,基于期望的分辨率和失真从图像数据库中选择代表性图像,然后将其调整大小并将其打包成增强显示屏空间使用的显示装置。 例如,这允许从传统的显示技术更快地,从图像数据库向用户发送图像,具有更理想的分辨率和更少的失真。
-
公开(公告)号:US08009880B2
公开(公告)日:2011-08-30
申请号:US11747695
申请日:2007-05-11
申请人: Zhengyou Zhang , Zicheng Liu , Gang Hua , Yang Wang
发明人: Zhengyou Zhang , Zicheng Liu , Gang Hua , Yang Wang
CPC分类号: G06K9/00268 , G06K9/4661 , G06T7/11 , G06T2207/30201
摘要: A subregion-based image parameter recovery system and method for recovering image parameters from a single image containing a face taken under sub-optimal illumination conditions. The recovered image parameters (including albedo, illumination, and face geometry) can be used to generate face images under a new lighting environment. The method includes dividing the face in the image into numerous smaller regions, generating an albedo morphable model for each region, and using a Markov Random Fields (MRF)-based framework to model the spatial dependence between neighboring regions. Different types of regions are defined, including saturated, shadow, regular, and occluded regions. Each pixel in the image is classified and assigned to a region based on intensity, and then weighted based on its classification. The method decouples the texture from the geometry and illumination models, and then generates an objective function that is iteratively solved using an energy minimization technique to recover the image parameters.
摘要翻译: 一种基于子区域的图像参数恢复系统和方法,用于从包含在次优照明条件下拍摄的面部的单个图像恢复图像参数。 恢复的图像参数(包括反照率,照明和脸部几何)可用于在新的照明环境下生成脸部图像。 该方法包括将图像中的脸部划分成许多较小的区域,为每个区域生成反照变形模型,并使用基于马尔可夫随机场(MRF)的框架来模拟相邻区域之间的空间依赖关系。 定义不同类型的区域,包括饱和,阴影,常规和遮挡区域。 将图像中的每个像素分类并分配给基于强度的区域,然后基于其分类进行加权。 该方法将纹理与几何和照明模型分离,然后生成使用能量最小化技术迭代求解以恢复图像参数的目标函数。
-
5.
公开(公告)号:US07706610B2
公开(公告)日:2010-04-27
申请号:US11291309
申请日:2005-11-29
申请人: Zhengyou Zhang , Zicheng Liu , Gang Hua
发明人: Zhengyou Zhang , Zicheng Liu , Gang Hua
CPC分类号: G06K9/38 , G06K9/6226 , G06T7/11 , G06T7/143 , G06T7/149 , G06T2207/20116
摘要: An “Image Segmenter” provides a variational energy formulation for segmentation of natural objects from images. In general, the Image Segmenter operates by adopting Gaussian mixture models (GMM) to capture the appearance variation of objects in one or more images. A global image data likelihood potential is then computed and combined with local region potentials to obtain a robust and accurate estimation of pixel foreground and background distributions. Iterative minimization of a “global-local energy function” is then accomplished by evolution of a foreground/background boundary curve by level set, and estimation of a foreground/background model by fixed-point iteration, termed “quasi-semi-supervised EM.” In various embodiments, this process is further improved by providing general object shape information for use in rectifying objects segmented from the image.
摘要翻译: “图像分割器”提供了用于从图像中分割自然对象的变分能量公式。 通常,图像分割器通过采用高斯混合模型(GMM)来捕获一个或多个图像中的对象的外观变化来操作。 然后计算全局图像数据可能性电位并与局部区域电位组合以获得对像素前景和背景分布的鲁棒且准确的估计。 “全局局部能量函数”的迭代最小化通过水平集演化前景/背景边界曲线,并通过称为“准半监督EM”的定点迭代估计前景/背景模型来实现。 “在各种实施例中,通过提供用于整流从图像分割的对象的一般对象形状信息来进一步改进该过程。
-
公开(公告)号:US20080279423A1
公开(公告)日:2008-11-13
申请号:US11747695
申请日:2007-05-11
申请人: Zhengyou Zhang , Zicheng Liu , Gang Hua , Yang Wang
发明人: Zhengyou Zhang , Zicheng Liu , Gang Hua , Yang Wang
IPC分类号: G06K9/00
CPC分类号: G06K9/00268 , G06K9/4661 , G06T7/11 , G06T2207/30201
摘要: A subregion-based image parameter recovery system and method for recovering image parameters from a single image containing a face taken under sub-optimal illumination conditions. The recovered image parameters (including albedo, illumination, and face geometry) can be used to generate face images under a new lighting environment. The method includes dividing the face in the image into numerous smaller regions, generating an albedo morphable model for each region, and using a Markov Random Fields (MRF)-based framework to model the spatial dependence between neighboring regions. Different types of regions are defined, including saturated, shadow, regular, and occluded regions. Each pixel in the image is classified and assigned to a region based on intensity, and then weighted based on its classification. The method decouples the texture from the geometry and illumination models, and then generates an objective function that is iteratively solved using an energy minimization technique to recover the image parameters.
摘要翻译: 一种基于子区域的图像参数恢复系统和方法,用于从包含在次优照明条件下拍摄的面部的单个图像恢复图像参数。 恢复的图像参数(包括反照率,照明和脸部几何)可用于在新的照明环境下生成脸部图像。 该方法包括将图像中的脸部划分成许多较小的区域,为每个区域生成反照变形模型,并使用基于马尔科夫随机场(MRF)的框架来模拟相邻区域之间的空间依赖关系。 定义不同类型的区域,包括饱和,阴影,常规和遮挡区域。 将图像中的每个像素分类并分配给基于强度的区域,然后基于其分类进行加权。 该方法将纹理与几何和照明模型分离,然后生成使用能量最小化技术迭代求解以恢复图像参数的目标函数。
-
7.
公开(公告)号:US20070122039A1
公开(公告)日:2007-05-31
申请号:US11291309
申请日:2005-11-29
申请人: Zhengyou Zhang , Zicheng Liu , Gang Hua
发明人: Zhengyou Zhang , Zicheng Liu , Gang Hua
CPC分类号: G06K9/38 , G06K9/6226 , G06T7/11 , G06T7/143 , G06T7/149 , G06T2207/20116
摘要: An “Image Segmenter” provides a variational energy formulation for segmentation of natural objects from images. In general, the Image Segmenter operates by adopting Gaussian mixture models (GMM) to capture the appearance variation of objects in one or more images. A global image data likelihood potential is then computed and combined with local region potentials to obtain a robust and accurate estimation of pixel foreground and background distributions. Iterative minimization of a “global-local energy function” is then accomplished by evolution of a foreground/background boundary curve by level set, and estimation of a foreground/background model by fixed-point iteration, termed “quasi-semi-supervised EM.” In various embodiments, this process is further improved by providing general object shape information for use in rectifying objects segmented from the image.
摘要翻译: “图像分割器”提供了用于从图像中分割自然对象的变分能量公式。 通常,图像分割器通过采用高斯混合模型(GMM)来捕获一个或多个图像中的对象的外观变化来操作。 然后计算全局图像数据可能性电位并与局部区域电位组合以获得对像素前景和背景分布的鲁棒且准确的估计。 “全局局部能量函数”的迭代最小化通过水平集演化前景/背景边界曲线,并通过称为“准半监督EM”的定点迭代估计前景/背景模型来实现。 “ 在各种实施例中,通过提供用于整流从图像分割的对象的一般对象形状信息来进一步改进该过程。
-
公开(公告)号:US06828972B2
公开(公告)日:2004-12-07
申请号:US10131972
申请日:2002-04-24
申请人: Zhengyou Zhang , Zicheng Liu , Ying Shan
发明人: Zhengyou Zhang , Zicheng Liu , Ying Shan
IPC分类号: G06T1500
CPC分类号: G06T13/40 , G06K9/00268 , G06K9/00308 , G06T2210/44
摘要: A system and method for mapping facial expressions. Facial expressions exhibit not only facial feature motions, but also subtle changes in illumination and appearance (e.g., facial creases and wrinkles). These details are important visual cues, but they are difficult to synthesize. Traditional expression mapping techniques consider feature motions while the details in illumination changes are ignored. A novel technique for facial expression mapping is presented. The illumination change of one person's expression is captured in what is called expression ratio image (ERI). Together with geometric warping, an ERI is mapped to any other person's face image to generate more expressive facial expressions.
摘要翻译: 一种用于映射面部表情的系统和方法。 面部表情不仅表现出面部特征运动,还表现出照明和外观的微妙变化(例如面部皱纹和皱纹)。 这些细节是重要的视觉线索,但它们很难合成。 传统表达映射技术考虑特征运动,而照明变化的细节被忽略。 提出了一种面部表情映射的新技术。 一个人的表情的照明变化被称为表达比例图像(ERI)。 与几何翘曲一起,ERI被映射到任何其他人的脸部图像,以产生更具表现力的面部表情。
-
公开(公告)号:US07020347B2
公开(公告)日:2006-03-28
申请号:US10126118
申请日:2002-04-18
申请人: Zhengyou Zhang , Zicheng Liu , Ying Shan
发明人: Zhengyou Zhang , Zicheng Liu , Ying Shan
CPC分类号: G06T15/04 , G06T11/001
摘要: A system and method, called Image-Based Surface Detail Transfer, to transfer geometric details from one surface of an object in an image to another with simple 2D image operations. The basic observation is that, without knowing its 3D geometry, geometric details (local deformations) can be extracted from a single image of an object in a way independent of its surface reflectance, and furthermore, these geometric details can be transferred to modify the appearance of other objects directly in images. Examples are shown including surface detail transfer between real objects, as well as between real and synthesized objects.
-
公开(公告)号:US07200281B2
公开(公告)日:2007-04-03
申请号:US11108545
申请日:2005-04-18
申请人: Zhengyou Zhang , Zicheng Liu , Ying Shan
发明人: Zhengyou Zhang , Zicheng Liu , Ying Shan
CPC分类号: G06T15/04 , G06T11/001
摘要: A system and method, called Image-Based Surface Detail Transfer, to transfer geometric details from one surface of an object in an image to another with simple 2D image operations. The basic observation is that, without knowing its 3D geometry, geometric details (local deformations) can be extracted from a single image of an object in a way independent of its surface reflectance, and furthermore, these geometric details can be transferred to modify the appearance of other objects directly in images. Examples are shown including surface detail transfer between real objects, as well as between real and synthesized objects.
摘要翻译: 一种称为基于图像的表面细节传输的系统和方法,通过简单的2D图像操作将图像中的对象的一个表面的几何细节传输到另一个。 基本的观察是,在不知道其3D几何形状的情况下,可以以独立于其表面反射率的方式从对象的单个图像中提取几何细节(局部变形),此外,这些几何细节可以被转移以修改外观 的其他对象直接在图像。 示例的实例包括真实对象之间的表面细节传递,以及真实对象和合成对象之间的表面细节传递。
-
-
-
-
-
-
-
-
-