-
公开(公告)号:US09936165B2
公开(公告)日:2018-04-03
申请号:US13977278
申请日:2012-09-06
申请人: Wenlong Li , Xiaofeng Tong , Yangzhou Du , Wei Hu , Yimin Zhang
发明人: Wenlong Li , Xiaofeng Tong , Yangzhou Du , Wei Hu , Yimin Zhang
CPC分类号: H04N7/157 , G06K9/00302 , H04L12/1827 , H04N7/147 , H04N7/155
摘要: A video communication system that replaces actual live images of the participating users with animated avatars. A method may include initiating communication between a first user device and a remote user device; receiving selection of a new avatar to represent a user of the first user device; identifying a new avatar file for the new avatar in an avatar database associated with the first user device; determining that the new avatar file is not present in a remote avatar database associated with the remote user device; and transmitting the new avatar file to the remote avatar database in response to determining that the new avatar file is not present in the remote avatar database.
-
2.
公开(公告)号:US20140198121A1
公开(公告)日:2014-07-17
申请号:US13997265
申请日:2012-04-09
申请人: Xiaofeng Tong , Wenlong Li , Yangzhou Du , Wei Hu , Jianguo Li , Yimin Zhang
发明人: Xiaofeng Tong , Wenlong Li , Yangzhou Du , Wei Hu , Jianguo Li , Yimin Zhang
IPC分类号: G06T11/60
摘要: A video communication system that replaces actual live images of the participating users with animated avatars. The system allows generation, rendering and animation of a two-dimensional (2-D) avatar of a user's face. The 2-D avatar represents a user's basic face shape and key facial characteristics, including, but not limited to, position and shape of the eyes, nose, mouth, and face contour. The system further allows adaptive rendering for displaying allow different scales of the 2-D avatar to be displayed on associated different sized displays of user devices.
摘要翻译: 视频通信系统,用动画头像代替参与用户的实际实况图像。 该系统允许用户脸部的二维(2-D)头像的生成,呈现和动画。 2-D头像表示用户的基本面部形状和关键面部特征,包括但不限于眼睛,鼻子,嘴巴和脸部轮廓的位置和形状。 该系统进一步允许用于显示的自适应渲染,允许在用户设备的相关联的不同大小的显示器上显示不同比例的2-D化身。
-
公开(公告)号:US20140152758A1
公开(公告)日:2014-06-05
申请号:US13996009
申请日:2012-04-09
申请人: Xiaofeng Tong , Wenlong Li , Yangzhou Du , Wei Hu , Yimin Zhang
发明人: Xiaofeng Tong , Wenlong Li , Yangzhou Du , Wei Hu , Yimin Zhang
CPC分类号: H04N7/157 , G06F3/0482 , G06F3/04883 , G06K9/00255 , G06K9/00268 , G06T13/40 , G10L21/003 , G10L21/013 , H04M1/72555 , H04N7/147
摘要: Generally this disclosure describes a video communication system that replaces actual live images of the participating users with animated avatars. A method may include selecting an avatar; initiating communication; detecting a user input; identifying the user input; identifying an animation command based on the user input; generating avatar parameters; and transmitting at least one of the animation command and the avatar parameters.
摘要翻译: 通常,本公开描述了一种视频通信系统,其使用动画化身替代参与用户的实际实况图像。 方法可以包括选择化身; 发起沟通 检测用户输入; 识别用户输入; 基于用户输入识别动画命令; 生成头像参数; 以及发送动画命令和化身参数中的至少一个。
-
公开(公告)号:US20130271451A1
公开(公告)日:2013-10-17
申请号:US13976869
申请日:2011-08-09
申请人: Xiaofeng Tong , Wei Hu , Yangzhou Du , Yimin Zhang
发明人: Xiaofeng Tong , Wei Hu , Yangzhou Du , Yimin Zhang
IPC分类号: G06T17/00
CPC分类号: G06T17/00
摘要: Systems, devices and methods are described including receiving a semantic description and associated measurement criteria for a facial control parameter, obtaining principal component analysis (PCA) coefficients, generating 3D faces in response to the PCA coefficients, determining a measurement value for each of the 3D faces based on the measurement criteria, and determining a regression parameters for the facial control parameter based on the measurement values.
摘要翻译: 描述了系统,设备和方法,包括接收面部控制参数的语义描述和相关联的测量标准,获得主成分分析(PCA)系数,响应于PCA系数生成3D面,确定3D中每一个的测量值 基于测量标准的面部,以及基于测量值确定面部控制参数的回归参数。
-
公开(公告)号:US10798142B2
公开(公告)日:2020-10-06
申请号:US14128996
申请日:2012-12-10
申请人: Qiang Li , Yangzhou Du , Wenlong Li , Xiaofeng Tong , Wei Hu , Lin Xu , Yimin Zhang
发明人: Qiang Li , Yangzhou Du , Wenlong Li , Xiaofeng Tong , Wei Hu , Lin Xu , Yimin Zhang
IPC分类号: G06F15/16 , H04L29/06 , H04N21/235 , H04N21/242 , H04N21/434 , H04N21/43 , H04N21/435 , H04N21/2368 , G10L19/04
摘要: A device, method and system of video and audio sharing among communication devices, may comprise a communication device for generating and sending a packet containing information related to the video and audio, and another communication device for receiving the packet and rendering the information related to the audio and video. In some embodiments, the communication device may comprise: an audio encoding module to encode a piece of audio into an audio bit stream; an avatar data extraction module to extract avatar data from a piece of video and generate an avatar data bit stream; and a synchronization module to generate synchronization information for synchronizing the audio bit stream with the avatar parameter stream.
-
公开(公告)号:US09386268B2
公开(公告)日:2016-07-05
申请号:US13996009
申请日:2012-04-09
申请人: Xiaofeng Tong , Wenlong Li , Yangzhou Du , Wei Hu , Yimin Zhang
发明人: Xiaofeng Tong , Wenlong Li , Yangzhou Du , Wei Hu , Yimin Zhang
CPC分类号: H04N7/157 , G06F3/0482 , G06F3/04883 , G06K9/00255 , G06K9/00268 , G06T13/40 , G10L21/003 , G10L21/013 , H04M1/72555 , H04N7/147
摘要: Generally this disclosure describes a video communication system that replaces actual live images of the participating users with animated avatars. A method may include selecting an avatar; initiating communication; detecting a user input; identifying the user input; identifying an animation command based on the user input; generating avatar parameters; and transmitting at least one of the animation command and the avatar parameters.
摘要翻译: 通常,本公开描述了一种视频通信系统,其使用动画化身替代参与用户的实际实况图像。 一种方法可以包括选择化身; 发起沟通 检测用户输入; 识别用户输入; 基于用户输入识别动画命令; 生成头像参数; 以及发送动画命令和化身参数中的至少一个。
-
公开(公告)号:US09357174B2
公开(公告)日:2016-05-31
申请号:US13997266
申请日:2012-04-09
申请人: Wenlong Li , Xiaofeng Tong , Yangzhou Du , Wei Hu , Yimin Zhang
发明人: Wenlong Li , Xiaofeng Tong , Yangzhou Du , Wei Hu , Yimin Zhang
IPC分类号: H04N7/14 , H04N7/15 , H04M1/725 , G06F3/0484 , G06F3/0488 , G06K9/00
CPC分类号: H04N7/157 , G06F3/04842 , G06F3/0488 , G06K9/00255 , H04M1/72544 , H04M2250/22 , H04M2250/52
摘要: A video communication system that replaces actual live images of the participating users with animated avatars. A method may include selecting an avatar, initiating communication, capturing an image, detecting a face in the image, extracting features from the face, converting the facial features to avatar parameters, and transmitting at least one of the avatar selection or avatar parameters. The system is configured to allow a user to select a new avatar during active communication with a remote user.
摘要翻译: 视频通信系统,用动画头像代替参与用户的实际实况图像。 方法可以包括选择化身,发起通信,拍摄图像,检测图像中的面部,从脸部提取特征,将面部特征转换成化身参数,以及发送化身选择或化身参数中的至少一个。 该系统被配置为允许用户在与远程用户的主动通信期间选择新的化身。
-
公开(公告)号:US20140267413A1
公开(公告)日:2014-09-18
申请号:US13976039
申请日:2013-03-14
申请人: Yangzhou Du , Wenlong Li , Wei Hu , Xiaofeng Tong , Yimin Zhang
发明人: Yangzhou Du , Wenlong Li , Wei Hu , Xiaofeng Tong , Yimin Zhang
IPC分类号: G06T19/00
CPC分类号: G06K9/00281 , A63F13/213 , A63F13/655 , G06T13/40 , G06T13/80 , G06T2215/16
摘要: Technologies for generating an avatar with a facial expression corresponding to a facial expression of a user include capturing a reference user image of the user on a computing device when the user is expressing a reference facial expression for registration. The computing device generates reference facial measurement data based on the captured reference user image and compares the reference facial measurement data with facial measurement data of a corresponding reference expression of the avatar to generate facial comparison data. After a user has been registered, the computing device captures a real-time facial expression of the user and generates real-time facial measurement data based on the captured real-time image. The computing device applies the facial comparison data to the real-time facial measurement data to generate modified expression data, which is used to generate an avatar with a facial expression corresponding with the facial expression of the user.
摘要翻译: 用于生成具有与用户的面部表情相对应的面部表情的化身的技术包括当用户表达用于注册的参考面部表情时,在计算设备上捕获用户的参考用户图像。 计算装置基于捕获的参考用户图像生成参考面部测量数据,并将参考面部测量数据与化身的对应参考表达式的面部测量数据进行比较以生成面部比较数据。 在用户注册之后,计算设备捕获用户的实时面部表情,并且基于所捕获的实时图像生成实时面部测量数据。 计算装置将面部比较数据应用于实时面部测量数据,以产生修改后的表达数据,该修改的表情数据用于生成具有与用户面部表情相对应的面部表情的化身。
-
9.
公开(公告)号:US20140055554A1
公开(公告)日:2014-02-27
申请号:US13996230
申请日:2012-04-09
申请人: Yangzhou Du , Wenlong Li , Xiaofeng Tong , Wei Hu , Yimin Zhang
发明人: Yangzhou Du , Wenlong Li , Xiaofeng Tong , Wei Hu , Yimin Zhang
CPC分类号: H04N7/157 , G06K9/00248 , G06K9/00255 , G06K9/00268 , G06K9/00281 , G06K9/00308 , G06T13/40 , H04N7/147 , H04N21/4223 , H04N21/44008 , H04N21/4788 , H04N21/8146
摘要: A video communication system that replaces actual live images of the participating users with animated avatars. A method may include selecting an avatar, initiating communication, capturing an image, detecting a face in the image, determining facial characteristics from the face, including eye movement and eyelid movement of a user indicative of direction of user gaze and blinking, respectively, converting the facial features to avatar parameters, and transmitting at least one of the avatar selection or avatar parameters.
摘要翻译: 视频通信系统,用动画头像代替参与用户的实际实况图像。 方法可以包括选择化身,发起通信,拍摄图像,检测图像中的脸部,从脸部确定面部特征,分别包括指示用户注视和闪烁方向的用户的眼睛运动和眼睑移动,转换 面部特征到化身参数,以及发送化身选择或化身参数中的至少一个。
-
公开(公告)号:US20130201187A1
公开(公告)日:2013-08-08
申请号:US13522783
申请日:2011-08-09
申请人: Xiaofeng Tong , Jianguo Li , Wei Hu , Yangzhou Du , Yimin Zhang
发明人: Xiaofeng Tong , Jianguo Li , Wei Hu , Yangzhou Du , Yimin Zhang
IPC分类号: G06T17/00
CPC分类号: G06T17/00 , G06K9/00288 , G06K9/6255 , G06T7/596 , G06T17/20 , G06T2200/08 , G06T2207/30201
摘要: Systems, devices and methods are described including recovering camera parameters and sparse key points for multiple 2D facial images and applying a multi-view stereo process to generate a dense avatar mesh using the camera parameters and sparse key points. The dense avatar mesh may then be used to generate a 3D face model and multi-view texture synthesis may be applied to generate a texture image for the 3D face model.
摘要翻译: 描述了系统,设备和方法,包括恢复用于多个2D面部图像的相机参数和稀疏关键点,并应用多视点立体声处理以使用相机参数和稀疏关键点来生成致密头像网格。 然后可以使用致密的头像网格来生成3D面部模型,并且可以应用多视图纹理合成来生成3D脸部模型的纹理图像。
-
-
-
-
-
-
-
-
-