-
公开(公告)号:US09330483B2
公开(公告)日:2016-05-03
申请号:US13977682
申请日:2011-04-11
申请人: Yangzhou Du , Xiaofeng Tong , Wei Hu , Yimin Zhang
发明人: Yangzhou Du , Xiaofeng Tong , Wei Hu , Yimin Zhang
摘要: A method and apparatus for capturing and representing 3D wireframe, color and shading of facial expressions are provided, wherein the method includes the following steps: storing a plurality of feature data sequences, each of the feature data sequences corresponding to one of the plurality of facial expressions; and retrieving one of the feature data sequences based on user facial feature data; and mapping the retrieved feature data sequence to an avatar face. The method may advantageously provide improvements in execution speed and communications bandwidth.
摘要翻译: 提供了一种用于捕获和表示面部表情的3D线框,颜色和阴影的方法和装置,其中该方法包括以下步骤:存储多个特征数据序列,每个特征数据序列对应于多个面部中的一个 表达; 以及基于用户面部特征数据检索所述特征数据序列之一; 并将所检索的特征数据序列映射到化身脸部。 该方法可以有利地提供执行速度和通信带宽的改进。
-
公开(公告)号:US20160006987A1
公开(公告)日:2016-01-07
申请号:US13977278
申请日:2012-09-06
申请人: Wenlong Li , Xiaofeng Tong , Yangzhou Du , Wei Hu , Yimin Zhang
发明人: Wenlong Li , Xiaofeng Tong , Yangzhou Du , Wei Hu , Yimin Zhang
CPC分类号: H04N7/157 , G06K9/00302 , H04L12/1827 , H04N7/147 , H04N7/155
摘要: A video communication system that replaces actual live images of the participating users with animated avatars. A method may include initiating communication between a first user device and a remote user device; receiving selection of a new avatar to represent a user of the first user device; identifying a new avatar file for the new avatar in an avatar database associated with the first user device; determining that the new avatar file is not present in a remote avatar database associated with the remote user device; and transmitting the new avatar file to the remote avatar database in response to determining that the new avatar file is not present in the remote avatar database.
摘要翻译: 视频通信系统,用动画头像代替参与用户的实际实况图像。 方法可以包括发起第一用户设备和远程用户设备之间的通信; 接收用于表示所述第一用户设备的用户的新化身的选择; 在与所述第一用户设备相关联的化身数据库中识别所述新化身的新头像文件; 确定所述新的化身文件不存在于与所述远程用户设备相关联的远程化身数据库中; 以及响应于确定所述新化身文件不存在于所述远程化身数据库中,将所述新化身文件发送到所述远程化身数据库。
-
公开(公告)号:US20140218371A1
公开(公告)日:2014-08-07
申请号:US13997271
申请日:2012-12-17
申请人: Yangzhou Du , Wenlong Li , Xiaofeng Tong , Wei Hu , Yimin Zhang
发明人: Yangzhou Du , Wenlong Li , Xiaofeng Tong , Wei Hu , Yimin Zhang
IPC分类号: G06T13/80
CPC分类号: G06T13/40 , G06K9/00315 , G06T13/80 , H04N7/157
摘要: Avatars are animated using predetermined avatar images that are selected based on facial features of a user extracted from video of the user. A user's facial features are tracked in a live video, facial feature parameters are determined from the tracked features, and avatar images are selected based on the facial feature parameters. The selected images are then displayed are sent to another device for display. Selecting and displaying different avatar images as a user's facial movements change animates the avatar. An avatar image can be selected from a series of avatar images representing a particular facial movement, such as blinking. An avatar image can also be generated from multiple avatar feature images selected from multiple avatar feature image series associated with different regions of a user's face (eyes, mouth, nose, eyebrows), which allows different regions of the avatar to be animated independently.
摘要翻译: 使用基于从用户的视频提取的用户的面部特征来选择的预定化身图像来动画化身。 在实时视频中跟踪用户的面部特征,根据跟踪的特征确定面部特征参数,并且基于面部特征参数选择头像图像。 然后将所选择的图像显示发送到另一个设备进行显示。 选择和显示不同的头像图像作为用户的面部动作变化动画化身。 可以从代表特定面部运动的一系列化身图像中选择化身图像,例如闪烁。 还可以从从用户脸部(眼睛,嘴,鼻,眉毛)的不同区域相关联的多个化身特征图像系列中选择的多个化身特征图像中生成化身图像,其允许化身的不同区域独立地动画化。
-
公开(公告)号:US20140035934A1
公开(公告)日:2014-02-06
申请号:US13977682
申请日:2011-04-11
申请人: Yangzhou Du , Xiaofeng Tong , Wei Hu , Yimin Zhang
发明人: Yangzhou Du , Xiaofeng Tong , Wei Hu , Yimin Zhang
IPC分类号: G06T13/40
摘要: A method and apparatus for capturing and representing 3D wire-frame, color and shading of facial expressions are provided, wherein the method includes the following steps: storing a plurality of feature data sequences, each of the feature data sequences corresponding to one of the plurality of facial expressions; and retrieving one of the feature data sequences based on user facial feature data; and mapping the retrieved feature data sequence to an avatar face. The method may advantageously provide improvements in execution speed and communications bandwidth.
摘要翻译: 提供了一种用于捕获和表示面部表情的3D线框,颜色和阴影的方法和装置,其中该方法包括以下步骤:存储多个特征数据序列,每个特征数据序列对应于多个 的面部表情; 以及基于用户面部特征数据检索所述特征数据序列之一; 并将所检索的特征数据序列映射到化身脸部。 该方法可以有利地提供执行速度和通信带宽的改进。
-
公开(公告)号:US10798142B2
公开(公告)日:2020-10-06
申请号:US14128996
申请日:2012-12-10
申请人: Qiang Li , Yangzhou Du , Wenlong Li , Xiaofeng Tong , Wei Hu , Lin Xu , Yimin Zhang
发明人: Qiang Li , Yangzhou Du , Wenlong Li , Xiaofeng Tong , Wei Hu , Lin Xu , Yimin Zhang
IPC分类号: G06F15/16 , H04L29/06 , H04N21/235 , H04N21/242 , H04N21/434 , H04N21/43 , H04N21/435 , H04N21/2368 , G10L19/04
摘要: A device, method and system of video and audio sharing among communication devices, may comprise a communication device for generating and sending a packet containing information related to the video and audio, and another communication device for receiving the packet and rendering the information related to the audio and video. In some embodiments, the communication device may comprise: an audio encoding module to encode a piece of audio into an audio bit stream; an avatar data extraction module to extract avatar data from a piece of video and generate an avatar data bit stream; and a synchronization module to generate synchronization information for synchronizing the audio bit stream with the avatar parameter stream.
-
公开(公告)号:US09386268B2
公开(公告)日:2016-07-05
申请号:US13996009
申请日:2012-04-09
申请人: Xiaofeng Tong , Wenlong Li , Yangzhou Du , Wei Hu , Yimin Zhang
发明人: Xiaofeng Tong , Wenlong Li , Yangzhou Du , Wei Hu , Yimin Zhang
CPC分类号: H04N7/157 , G06F3/0482 , G06F3/04883 , G06K9/00255 , G06K9/00268 , G06T13/40 , G10L21/003 , G10L21/013 , H04M1/72555 , H04N7/147
摘要: Generally this disclosure describes a video communication system that replaces actual live images of the participating users with animated avatars. A method may include selecting an avatar; initiating communication; detecting a user input; identifying the user input; identifying an animation command based on the user input; generating avatar parameters; and transmitting at least one of the animation command and the avatar parameters.
摘要翻译: 通常,本公开描述了一种视频通信系统,其使用动画化身替代参与用户的实际实况图像。 一种方法可以包括选择化身; 发起沟通 检测用户输入; 识别用户输入; 基于用户输入识别动画命令; 生成头像参数; 以及发送动画命令和化身参数中的至少一个。
-
公开(公告)号:US09357174B2
公开(公告)日:2016-05-31
申请号:US13997266
申请日:2012-04-09
申请人: Wenlong Li , Xiaofeng Tong , Yangzhou Du , Wei Hu , Yimin Zhang
发明人: Wenlong Li , Xiaofeng Tong , Yangzhou Du , Wei Hu , Yimin Zhang
IPC分类号: H04N7/14 , H04N7/15 , H04M1/725 , G06F3/0484 , G06F3/0488 , G06K9/00
CPC分类号: H04N7/157 , G06F3/04842 , G06F3/0488 , G06K9/00255 , H04M1/72544 , H04M2250/22 , H04M2250/52
摘要: A video communication system that replaces actual live images of the participating users with animated avatars. A method may include selecting an avatar, initiating communication, capturing an image, detecting a face in the image, extracting features from the face, converting the facial features to avatar parameters, and transmitting at least one of the avatar selection or avatar parameters. The system is configured to allow a user to select a new avatar during active communication with a remote user.
摘要翻译: 视频通信系统,用动画头像代替参与用户的实际实况图像。 方法可以包括选择化身,发起通信,拍摄图像,检测图像中的面部,从脸部提取特征,将面部特征转换成化身参数,以及发送化身选择或化身参数中的至少一个。 该系统被配置为允许用户在与远程用户的主动通信期间选择新的化身。
-
公开(公告)号:US20140267413A1
公开(公告)日:2014-09-18
申请号:US13976039
申请日:2013-03-14
申请人: Yangzhou Du , Wenlong Li , Wei Hu , Xiaofeng Tong , Yimin Zhang
发明人: Yangzhou Du , Wenlong Li , Wei Hu , Xiaofeng Tong , Yimin Zhang
IPC分类号: G06T19/00
CPC分类号: G06K9/00281 , A63F13/213 , A63F13/655 , G06T13/40 , G06T13/80 , G06T2215/16
摘要: Technologies for generating an avatar with a facial expression corresponding to a facial expression of a user include capturing a reference user image of the user on a computing device when the user is expressing a reference facial expression for registration. The computing device generates reference facial measurement data based on the captured reference user image and compares the reference facial measurement data with facial measurement data of a corresponding reference expression of the avatar to generate facial comparison data. After a user has been registered, the computing device captures a real-time facial expression of the user and generates real-time facial measurement data based on the captured real-time image. The computing device applies the facial comparison data to the real-time facial measurement data to generate modified expression data, which is used to generate an avatar with a facial expression corresponding with the facial expression of the user.
摘要翻译: 用于生成具有与用户的面部表情相对应的面部表情的化身的技术包括当用户表达用于注册的参考面部表情时,在计算设备上捕获用户的参考用户图像。 计算装置基于捕获的参考用户图像生成参考面部测量数据,并将参考面部测量数据与化身的对应参考表达式的面部测量数据进行比较以生成面部比较数据。 在用户注册之后,计算设备捕获用户的实时面部表情,并且基于所捕获的实时图像生成实时面部测量数据。 计算装置将面部比较数据应用于实时面部测量数据,以产生修改后的表达数据,该修改的表情数据用于生成具有与用户面部表情相对应的面部表情的化身。
-
公开(公告)号:US09936165B2
公开(公告)日:2018-04-03
申请号:US13977278
申请日:2012-09-06
申请人: Wenlong Li , Xiaofeng Tong , Yangzhou Du , Wei Hu , Yimin Zhang
发明人: Wenlong Li , Xiaofeng Tong , Yangzhou Du , Wei Hu , Yimin Zhang
CPC分类号: H04N7/157 , G06K9/00302 , H04L12/1827 , H04N7/147 , H04N7/155
摘要: A video communication system that replaces actual live images of the participating users with animated avatars. A method may include initiating communication between a first user device and a remote user device; receiving selection of a new avatar to represent a user of the first user device; identifying a new avatar file for the new avatar in an avatar database associated with the first user device; determining that the new avatar file is not present in a remote avatar database associated with the remote user device; and transmitting the new avatar file to the remote avatar database in response to determining that the new avatar file is not present in the remote avatar database.
-
10.
公开(公告)号:US20140198121A1
公开(公告)日:2014-07-17
申请号:US13997265
申请日:2012-04-09
申请人: Xiaofeng Tong , Wenlong Li , Yangzhou Du , Wei Hu , Jianguo Li , Yimin Zhang
发明人: Xiaofeng Tong , Wenlong Li , Yangzhou Du , Wei Hu , Jianguo Li , Yimin Zhang
IPC分类号: G06T11/60
摘要: A video communication system that replaces actual live images of the participating users with animated avatars. The system allows generation, rendering and animation of a two-dimensional (2-D) avatar of a user's face. The 2-D avatar represents a user's basic face shape and key facial characteristics, including, but not limited to, position and shape of the eyes, nose, mouth, and face contour. The system further allows adaptive rendering for displaying allow different scales of the 2-D avatar to be displayed on associated different sized displays of user devices.
摘要翻译: 视频通信系统,用动画头像代替参与用户的实际实况图像。 该系统允许用户脸部的二维(2-D)头像的生成,呈现和动画。 2-D头像表示用户的基本面部形状和关键面部特征,包括但不限于眼睛,鼻子,嘴巴和脸部轮廓的位置和形状。 该系统进一步允许用于显示的自适应渲染,允许在用户设备的相关联的不同大小的显示器上显示不同比例的2-D化身。
-
-
-
-
-
-
-
-
-