-
公开(公告)号:US09589357B2
公开(公告)日:2017-03-07
申请号:US14127457
申请日:2013-06-04
申请人: INTEL CORPORATION , Wenlong Li , Yangzhou Du , Xiaofeng Tong
发明人: Wenlong Li , Yangzhou Du , Xiaofeng Tong
CPC分类号: G06T7/73 , G06K9/00281 , G06K9/00315 , G06T13/40 , G06T13/80 , G06T2207/30201 , H04N7/147 , H04N7/157
摘要: Techniques are disclosed for performing avatar-based video encoding. In some embodiments, a video recording of an individual may be encoded utilizing an avatar that is driven by the facial expression(s) of the individual. In some such cases, the resultant avatar animation may accurately mimic facial expression(s) of the recorded individual. Some embodiments can be used, for example, in video sharing via social media and networking websites. Some embodiments can be used, for example, in video-based communications (e.g., peer-to-peer video calls; videoconferencing). In some instances, use to the disclosed techniques may help to reduce communications bandwidth use, preserve the individual's anonymity, and/or provide enhanced entertainment value (e.g., amusement) for the individual, for example.
摘要翻译: 公开了用于执行基于图像的视频编码的技术。 在一些实施例中,可以使用由个人的面部表情驱动的头像来编码个人的视频记录。 在某些这种情况下,所得到的化身动画可以准确地模拟记录的个人的面部表情。 一些实施例可以用于例如通过社交媒体和网络网站的视频共享。 一些实施例可以用于例如基于视频的通信(例如,对等视频通话;视频会议)中。 在某些情况下,例如,使用所公开的技术可以有助于减少个人的通信带宽使用,保留个人的匿名性和/或提供增强的娱乐价值(例如,娱乐)。
-
公开(公告)号:US20150213604A1
公开(公告)日:2015-07-30
申请号:US14127457
申请日:2013-06-04
申请人: Wenlong LI , Yangzhou DU , Xiaofeng TONG , INTEL CORPORATION
发明人: Wenlong Li , Yangzhou Du , Xiaofeng Tong
CPC分类号: G06T7/73 , G06K9/00281 , G06K9/00315 , G06T13/40 , G06T13/80 , G06T2207/30201 , H04N7/147 , H04N7/157
摘要: Techniques are disclosed for performing avatar-based video encoding. In some embodiments, a video recording of an individual may be encoded utilizing an avatar that is driven by the facial expression(s) of the individual. In some such cases, the resultant avatar animation may accurately mimic facial expression(s) of the recorded individual. Some embodiments can be used, for example, in video sharing via social media and networking websites. Some embodiments can be used, for example, in video-based communications (e.g., peer-to-peer video calls; videoconferencing). In some instances, use to the disclosed techniques may help to reduce communications bandwidth use, preserve the individual's anonymity, and/or provide enhanced entertainment value (e.g., amusement) for the individual, for example.
摘要翻译: 公开了用于执行基于图像的视频编码的技术。 在一些实施例中,可以使用由个人的面部表情驱动的头像来编码个人的视频记录。 在某些这种情况下,所得到的化身动画可以准确地模拟记录的个人的面部表情。 一些实施例可以用于例如通过社交媒体和网络网站的视频共享。 一些实施例可以用于例如基于视频的通信(例如,对等视频通话;视频会议)中。 在某些情况下,例如,使用所公开的技术可以有助于减少个人的通信带宽使用,保留个人的匿名性和/或提供增强的娱乐价值(例如,娱乐)。
-
公开(公告)号:US20160006987A1
公开(公告)日:2016-01-07
申请号:US13977278
申请日:2012-09-06
申请人: Wenlong Li , Xiaofeng Tong , Yangzhou Du , Wei Hu , Yimin Zhang
发明人: Wenlong Li , Xiaofeng Tong , Yangzhou Du , Wei Hu , Yimin Zhang
CPC分类号: H04N7/157 , G06K9/00302 , H04L12/1827 , H04N7/147 , H04N7/155
摘要: A video communication system that replaces actual live images of the participating users with animated avatars. A method may include initiating communication between a first user device and a remote user device; receiving selection of a new avatar to represent a user of the first user device; identifying a new avatar file for the new avatar in an avatar database associated with the first user device; determining that the new avatar file is not present in a remote avatar database associated with the remote user device; and transmitting the new avatar file to the remote avatar database in response to determining that the new avatar file is not present in the remote avatar database.
摘要翻译: 视频通信系统,用动画头像代替参与用户的实际实况图像。 方法可以包括发起第一用户设备和远程用户设备之间的通信; 接收用于表示所述第一用户设备的用户的新化身的选择; 在与所述第一用户设备相关联的化身数据库中识别所述新化身的新头像文件; 确定所述新的化身文件不存在于与所述远程用户设备相关联的远程化身数据库中; 以及响应于确定所述新化身文件不存在于所述远程化身数据库中,将所述新化身文件发送到所述远程化身数据库。
-
公开(公告)号:US20140218371A1
公开(公告)日:2014-08-07
申请号:US13997271
申请日:2012-12-17
申请人: Yangzhou Du , Wenlong Li , Xiaofeng Tong , Wei Hu , Yimin Zhang
发明人: Yangzhou Du , Wenlong Li , Xiaofeng Tong , Wei Hu , Yimin Zhang
IPC分类号: G06T13/80
CPC分类号: G06T13/40 , G06K9/00315 , G06T13/80 , H04N7/157
摘要: Avatars are animated using predetermined avatar images that are selected based on facial features of a user extracted from video of the user. A user's facial features are tracked in a live video, facial feature parameters are determined from the tracked features, and avatar images are selected based on the facial feature parameters. The selected images are then displayed are sent to another device for display. Selecting and displaying different avatar images as a user's facial movements change animates the avatar. An avatar image can be selected from a series of avatar images representing a particular facial movement, such as blinking. An avatar image can also be generated from multiple avatar feature images selected from multiple avatar feature image series associated with different regions of a user's face (eyes, mouth, nose, eyebrows), which allows different regions of the avatar to be animated independently.
摘要翻译: 使用基于从用户的视频提取的用户的面部特征来选择的预定化身图像来动画化身。 在实时视频中跟踪用户的面部特征,根据跟踪的特征确定面部特征参数,并且基于面部特征参数选择头像图像。 然后将所选择的图像显示发送到另一个设备进行显示。 选择和显示不同的头像图像作为用户的面部动作变化动画化身。 可以从代表特定面部运动的一系列化身图像中选择化身图像,例如闪烁。 还可以从从用户脸部(眼睛,嘴,鼻,眉毛)的不同区域相关联的多个化身特征图像系列中选择的多个化身特征图像中生成化身图像,其允许化身的不同区域独立地动画化。
-
5.
公开(公告)号:US20130276007A1
公开(公告)日:2013-10-17
申请号:US13994761
申请日:2011-09-12
申请人: Wenlong Li , Yangzhou Du , Jianguo Li , Xiaofeng Tong , Peng Wang
发明人: Wenlong Li , Yangzhou Du , Jianguo Li , Xiaofeng Tong , Peng Wang
IPC分类号: H04N21/442
CPC分类号: H04N21/44218 , G06Q50/01
摘要: Video analysis may be used to determine who is watching television and their level of interest in the current programming. Lists of favorite programs may be derived for each of a plurality of viewers of programming on the same television receiver.
摘要翻译: 视频分析可用于确定正在看电视的人和他们在当前节目中的兴趣程度。 可以针对同一电视接收机上的多个编程观看者中的每一个导出最喜欢节目的列表。
-
公开(公告)号:US10798142B2
公开(公告)日:2020-10-06
申请号:US14128996
申请日:2012-12-10
申请人: Qiang Li , Yangzhou Du , Wenlong Li , Xiaofeng Tong , Wei Hu , Lin Xu , Yimin Zhang
发明人: Qiang Li , Yangzhou Du , Wenlong Li , Xiaofeng Tong , Wei Hu , Lin Xu , Yimin Zhang
IPC分类号: G06F15/16 , H04L29/06 , H04N21/235 , H04N21/242 , H04N21/434 , H04N21/43 , H04N21/435 , H04N21/2368 , G10L19/04
摘要: A device, method and system of video and audio sharing among communication devices, may comprise a communication device for generating and sending a packet containing information related to the video and audio, and another communication device for receiving the packet and rendering the information related to the audio and video. In some embodiments, the communication device may comprise: an audio encoding module to encode a piece of audio into an audio bit stream; an avatar data extraction module to extract avatar data from a piece of video and generate an avatar data bit stream; and a synchronization module to generate synchronization information for synchronizing the audio bit stream with the avatar parameter stream.
-
公开(公告)号:US09386268B2
公开(公告)日:2016-07-05
申请号:US13996009
申请日:2012-04-09
申请人: Xiaofeng Tong , Wenlong Li , Yangzhou Du , Wei Hu , Yimin Zhang
发明人: Xiaofeng Tong , Wenlong Li , Yangzhou Du , Wei Hu , Yimin Zhang
CPC分类号: H04N7/157 , G06F3/0482 , G06F3/04883 , G06K9/00255 , G06K9/00268 , G06T13/40 , G10L21/003 , G10L21/013 , H04M1/72555 , H04N7/147
摘要: Generally this disclosure describes a video communication system that replaces actual live images of the participating users with animated avatars. A method may include selecting an avatar; initiating communication; detecting a user input; identifying the user input; identifying an animation command based on the user input; generating avatar parameters; and transmitting at least one of the animation command and the avatar parameters.
摘要翻译: 通常,本公开描述了一种视频通信系统,其使用动画化身替代参与用户的实际实况图像。 一种方法可以包括选择化身; 发起沟通 检测用户输入; 识别用户输入; 基于用户输入识别动画命令; 生成头像参数; 以及发送动画命令和化身参数中的至少一个。
-
公开(公告)号:US09357174B2
公开(公告)日:2016-05-31
申请号:US13997266
申请日:2012-04-09
申请人: Wenlong Li , Xiaofeng Tong , Yangzhou Du , Wei Hu , Yimin Zhang
发明人: Wenlong Li , Xiaofeng Tong , Yangzhou Du , Wei Hu , Yimin Zhang
IPC分类号: H04N7/14 , H04N7/15 , H04M1/725 , G06F3/0484 , G06F3/0488 , G06K9/00
CPC分类号: H04N7/157 , G06F3/04842 , G06F3/0488 , G06K9/00255 , H04M1/72544 , H04M2250/22 , H04M2250/52
摘要: A video communication system that replaces actual live images of the participating users with animated avatars. A method may include selecting an avatar, initiating communication, capturing an image, detecting a face in the image, extracting features from the face, converting the facial features to avatar parameters, and transmitting at least one of the avatar selection or avatar parameters. The system is configured to allow a user to select a new avatar during active communication with a remote user.
摘要翻译: 视频通信系统,用动画头像代替参与用户的实际实况图像。 方法可以包括选择化身,发起通信,拍摄图像,检测图像中的面部,从脸部提取特征,将面部特征转换成化身参数,以及发送化身选择或化身参数中的至少一个。 该系统被配置为允许用户在与远程用户的主动通信期间选择新的化身。
-
公开(公告)号:US20140267413A1
公开(公告)日:2014-09-18
申请号:US13976039
申请日:2013-03-14
申请人: Yangzhou Du , Wenlong Li , Wei Hu , Xiaofeng Tong , Yimin Zhang
发明人: Yangzhou Du , Wenlong Li , Wei Hu , Xiaofeng Tong , Yimin Zhang
IPC分类号: G06T19/00
CPC分类号: G06K9/00281 , A63F13/213 , A63F13/655 , G06T13/40 , G06T13/80 , G06T2215/16
摘要: Technologies for generating an avatar with a facial expression corresponding to a facial expression of a user include capturing a reference user image of the user on a computing device when the user is expressing a reference facial expression for registration. The computing device generates reference facial measurement data based on the captured reference user image and compares the reference facial measurement data with facial measurement data of a corresponding reference expression of the avatar to generate facial comparison data. After a user has been registered, the computing device captures a real-time facial expression of the user and generates real-time facial measurement data based on the captured real-time image. The computing device applies the facial comparison data to the real-time facial measurement data to generate modified expression data, which is used to generate an avatar with a facial expression corresponding with the facial expression of the user.
摘要翻译: 用于生成具有与用户的面部表情相对应的面部表情的化身的技术包括当用户表达用于注册的参考面部表情时,在计算设备上捕获用户的参考用户图像。 计算装置基于捕获的参考用户图像生成参考面部测量数据,并将参考面部测量数据与化身的对应参考表达式的面部测量数据进行比较以生成面部比较数据。 在用户注册之后,计算设备捕获用户的实时面部表情,并且基于所捕获的实时图像生成实时面部测量数据。 计算装置将面部比较数据应用于实时面部测量数据,以产生修改后的表达数据,该修改的表情数据用于生成具有与用户面部表情相对应的面部表情的化身。
-
10.
公开(公告)号:US20160005206A1
公开(公告)日:2016-01-07
申请号:US13997259
申请日:2013-03-29
申请人: Wenlong Li , Xiaofeng Tong , Yangzhou Du , THOMAS SACHSON , YUNZHEN WANG
发明人: Wenlong Li , Xiaofeng Tong , Yangzhou Du , THOMAS SACHSON , YUNZHEN WANG
CPC分类号: G06T13/80 , G06K9/00268 , G06T7/20 , G06T13/40 , G09G5/003 , G09G2370/022 , H04N7/157 , H04N2007/145
摘要: Systems and methods may provide for detecting a condition with respect to one or more frames of a video signal associated with a set of facial motion data and modifying, in response to the condition, the set of facial motion data to indicate that the one or more frames lack facial motion data. Additionally, an avatar animation may be initiated based on the modified set of facial motion data. In one example, the condition is one or more of a buffer overflow condition and a tracking failure condition.
摘要翻译: 系统和方法可以提供用于检测与一组面部运动数据相关联的视频信号的一个或多个帧的状况,并且响应于该状况修改一组面部运动数据以指示该一个或多个 帧缺少面部运动数据。 另外,可以基于经修改的面部运动数据集来启动头像动画。 在一个示例中,条件是缓冲器溢出条件和跟踪失败条件中的一个或多个。
-
-
-
-
-
-
-
-
-