AVATAR FACIAL EXPRESSION AND/OR SPEECH DRIVEN ANIMATIONS
    1.
    发明申请
    AVATAR FACIAL EXPRESSION AND/OR SPEECH DRIVEN ANIMATIONS 审中-公开
    AVATAR FACIAL EXPRESSION和/或语音驱动动画

    公开(公告)号:WO2016154800A1

    公开(公告)日:2016-10-06

    申请号:PCT/CN2015/075227

    申请日:2015-03-27

    Abstract: Apparatuses, methods and storage medium associated with animating and rendering an avatar are disclosed herein. In embodiments, an apparatus may include a facial expression and speech tracker to respectively receive a plurality of image frames and audio of a user, and analyze the image frames and the audio to determine and track facial expressions and speech of the user. The tracker may further select a plurality of blend shapes, including assignment of weights of the blend shapes, for animating the avatar, based on tracked facial expressions or speech of the user. The tracker may select the plurality of blend shapes, including assignment of weights of the blend shapes, based on the tracked speech of the user, when visual conditions for tracking facial expressions of the user are determined to be below a quality threshold. Other embodiments may be disclosed and/or claimed.

    Abstract translation: 本文公开了与动画和呈现化身相关联的装置,方法和存储介质。 在实施例中,设备可以包括面部表情和语音跟踪器,以分别接收用户的多个图像帧和音频,并且分析图像帧和音频以确定和跟踪用户的面部表情和语音。 跟踪器还可以基于跟踪的用户的面部表情或语音来选择多个混合形状,包括分配混合形状的权重,以便动画化身化身。 当确定用于跟踪用户面部表情的视觉条件低于质量阈值时,跟踪器可以基于用户的跟踪语音来选择多个混合形状,包括分配混合形状的权重。 可以公开和/或要求保护其他实施例。

    FACILITATING EFFICIENT FREE IN-PLANE ROTATION LANDMARK TRACKING OF IMAGES ON COMPUTING DEVICES
    2.
    发明申请
    FACILITATING EFFICIENT FREE IN-PLANE ROTATION LANDMARK TRACKING OF IMAGES ON COMPUTING DEVICES 审中-公开
    在计算机设备上实现有效的免费平面内旋转图像跟踪

    公开(公告)号:WO2016045050A1

    公开(公告)日:2016-03-31

    申请号:PCT/CN2014/087426

    申请日:2014-09-25

    Abstract: A mechanism is described for facilitating efficient free in-plane rotation landmark tracking of images on computing devices according to one embodiment. A method of embodiments, as described herein, includes detecting a first frame having a first image and a second frame having a second image, where the second image is rotated to a position away from the first image. The method may further include assigning a first parameter line and a second parameter line to the second image based on landmark positions associated with the first and second images, detecting a rotation angle between the first parameter line and the second parameter line, and rotating the second image back and forth within a distance associated with the rotation angle to verify positions of the first and second images.

    Abstract translation: 描述了根据一个实施例的用于促进计算设备上的图像的有效的自由面内旋转地标跟踪的机构。 如本文所述的实施例的方法包括检测具有第一图像的第一帧和具有第二图像的第二帧,其中第二图像旋转到远离第一图像的位置。 该方法还可以包括基于与第一和第二图像相关联的界标位置向第二图像分配第一参数线和第二参数线,检测第一参数线和第二参数线之间的旋转角度,以及旋转第二参数线 在与旋转角度相关联的距离内来回显示图像,以验证第一和第二图像的位置。

    AVATAR AUDIO COMMUNICATION SYSTEMS AND TECHNIQUES
    3.
    发明申请
    AVATAR AUDIO COMMUNICATION SYSTEMS AND TECHNIQUES 审中-公开
    AVATAR音频通信系统和技术

    公开(公告)号:WO2016045015A1

    公开(公告)日:2016-03-31

    申请号:PCT/CN2014/087313

    申请日:2014-09-24

    Abstract: Examples of systems and methods for transmitting avatar sequencing data in an audio file are generally described herein. A method can include receiving, at a second device from a first device, an audio file comprising: facial motion data, the facial motion data derived from a series of facial images captured at the first device, an avatar sequencing data structure from the first device, the avatar sequencing data structure comprising an avatar identifier and a duration, and an audio stream. The method can include presenting an animation of an avatar, at the second device, using the facial motion data and the audio stream.

    Abstract translation: 这里通常描述用于在音频文件中传送头像排序数据的系统和方法的示例。 一种方法可以包括在第二设备处从第一设备接收音频文件,该音频文件包括:面部运动数据,从在第一设备捕获的一系列面部图像导出的面部运动数据,来自第一设备的头像排序数据结构 包括化身标识符和持续时间的头像排序数据结构和音频流。 该方法可以包括使用面部运动数据和音频流在第二设备处呈现化身的动画。

    DETERMINATION OF AUGMENTED REALITY INFORMATION
    4.
    发明申请
    DETERMINATION OF AUGMENTED REALITY INFORMATION 审中-公开
    确定已实现的现实信息

    公开(公告)号:WO2014047876A1

    公开(公告)日:2014-04-03

    申请号:PCT/CN2012/082311

    申请日:2012-09-28

    Abstract: Systems and methods may provide for obtaining or implementing augmented reality information. A logic architecture may be employed to detect a low acceleration condition with respect to an image capture device. The logic architecture may select data from a video associated with the image capture device in response to the low acceleration condition. The logic architecture may also use the data to obtain augmented reality information for the video. Additionally, the logic architecture may modify the video with the augmented reality information, or may display the video with the augmented reality information.

    Abstract translation: 系统和方法可以提供用于获得或实现增强现实信息。 可以采用逻辑架构来检测相对于图像捕获装置的低加速度状况。 逻辑架构可以响应于低加速度条件从与图像捕获装置相关联的视频中选择数据。 逻辑架构还可以使用数据来获得视频的增强现实信息。 此外,逻辑架构可以利用增强现实信息来修改视频,或者可以用增强的现实信息来显示视频。

    CONTENT-BASED CONTROL SYSTEM
    7.
    发明申请
    CONTENT-BASED CONTROL SYSTEM 审中-公开
    基于内容的控制系统

    公开(公告)号:WO2013097232A1

    公开(公告)日:2013-07-04

    申请号:PCT/CN2011/085172

    申请日:2011-12-31

    Abstract: Generally this disclosure describes a method for controlling the operation of a system based on a determination of content that is airing on a channel. A method may include transmitting at least one message including instructions to sample content from a channel, receiving a message indicating that certain content on the channel is complete, and activating a notification indicating that the certain content on the channel is complete. Another method may include receiving a message including instructions to sample content from a channel, sampling content from the channel, transmitting a message including the content sample, receiving a message comprising information related to the content sample, and determining whether certain content is complete on the channel based on the received information.

    Abstract translation: 通常,本公开描述了一种用于基于在通道上播放的内容的确定来控制系统的操作的方法。 一种方法可以包括发送至少一个消息,包括从信道中采样内容的指令,接收指示信道上的某些内容完成的消息,以及激活指示信道上的某些内容完成的通知。 另一种方法可以包括接收包括从信道中采样内容的指令的消息,从信道采样内容,发送包括内容样本的消息,接收包括与内容样本有关的信息的消息,以及确定是否在 基于接收到的信息。

    USER GESTURE DRIVEN AVATAR APPARATUS AND METHOD
    9.
    发明申请
    USER GESTURE DRIVEN AVATAR APPARATUS AND METHOD 审中-公开
    用户手册驱动的AVATAR装置和方法

    公开(公告)号:WO2016045005A1

    公开(公告)日:2016-03-31

    申请号:PCT/CN2014/087248

    申请日:2014-09-24

    Abstract: Apparatuses, methods and storage medium associated with animating and rendering an avatar are disclosed herein. In embodiments, the apparatus may include a gesture tracker and an animation engine. The gesture tracker may be configured to detect and track a user gesture that corresponds to a canned facial expression, the user gesture including a duration component corresponding to a duration the canned facial expression is to be animated. Further, the gesture tracker may be configured to respond to a detection and tracking of the user gesture, and output one or more animation messages that describe the detected/tracked user gesture or identify the canned facial expression, and the duration. The animation engine may be configured to receive the one or more animation messages, and drive an avatar model, in accordance with the one or more animation messages, to animate the avatar with animation of the canned facial expressions for the duration. Other embodiments may be described and/or claimed.

    Abstract translation: 本文公开了与动画和呈现化身相关联的装置,方法和存储介质。 在实施例中,设备可以包括手势跟踪器和动画引擎。 手势跟踪器可以被配置为检测和跟踪对应于罐头面部表情的用户手势,所述用户手势包括对应于罐头面部表情将被动画化的持续时间的持续时间分量。 此外,手势跟踪器可以被配置为响应用户手势的检测和跟踪,并且输出描述所检测/跟踪的用户手势或识别罐头面部表情以及持续时间的一个或多个动画消息。 动画引擎可以被配置为接收一个或多个动画消息,并且根据一个或多个动画消息来驱动头像模型,以在持续时间内用罐头的面部表情的动画来动画化身。 可以描述和/或要求保护其他实施例。

    3D FACE MODEL RECONSTRUCTION APPARATUS AND METHOD
    10.
    发明申请
    3D FACE MODEL RECONSTRUCTION APPARATUS AND METHOD 审中-公开
    3D脸部模型重建装置和方法

    公开(公告)号:WO2015192369A1

    公开(公告)日:2015-12-23

    申请号:PCT/CN2014/080382

    申请日:2014-06-20

    Abstract: Apparatuses, methods and storage medium associated with 3D face model reconstruction are disclosed herein. In embodiments, an apparatus may include a facial landmark detector, a model fitter and a model tracker. The facial landmark detector may be configured to detect a plurality of landmarks of a face and their locations within each of a plurality of image frames. The model fitter may be configured to generate a 3D model of the face from a 3D model of a neutral face, in view of detected landmarks of the face and their locations within a first one of the plurality of image frames. The model tracker may be configured to maintain the 3D model to track the face in subsequent image frames, successively updating the 3D model in view of detected landmarks of the face and their locations within each of successive ones of the plurality of image frames. In embodiments, the facial landmark detector may include a face detector, an initial facial landmark detector, and one or more facial landmark detection linear regressors. Other embodiments may be described and/or claimed.

    Abstract translation: 本文公开了与3D脸部模型重建相关联的装置,方法和存储介质。 在实施例中,装置可以包括面部地标检测器,模型装配器和模型跟踪器。 面部地标检测器可以被配置为检测面部的多个界标及其在多个图像帧的每一个内的位置。 考虑到检测到的面部的标记及其在多个图像帧的第一个图像帧中的位置,模型拟合器可以被配置为从中立面的3D模型生成面部的3D模型。 模型跟踪器可以被配置为维持3D模型以跟踪后续图像帧中的面部,从而考虑到检测到的面部的界标及其在多个图像帧中的每个连续图像帧中的位置之间的连续更新3D模型。 在实施例中,面部地标检测器可以包括面部检测器,初始面部地标检测器和一个或多个面部地标检测线性回归器。 可以描述和/或要求保护其他实施例。

Patent Agency Ranking