SIMULATING THE MOTION OF COMPLEX OBJECTS IN RESPONSE TO CONNECTED STRUCTURE MOTION

    公开(公告)号:US20190035133A1

    公开(公告)日:2019-01-31

    申请号:US16071502

    申请日:2016-03-17

    Abstract: In response to movement of an underlying structure, motion of complex objects connected to that structure may be simulated relatively quickly and without requiring extensive processing capabilities. A skeleton extraction method is used to simplify the complex object. Tracking is used to track the motion of the underlying structure, such as the user's head in a case where motion of hair is being simulated. Thus, the simulated motion is driven in response to the extent and direction of head or facial movement. A mass-spring model may be used to accelerate the simulation in some embodiments.

    AUTOMATIC POINT CLOUD VALIDATION FOR IMMERSIVE MEDIA

    公开(公告)号:US20220172429A1

    公开(公告)日:2022-06-02

    申请号:US17436481

    申请日:2019-05-14

    Abstract: Techniques related to validating an image based 3D model of a scene are discussed. Such techniques include detecting an object within a captured image used to generate the scene, projecting the 3D model to a view corresponding to the captured image to generate a reconstructed image, and comparing image regions of the captured and reconstructed images corresponding to the object to validate the 3D model.

    AVATAR KEYBOARD
    17.
    发明申请
    AVATAR KEYBOARD 审中-公开
    AVATAR键盘

    公开(公告)号:US20170046065A1

    公开(公告)日:2017-02-16

    申请号:US14916930

    申请日:2015-04-07

    Abstract: Apparatuses, methods and storage medium associated with the provision of an avatar keyboard to a communication/computing device are disclosed herein. In embodiments, an apparatus for communicating may comprise one or more processors to execute an application; and a keyboard module coupled with the one or more processor to provide a plurality of keyboards in a corresponding plurality of keyboard modes for inputting to the application, including an avatar keyboard, in an avatar keyboard mode. The avatar keyboard may include a plurality of avatar keys with corresponding avatars that can be dynamically customized or animated based at least in part on facial expressions or head poses of a user, prior to input to the application. Other embodiments may be disclosed and/or claimed.

    Abstract translation: 本文公开了将与向通信/计算设备提供化身键盘相关联的设备,方法和存储介质。 在实施例中,用于通信的装置可以包括用于执行应用的一个或多个处理器; 以及键盘模块,与所述一个或多个处理器耦合以提供多个键盘模式中的多个键盘,用于以化身键盘模式输入到包括化身键盘的应用程序。 化身键盘可以在输入到应用程序之前至少部分地基于用户的面部表情或头部姿态来包括具有可以动态定制或动画的相应化身的多个化身键。 可以公开和/或要求保护其他实施例。

    AVATAR VIDEO APPARATUS AND METHOD
    18.
    发明申请
    AVATAR VIDEO APPARATUS AND METHOD 有权
    AVATAR视频设备和方法

    公开(公告)号:US20160300379A1

    公开(公告)日:2016-10-13

    申请号:US14775324

    申请日:2014-11-05

    Abstract: Apparatuses, methods and storage medium associated with creating an avatar video are disclosed herein. In embodiments, the apparatus may one or more facial expression engines, an animation-rendering engine, and a video generator. The one or more facial expression engines may be configured to receive video, voice and/or text inputs, and, in response, generate a plurality of animation messages having facial expression parameters that depict facial expressions for a plurality of avatars based at least in part on the video, voice and/or text inputs received. The animation-rendering engine may be configured to receive the one or more animation messages, and drive a plurality of avatar models, to animate and render the plurality of avatars with the facial expression depicted. The video generator may be configured to capture the animation and rendering of the plurality of avatars, to generate a video. Other embodiments may be described and/or claimed.

    Abstract translation: 本文公开了与创建头像视频相关联的装置,方法和存储介质。 在实施例中,设备可以是一个或多个面部表情引擎,动画呈现引擎和视频生成器。 一个或多个面部表情引擎可以被配置为接收视频,语音和/或文本输入,并且作为响应,至少部分地生成具有描绘多个化身的面部表情的面部表情参数的多个动画消息 接收到的视频,语音和/或文本输入。 动画呈现引擎可以被配置为接收一个或多个动画消息,并且驱动多个化身模型,以所描绘的面部表情来动画化和呈现多个化身。 视频发生器可以被配置为捕获多个化身的动画和渲染,以产生视频。 可以描述和/或要求保护其他实施例。

    FACIAL EXPRESSION AND/OR INTERACTION DRIVEN AVATAR APPARATUS AND METHOD
    19.
    发明申请
    FACIAL EXPRESSION AND/OR INTERACTION DRIVEN AVATAR APPARATUS AND METHOD 审中-公开
    FACIAL表达和/或交互驱动的AVATAR装置和方法

    公开(公告)号:US20160042548A1

    公开(公告)日:2016-02-11

    申请号:US14416580

    申请日:2014-03-19

    Abstract: Apparatuses, methods and storage medium associated with animating and rendering an avatar are disclosed herein. In embodiments, an apparatus may include a facial mesh tracker to receive a plurality of image frames, detect facial action movements of a face and head pose gestures of a head within the plurality of image frames, and output a plurality of facial motion parameters and head pose parameters that depict facial action movements and head pose gestures detected, all in real time, for animation and rendering of an avatar. The facial action movements and head pose gestures may be detected through inter-frame differences for a mouth and an eye, or the head, based on pixel sampling of the image frames. The facial action movements may include opening or closing of a mouth, and blinking of an eye. The head pose gestures may include head rotation such as pitch, yaw, roll, and head movement along horizontal and vertical direction, and the head comes closer or goes farther from the camera. Other embodiments may be described and/or claimed.

    Abstract translation: 本文公开了与动画和呈现化身相关联的装置,方法和存储介质。 在实施例中,装置可以包括面部网格跟踪器,用于接收多个图像帧,检测多个图像帧内的头部的脸部和头部姿势手势的面部动作运动,并且输出多个面部运动参数和头部 构成参数,其描绘了所有实时检测到的面部动作动作和头部姿势手势,用于动画和呈现头像。 基于图像帧的像素采样,可以通过口和眼或头部的帧间差异来检测面部动作运动和头部姿势手势。 面部动作动作可以包括开口或闭合嘴,以及眼睛的眨眼。 头部姿势手势可以包括水平和垂直方向的头部旋转,例如俯仰,偏航,滚动和头部移动,并且头部靠近或离开相机更远。 可以描述和/或要求保护其他实施例。

Patent Agency Ranking