AUTOMATIC POINT CLOUD VALIDATION FOR IMMERSIVE MEDIA

    公开(公告)号:US20220172429A1

    公开(公告)日:2022-06-02

    申请号:US17436481

    申请日:2019-05-14

    Abstract: Techniques related to validating an image based 3D model of a scene are discussed. Such techniques include detecting an object within a captured image used to generate the scene, projecting the 3D model to a view corresponding to the captured image to generate a reconstructed image, and comparing image regions of the captured and reconstructed images corresponding to the object to validate the 3D model.

    AVATAR VIDEO APPARATUS AND METHOD
    13.
    发明申请
    AVATAR VIDEO APPARATUS AND METHOD 有权
    AVATAR视频设备和方法

    公开(公告)号:US20160300379A1

    公开(公告)日:2016-10-13

    申请号:US14775324

    申请日:2014-11-05

    Abstract: Apparatuses, methods and storage medium associated with creating an avatar video are disclosed herein. In embodiments, the apparatus may one or more facial expression engines, an animation-rendering engine, and a video generator. The one or more facial expression engines may be configured to receive video, voice and/or text inputs, and, in response, generate a plurality of animation messages having facial expression parameters that depict facial expressions for a plurality of avatars based at least in part on the video, voice and/or text inputs received. The animation-rendering engine may be configured to receive the one or more animation messages, and drive a plurality of avatar models, to animate and render the plurality of avatars with the facial expression depicted. The video generator may be configured to capture the animation and rendering of the plurality of avatars, to generate a video. Other embodiments may be described and/or claimed.

    Abstract translation: 本文公开了与创建头像视频相关联的装置,方法和存储介质。 在实施例中,设备可以是一个或多个面部表情引擎,动画呈现引擎和视频生成器。 一个或多个面部表情引擎可以被配置为接收视频,语音和/或文本输入,并且作为响应,至少部分地生成具有描绘多个化身的面部表情的面部表情参数的多个动画消息 接收到的视频,语音和/或文本输入。 动画呈现引擎可以被配置为接收一个或多个动画消息,并且驱动多个化身模型,以所描绘的面部表情来动画化和呈现多个化身。 视频发生器可以被配置为捕获多个化身的动画和渲染,以产生视频。 可以描述和/或要求保护其他实施例。

    FACIAL EXPRESSION AND/OR INTERACTION DRIVEN AVATAR APPARATUS AND METHOD
    14.
    发明申请
    FACIAL EXPRESSION AND/OR INTERACTION DRIVEN AVATAR APPARATUS AND METHOD 审中-公开
    FACIAL表达和/或交互驱动的AVATAR装置和方法

    公开(公告)号:US20160042548A1

    公开(公告)日:2016-02-11

    申请号:US14416580

    申请日:2014-03-19

    Abstract: Apparatuses, methods and storage medium associated with animating and rendering an avatar are disclosed herein. In embodiments, an apparatus may include a facial mesh tracker to receive a plurality of image frames, detect facial action movements of a face and head pose gestures of a head within the plurality of image frames, and output a plurality of facial motion parameters and head pose parameters that depict facial action movements and head pose gestures detected, all in real time, for animation and rendering of an avatar. The facial action movements and head pose gestures may be detected through inter-frame differences for a mouth and an eye, or the head, based on pixel sampling of the image frames. The facial action movements may include opening or closing of a mouth, and blinking of an eye. The head pose gestures may include head rotation such as pitch, yaw, roll, and head movement along horizontal and vertical direction, and the head comes closer or goes farther from the camera. Other embodiments may be described and/or claimed.

    Abstract translation: 本文公开了与动画和呈现化身相关联的装置,方法和存储介质。 在实施例中,装置可以包括面部网格跟踪器,用于接收多个图像帧,检测多个图像帧内的头部的脸部和头部姿势手势的面部动作运动,并且输出多个面部运动参数和头部 构成参数,其描绘了所有实时检测到的面部动作动作和头部姿势手势,用于动画和呈现头像。 基于图像帧的像素采样,可以通过口和眼或头部的帧间差异来检测面部动作运动和头部姿势手势。 面部动作动作可以包括开口或闭合嘴,以及眼睛的眨眼。 头部姿势手势可以包括水平和垂直方向的头部旋转,例如俯仰,偏航,滚动和头部移动,并且头部靠近或离开相机更远。 可以描述和/或要求保护其他实施例。

Patent Agency Ranking