Serial fusion of Eulerian and Lagrangian approaches for real-time heart rate estimation

    公开(公告)号:US10130271B1

    公开(公告)日:2018-11-20

    申请号:US15900783

    申请日:2018-02-20

    Abstract: Traditional electrocardiography (ECG) and photo-plethysmography (PPG) based HR estimation require human skin contact which is not only user uncomfortable, but also infeasible when multiple user monitoring is required or extreme sensitive conditions is a prime concern as in the case of monitoring neonates, sleeping human and skin damaged patients. Temporal signals depicting the motion or color variations in the frames across time, are estimated from a Region of Interest using Eulerian or Lagrangian approaches. However, the Eulerian approach fails under improper illumination, inappropriate camera focus or human factors like skin color. Likewise, Lagrangian approach is highly time-consuming and may fail when few or less discriminatory features are available for tracking. The present disclosure provides a poorness measure that is indicative of when an approach fails and facilitates serial fusion of the two approaches. Switching to an appropriate approach results in accurate heart rate estimation.

    Audio-speech driven animated talking face generation using a cascaded generative adversarial network

    公开(公告)号:US11551394B2

    公开(公告)日:2023-01-10

    申请号:US17199149

    申请日:2021-03-11

    Abstract: Conventional state-of-the-art methods are limited in their ability to generate realistic animation from audio on any unknown faces and cannot be easily generalized to different facial characteristics and voice accents. Further, these methods fail to produce realistic facial animation for subjects which are quite different than that of distribution of facial characteristics network has seen during training. Embodiments of the present disclosure provide systems and methods that generate audio-speech driven animated talking face using a cascaded generative adversarial network (CGAN), wherein a first GAN is used to transfer lip motion from canonical face to person-specific face. A second GAN based texture generator network is conditioned on person-specific landmark to generate high-fidelity face corresponding to the motion. Texture generator GAN is made more flexible using meta learning to adapt to unknown subject's traits and orientation of face during inference. Finally, eye-blinks are induced in the final animation face being generated.

    System and method for stitching images using non-linear optimization and multi-constraint cost function minimization

    公开(公告)号:US11288769B2

    公开(公告)日:2022-03-29

    申请号:US16830328

    申请日:2020-03-26

    Abstract: The present disclosure provides a system and a method for stitching images using non-linear optimization and multi-constraint cost function minimization. Most of conventional homography based transformation approaches for image alignment, calculate transformations based on linear algorithms which ignore parameters such as lens distortion and unable to handle parallax for non-planar images resulting in improper image stitching with misalignments. The disclosed system and the method generates initial stitched image by estimating a global homography for each image using estimated pairwise homography matrix and feature point correspondences for each pair of images, based on a non-linear optimization. Local warping based image alignment is applied on the initial stitched image, using multi-constraint cost function minimization to mitigate aberrations caused by noises in the global homography estimation to generate the refined stitched image. The refined stitched image is accurate and free from misalignments and poor intensities.

    System and method for tracking body joints

    公开(公告)号:US10980447B2

    公开(公告)日:2021-04-20

    申请号:US15908731

    申请日:2018-02-28

    Abstract: Body joint tracking is applied in various industries and medical field. In body joint tracking, marker less devices plays an important role. However, the marker less devices are facing some challenges in providing optimal tracking due to occlusion, ambiguity, lighting conditions, dynamic objects etc. System and method of the present disclosure provides an optimized body joint tracking. Here, motion data pertaining to a first set of motion frames from a motion sensor are received. Further, the motion data are processed to obtain a plurality of 3 dimensional cylindrical models. Here, every cylindrical model among the plurality of 3 dimensional cylindrical model represents a body segment. The coefficients associated with the plurality of 3 dimensional cylindrical models are initialized to obtain a set of initialized cylindrical models. A set of dynamic coefficients associated with the initialized cylindrical models are utilized to track joint motion trajectories of a set of subsequent frames.

    Systems and methods for solving inverse problems using a coupled autoencoder

    公开(公告)号:US10360665B2

    公开(公告)日:2019-07-23

    申请号:US15898144

    申请日:2018-02-15

    Abstract: Motion blur occur when acquiring images and videos with cameras fitted to the high speed motion devices, for example, drones. Distorted images intervene with the mapping of the visual points, hence the pose estimation and tracking may get corrupted. System and method for solving inverse problems using a coupled autoencoder is disclosed. In an embodiment, solving inverse problems, for example, generating a clean sample from an unknown corrupted sample is disclosed. The coupled autoencoder learns the autoencoder weights and coupling map (between source and target) simultaneously. The technique is applicable to any transfer learning problem. The embodiments of the present disclosure implements/proposes a new formulation that recasts deblurring as a transfer learning problem which is solved using the proposed coupled autoencoder.

    SYSTEMS AND METHODS FOR EDGE POINTS BASED MONOCULAR VISUAL SLAM

    公开(公告)号:US20190114777A1

    公开(公告)日:2019-04-18

    申请号:US15913800

    申请日:2018-03-06

    Abstract: Feature based visual simultaneous localization and mapping (SLAM) do not produce reliable camera and structure estimates due to insufficient features in a low-textured environment. Moreover, existing visual SLAMs produce partial reconstruction when the number of 3D-2D correspondences is insufficient for incremental camera estimation using bundle adjustment. Systems and methods of the present disclosure provide edge points based monocular visual SLAM that mitigates these problems. The SLAM is initialized through a validation process. A local optimization process is provided for stable pose estimation in situations where camera tracking becomes unreliable in a very low-textured challenging environment. An efficient and reliable loop closing process that uses structural properties of edges in the frames is also provided.

Patent Agency Ranking