公开(公告)号：US20250134430A1

公开(公告)日：2025-05-01

申请号：US19008644

申请日：2025-01-03

Applicant: INSTITUTE OF AUTOMATION, CHINESE ACADEMY OF SCIENCES

Inventor： Zhenan SUN ,  Yiwei RU ,  Kunbo ZHANG ,  Yunlong WANG

IPC: A61B5/16 ,  A61B5/00 ,  A61B5/0205 ,  A61B5/024 ,  A61B5/08 ,  A61B5/11 ,  G06T7/00 ,  G06T7/20

Abstract: Disclosed are a method and a system for mental state perception and a computer-readable storage medium. The method includes: acquiring image sequences with timestamps and millimeter-wave radar raw data with timestamps; preprocessing the image sequences and the millimeter-wave radar raw data; analyzing the head region image sequences to obtain head vibration signal features; calculating face region image sequences obtained from preprocessing by using a remote photovolumetric pulse wave recording method to obtain a first heart rate; analyzing the original millimeter-wave radar data sequence to obtain a second heart rate and a breathing rate; fusing the first heart rate, the second heart rate and the breathing rate to obtain a fused heart rate and breathing rate; performing feature extraction on facial change information by a Transformer-like network; establishing a non-contact multi-modal mental perception model for prediction to obtain a predicted result of the mental state.