Natural human-computer interaction system based on multi-sensing data fusion

    公开(公告)号:US11409357B2

    公开(公告)日:2022-08-09

    申请号:US16475384

    申请日:2018-05-23

    Abstract: A natural human-computer interaction system based on multi-sensing data fusion comprises a MEMS anti tracking device, a visual tracking device, a force feedback device and a PC terminal. The MEMS arm tracking device is composed of three sets of independent MEMS sensors for collecting arm joint angle information and measuring an arm motion trajectory. The visual tracking device is composed of a binocular camera for collecting image information and measuring a finger motion trajectory. The force feedback device is mounted in a palm of an operator for providing a feedback force to the finger. The PC terminal comprises a data display module, an arm motion calculating module, an image processing module, a mechanics calculating module and a virtual scene rendering module. The system tracks the arm motion trajectory and the finger motion trajectory of the operator and provides force feedback interaction to the finger of the operator.

    Flexible finger-wearable haptic feedback device

    公开(公告)号:US11287887B2

    公开(公告)日:2022-03-29

    申请号:US17271207

    申请日:2019-03-21

    Abstract: A flexible finger-wearable haptic feedback device includes a fingertip sleeve sheathing a distal phalanx of a finger, a middle sleeve sheathing a middle phalanx of the finger, a proximal sleeve sheathing a proximal phalanx of the finger, outer and inner transmission rods having bending elasticity. The outer transmission rod is fixed on the fingertip sleeve at one end, positioned at a back of a hand at the other end and connected with an outer driver. The inner transmission rod is fixed on the fingertip sleeve at one end, positioned at a palm at the other end and connected with an inner driver. The fingertip sleeve is provided with first and second contact pressure sensors respectively connected with the ends of the outer and inner transmission rods, and an inner wall of the fingertip finger sleeve contacting the finger is provided with a film pressure sensor.

Patent Agency Ranking