SYSTEMS AND METHODS FOR CONTROLLING VIRTUAL WIDGETS IN A GESTURE-CONTROLLED DEVICE

    公开(公告)号:US20220382377A1

    公开(公告)日:2022-12-01

    申请号:US17334324

    申请日:2021-05-28

    摘要: A gesture-controlled device and a method thereon are provided. The method includes capturing a plurality of video frames of a user's body and processing the plurality of video frames to allow detecting a portion of the user's body and to allow recognizing hand gestures. In response to detecting the portion of the user's body, the method includes generating at least one widget interaction region corresponding to the portion of the user's body. The method further includes recognizing, a mid-air hand gesture in the at least one widget interaction region, mapping the mid-air hand gesture to at least one virtual widget on the gesture-controlled device, and manipulating the at least one virtual widget based on the mid-air hand gesture. The method and device allow manipulation of virtual widgets using mid-air gestures on a gesture-controlled device.