Controlling a device by tracking the movement of a finger

    公开(公告)号:US10572001B2

    公开(公告)日:2020-02-25

    申请号:US15834417

    申请日:2017-12-07

    发明人: Lili Qiu Sangki Yun

    IPC分类号: G06F3/01 G01S15/66 H04M1/725

    摘要: A method, system and computer program product for controlling a device (e.g., smartphone) by tracking a movement of a target (e.g., finger). A channel impulse response which characterizes signal traversal paths with different delays is estimated. Channel tap(s) corresponding to the target are then selected. The phase change of the selected channel taps is tracked based on the estimated channel impulse response to estimate a distance change of the target from the device. An estimate of an absolute distance between the device and the target is estimated based on the estimated channel impulse response. A more accurate absolute distance between the device and the target is calculated by combining the estimated absolute distance and the estimated distance change. The position of the target is then tracked based on a distance to different landmarks (e.g., microphones) on the device using the more accurate absolute distance and the estimated distance change.

    UTILIZING A MOBILE DEVICE AS A MOTION-BASED CONTROLLER
    2.
    发明申请
    UTILIZING A MOBILE DEVICE AS A MOTION-BASED CONTROLLER 审中-公开
    使用移动设备作为基于运动的控制器

    公开(公告)号:US20160321917A1

    公开(公告)日:2016-11-03

    申请号:US15135877

    申请日:2016-04-22

    摘要: A method, system and computer program product for accurately tracking the position of a mobile device. The microphone on a mobile device receives acoustic signals at a few selected frequencies from a device to be controlled by the mobile device. The frequency shifts are used to estimate the speed and distance traveled. The distance between the speakers of the device to be controlled is calibrated and the mobile device's initial position is narrowed down using its movement trajectory. Based on the information, the mobile device's new position is continuously tracked in real time. Hence, movement of the mobile device can be accurately tracked, thereby allowing the mobile device to be realized as a motion-based controller (e.g., mouse, game controller, controller for Internet of Things).

    摘要翻译: 一种用于准确跟踪移动设备位置的方法,系统和计算机程序产品。 移动设备上的麦克风从要由移动设备控制的设备接收几个选定频率的声信号。 频率偏移用于估计行进的速度和距离。 要控制的设备的扬声器之间的距离被校准,并且移动设备的初始位置使用其移动轨迹变窄。 根据这些信息,移动设备的新位置被实时地跟踪。 因此,可以准确地跟踪移动设备的移动,从而允许移动设备被实现为基于运动的控制器(例如,鼠标,游戏控制器,物联网的控制器)。

    Controlling a device by tracking movement of hand using acoustic signals

    公开(公告)号:US11474194B2

    公开(公告)日:2022-10-18

    申请号:US17269671

    申请日:2019-08-22

    发明人: Lili Qiu Wenguang Mao

    摘要: A method, device and computer program product for controlling the device by tracking a movement of a hand or other objects. The device receives acoustic signals. At least a portion of the received signals are transformed into two-dimensional sinusoids whose frequencies are proportional to an angle-of-arrival (AoA) and a propagation distance of the reflected signals. An AoA-distance profile is derived based on signals received from the object by evaluating frequencies of the two-dimensional sinusoids. Then, an AoA-distance pair is derived from the AoA-distance profile. A current location of the object is determined based on the estimated AoA-distance pair. The device then performs a command in response to detecting that the user moved to perform the command based on prior and current locations of the object.

    CONTROLLING A DEVICE BY TRACKING MOVEMENT OF HAND USING ACOUSTIC SIGNALS

    公开(公告)号:US20210199751A1

    公开(公告)日:2021-07-01

    申请号:US17269671

    申请日:2019-08-22

    发明人: Lili Qiu Wenguang Mao

    摘要: A method, device and computer program product for controlling the device by tracking a movement of a hand or other objects. The device receives acoustic signals. At least a portion of the received signals are transformed into two-dimensional sinusoids whose frequencies are proportional to an angle-of-arrival (AoA) and a propagation distance of the reflected signals. An AoA-di stance profile is derived based on signals received from the object by evaluating frequencies of the two-dimensional sinusoids. Then, an AoA-di stance pair is derived from the AoA-di stance profile. A current location of the object is determined based on the estimated AoA-di stance pair. The device then performs a command in response to detecting that the user moved to perform the command based on prior and current locations of the object.

    Device-free tracking system that accurately tracks hand movement

    公开(公告)号:US10386482B2

    公开(公告)日:2019-08-20

    申请号:US15414084

    申请日:2017-01-24

    发明人: Lili Qiu Sangki Yun

    IPC分类号: G01S15/62 G01S15/42 G01S15/58

    摘要: A method, system and computer program product for tracking movement of an object, such as a hand. Speakers of a device to be controlled transmit frequency modulated continuous wave (FMCW) audio signals. These signals are reflected by the object and received by the microphones at the controlled device. The received and transmitted audio signals are mixed. A fast Fourier transform (FFT) is then performed on the mixed audio signals. One or more peak frequencies in the frequency domain of the FFT mixed audio signals are selected and used to estimate the distance between the object and the speakers of the controlled device. Furthermore, the velocity of the object is estimated. The coordinates of the object are then computed using the estimated distance between the object and the speakers and microphones of the controlled device and the estimated velocity of the object.

    Accurately tracking a mobile device to effectively enable mobile device to control another device

    公开(公告)号:US10182414B2

    公开(公告)日:2019-01-15

    申请号:US15368061

    申请日:2016-12-02

    发明人: Lili Qiu Wenguang Mao

    摘要: A method, system and computer program product for tracking a mobile device. A reference position of the mobile device and a frequency offset between the mobile device and another device are estimated. Samples are then fetched at various frequencies from the receivers. The fetched signals are mixed with a pseudo transmitted signal. A relative distance between the mobile device and the other device is computed based on a change in frequency of the mixed signal at a current location, a velocity of the mobile device and the estimated frequency offset. An absolute distance between the mobile device and the other device is determined using the reference position and the computed relative distance. A location of the mobile device is then determined based on the mobile device's velocity and the determined absolute difference.

    CONTROLLING A DEVICE BY TRACKING THE MOVEMENT OF A FINGER

    公开(公告)号:US20180164874A1

    公开(公告)日:2018-06-14

    申请号:US15834417

    申请日:2017-12-07

    发明人: Lili Qiu Sangki Yun

    IPC分类号: G06F3/01 G01S15/66

    摘要: A method, system and computer program product for controlling a device (e.g., smartphone) by tracking a movement of a target (e.g., finger). A channel impulse response which characterizes signal traversal paths with different delays is estimated. Channel tap(s) corresponding to the target are then selected. The phase change of the selected channel taps is tracked based on the estimated channel impulse response to estimate a distance change of the target from the device. An estimate of an absolute distance between the device and the target is estimated based on the estimated channel impulse response. A more accurate absolute distance between the device and the target is calculated by combining the estimated absolute distance and the estimated distance change. The position of the target is then tracked based on a distance to different landmarks (e.g., microphones) on the device using the more accurate absolute distance and the estimated distance change.

    DEVICE-FREE TRACKING SYSTEM THAT ACCURATELY TRACKS HAND MOVEMENT

    公开(公告)号:US20170212235A1

    公开(公告)日:2017-07-27

    申请号:US15414084

    申请日:2017-01-24

    发明人: Lili Qiu Sangki Yun

    IPC分类号: G01S15/62 G01S15/42 G01S15/58

    摘要: A method, system and computer program product for tracking movement of an object, such as a hand. Speakers of a device to be controlled transmit frequency modulated continuous wave (FMCW) audio signals. These signals are reflected by the object and received by the microphones at the controlled device. The received and transmitted audio signals are mixed. A fast Fourier transform (FFT) is then performed on the mixed audio signals. One or more peak frequencies in the frequency domain of the FFT mixed audio signals are selected and used to estimate the distance between the object and the speakers of the controlled device. Furthermore, the velocity of the object is estimated. The coordinates of the object are then computed using the estimated distance between the object and the speakers and microphones of the controlled device and the estimated velocity of the object.