Real-time processing of handstate representation model estimates

    公开(公告)号:US10460455B2

    公开(公告)日:2019-10-29

    申请号:US16258232

    申请日:2019-01-25

    IPC分类号: G06T5/00 G06F3/01 G06T7/246

    摘要: System and methods are provided for providing a dynamically-updated musculoskeletal representation of a hand. The system includes a plurality of neuromuscular sensors configured to continuously record a plurality of neuromuscular signals from a user, and at least one computer processor programmed to provide as input to a trained statistical model, the plurality of neuromuscular signals and temporally smooth in real-time an output of the trained statistical model. The system is also programmed to determine, based on the smoothed output of the trained statistical model, position information describing a spatial relationship between two or more connected segments of the musculoskeletal representation, force information describing a force exerted by at least one segment of the musculoskeletal representation, and update the musculoskeletal representation of the hand based, at least in part, on the position information and the force information.

    HANDSTATE RECONSTRUCTION BASED ON MULTIPLE INPUTS

    公开(公告)号:US20190228330A1

    公开(公告)日:2019-07-25

    申请号:US16257922

    申请日:2019-01-25

    摘要: Methods and systems for dynamically reconstructing handstate information based on multiple inputs are described. The methods and systems use data from multiple inputs including a plurality of neuromuscular sensors arranged on one or more wearable devices and one or more cameras. The multimodal data is provided as input to a trained statistical model. The methods and systems determine, based on the data from the multiple inputs, an estimate and representation of the spatial relationship between two or more connected segments of the musculoskeletal representation and force information describing a force exerted by at least one segment of the musculoskeletal representation. The methods and systems further update the computerized musculoskeletal representation based, at least in part, on the position information and the force information.

    REAL-TIME PROCESSING OF HANDSTATE REPRESENTATION MODEL ESTIMATES

    公开(公告)号:US20200034978A1

    公开(公告)日:2020-01-30

    申请号:US16589539

    申请日:2019-10-01

    摘要: System and methods are provided for providing a dynamically-updated musculoskeletal representation of a hand. The system includes a plurality of neuromuscular sensors configured to continuously record a plurality of neuromuscular signals from a user, and at least one computer processor programmed to provide as input to a trained statistical model, the plurality of neuromuscular signals and temporally smooth in real-time an output of the trained statistical model. The system is also programmed to determine, based on the smoothed output of the trained statistical model, position information describing a spatial relationship between two or more connected segments of the musculoskeletal representation, force information describing a force exerted by at least one segment of the musculoskeletal representation, and update the musculoskeletal representation of the hand based, at least in part, on the position information and the force information.

    TECHNIQUES FOR ANONYMIZING NEUROMUSCULAR SIGNAL DATA

    公开(公告)号:US20190228579A1

    公开(公告)日:2019-07-25

    申请号:US16258442

    申请日:2019-01-25

    IPC分类号: G06T19/00 G06F3/01 G06N20/00

    摘要: Methods and apparatus for anonymizing neuromuscular signals used to generate a musculoskeletal representation. The method comprises recording, using a plurality of neuromuscular sensors arranged on one or more wearable devices, a plurality of neuromuscular signals from a user, providing as input to a trained statistical model, the plurality of neuromuscular signals and/or information based on the plurality of neuromuscular signals; and generating, the musculoskeletal representation based, at least in part, on an output of the trained statistical model, wherein the musculoskeletal representation is an anonymized musculoskeletal representation from which at least one personal characteristic of the user has been removed.

    REAL-TIME SMOOTHING OF HANDSTATE REPRESENTATION MODEL ESTIMATES

    公开(公告)号:US20190228533A1

    公开(公告)日:2019-07-25

    申请号:US16258232

    申请日:2019-01-25

    IPC分类号: G06T7/246 G06F3/01 G06T5/00

    摘要: System and methods are provided for providing a dynamically-updated musculoskeletal representation of a hand. The system includes a plurality of neuromuscular sensors configured to continuously record a plurality of neuromuscular signals from a user, and at least one computer processor programmed to provide as input to a trained statistical model, the plurality of neuromuscular signals and temporally smooth in real-time an output of the trained statistical model. The system is also programmed to determine, based on the smoothed output of the trained statistical model, position information describing a spatial relationship between two or more connected segments of the musculoskeletal representation, force information describing a force exerted by at least one segment of the musculoskeletal representation, and update the musculoskeletal representation of the hand based, at least in part, on the position information and the force information.

    VISUALIZATION OF RECONSTRUCTED HANDSTATE INFORMATION

    公开(公告)号:US20190228591A1

    公开(公告)日:2019-07-25

    申请号:US16258430

    申请日:2019-01-25

    摘要: Method and apparatus for rendering a visual representation based on a musculoskeletal representation. The method comprises updating the musculoskeletal representation based, at least in part, on a plurality of neuromuscular signals recorded from a user, wherein the musculoskeletal representation is updated based at least in part on: position information describing a spatial relationship between two or more connected segments of the musculoskeletal representation, and force information describing a force exerted by at least one segment of the musculoskeletal representation, and rendering, via a user interface, the visual representation based on the updated musculoskeletal representation, wherein the visual representation includes a visual indication of the position information and a visual indication of the force information.