公开(公告)号：US20200090408A1

公开(公告)日：2020-03-19

申请号：US16570369

申请日：2019-09-13

申请人： Hemant Virkar

发明人： Hemant Virkar ,  Leah Kaplan ,  Stephen Furlani ,  Jacob Borgman

IPC分类号： G06T19/00 ,  G06T7/215 ,  G06T7/73 ,  G06N20/20 ,  G06K9/00

摘要： The disclosure relates to a system for providing guidance for positioning a body. The system may include a video display, one or more digital cameras configured to generate a depth video stream and a visual video stream, and a computing device including, a memory, and a processor. The processor may control the one or more digital cameras to generate the depth video stream including a depth image of the body and the visual video stream including a color image of the body. The processor identifies at least a part of the body within the images using a first trained learning machine to segment the images and isolate the body. The processor may crop both the visual image and the depth image based on the identified body. The processor may estimate a position of a plurality of joints of the body by applying a second trained learning machine to the identified and isolated part of the body. The processor may generate a current pose estimate by connecting estimated positions of the plurality of joints. The processor may overlay a visual representation of the current pose estimate over the color video stream on the video display.