公开(公告)号：US20230096949A1

公开(公告)日：2023-03-30

申请号：US17950664

申请日：2022-09-22

Applicant: Apple Inc.

Inventor： Aditya Sarathy ,  Rene Aguirre Ramos ,  Umamahesh Srinivas ,  Yongyang Nie

IPC: G06V40/20 ,  G06T7/50 ,  G06T7/30 ,  G06T7/73

Abstract: Embodiments are disclosed for posture and motion monitoring using mobile devices. In an embodiment, a method comprises: obtaining motion data obtained from at least one motion sensor worn by a user; obtaining at least one frame of skeletal data of the user based on at least one of camera data or depth data; calibrating, with the at least one processor, the motion data and skeletal data to determine a calibration offset; synchronizing the motion data and skeletal data; generating, with the at least one processor, a body pose of the user by: aligning reference frames of the synchronized motion data and the synchronized skeletal data using the calibration offset; estimating the body pose of the user based on the aligned motion data and skeletal data; and classifying, using a machine learning model, the estimated body pose of the user.