System and method for ergonomic risk assessment based on three dimensional motion capture datasets

    公开(公告)号:US12112485B1

    公开(公告)日:2024-10-08

    申请号:US18418929

    申请日:2024-01-22

    IPC分类号: G06T7/20

    摘要: Disclosed herein is a system and method for obtaining and generating motion capture datasets relating to various working activities for ergonomic risk assessment. An example system may comprise a computing device that obtains first data from multiple motion capture cameras, obtains second data from multiple visible light imaging sensors, calculates 3D positions of multiple reflective markers positioned on several subjects performing various working activities based on the first data, labels each marker to generate marker trajectories, performs gap filing and smoothing functions on the marker trajectories to generate global marker positions, transforms the global marker positions into a corresponding image coordinate system of each sensor to generate 3D pose data of the subjects at each sensor viewpoint, projects the 3D pose data into frames of the second data to generate 2D pose data, and generates a dataset comprising the second data, the 2D pose data, and the 3D pose data.

    Image-based automated ergonomic risk root cause and solution identification system and method

    公开(公告)号:US12014575B1

    公开(公告)日:2024-06-18

    申请号:US18535146

    申请日:2023-12-11

    IPC分类号: G06V40/20 G06V10/82

    CPC分类号: G06V40/23 G06V10/82

    摘要: Disclosed herein is an image-based system configured to identify root causes of industrial ergonomic risks and their corresponding solutions. An example system comprises a computing device configured to encode an image of a worker performing a work task to generate an embedding vector, transmit the embedding vector to an image-grounded text decoder, while generating first tokens to instruct the decoder to generate a first sentence indicating a root cause of an ergonomic risk identified in the image, compute first relative sensitivity scores relating to the first tokens and extracted image features, generate second tokens of the first sentence based on the first relative sensitivity scores, while generating third tokens to instruct a text decoder to generate a second sentence indicating a solution to the ergonomic risk, calculate second relative sensitivity scores relating to the second and third tokens, and generate the first and second sentences accordingly.