公开(公告)号：US12100244B2

公开(公告)日：2024-09-24

申请号：US17303365

申请日：2021-05-27

申请人： STATS LLC

发明人： Xinyu Wei ,  Jennifer Hobbs ,  Long Sha ,  Patrick Joseph Lucey ,  Sujoy Ganguly

IPC分类号： G06K9/00 ,  G06F18/21 ,  G06F18/214 ,  G06K9/62 ,  G06N3/04 ,  G06N3/045 ,  G06N3/08 ,  G06V10/82 ,  G06V20/40 ,  G06V20/52 ,  G06V40/20

CPC分类号： G06V40/20 ,  G06F18/214 ,  G06F18/217 ,  G06N3/045 ,  G06N3/08 ,  G06V10/82 ,  G06V20/42 ,  G06V20/46 ,  G06V20/52

摘要： A method and system of generating agent and actions prediction based on multi-agent tracking data are disclosed herein. A computing system retrieves tracking data from a data store. The computing system generates a trained neural network by generating a plurality of training data sets based on the tracking data by converting each frame of data into a matrix representation of the data contained in the frame and learning, by the neural network, a start frame and end frame of each action contained in the frame and its associated actor. The computing system receives target tracking data associated with an event. The target tracking data includes a plurality of actors and a plurality of actions. The computing system generates, via the trained neural network, a target start frame and a target end frame of each action identified in the tracking data and a corresponding actor.

公开(公告)号：US11830202B2

公开(公告)日：2023-11-28

申请号：US17532707

申请日：2021-11-22

申请人： STATS LLC

发明人： Long Sha ,  Sujoy Ganguly ,  Xinyu Wei ,  Patrick Joseph Lucey ,  Aditya Cherukumudi

IPC分类号： G06T7/20 ,  G06N3/08 ,  G06T7/73 ,  G06T7/80 ,  G06T7/00 ,  G06T7/70 ,  H04N21/44 ,  G06V20/40 ,  G06V40/20 ,  G06F18/22 ,  G06F18/214 ,  G06F18/232 ,  G06F18/2135 ,  G06F18/2413 ,  G06V10/764 ,  G06V10/82 ,  G06V10/44

CPC分类号： G06T7/20 ,  G06F18/214 ,  G06F18/2135 ,  G06F18/22 ,  G06F18/232 ,  G06F18/2413 ,  G06N3/08 ,  G06T7/70 ,  G06T7/73 ,  G06T7/80 ,  G06T7/97 ,  G06V10/454 ,  G06V10/764 ,  G06V10/82 ,  G06V20/42 ,  G06V20/46 ,  G06V20/48 ,  G06V20/49 ,  G06V40/20 ,  H04N21/44008 ,  G06T2207/10016 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/30221 ,  G06T2207/30244 ,  G06V20/44

摘要： A system and method of generating a player tracking prediction are described herein. A computing system retrieves a broadcast video feed for a sporting event. The computing system segments the broadcast video feed into a unified view. The computing system generates a plurality of data sets based on the plurality of trackable frames. The computing system calibrates a camera associated with each trackable frame based on the body pose information. The computing system generates a plurality of sets of short tracklets based on the plurality of trackable frames and the body pose information. The computing system connects each set of short tracklets by generating a motion field vector for each player in the plurality of trackable frames. The computing system predicts a future motion of a player based on the player's motion field vector using a neural network.

公开(公告)号：US20200279114A1

公开(公告)日：2020-09-03

申请号：US16805116

申请日：2020-02-28

申请人： STATS LLC

发明人： Long Sha ,  Sujoy Ganguly ,  Xinyu Wei ,  Patrick Joseph Lucey ,  Aditya Cherukumudi

IPC分类号： G06K9/00 ,  G06K9/62 ,  G06T7/20 ,  H04N21/44

摘要： A system and method of generating trackable frames from a broadcast video feed are provided herein. A computing system retrieves a broadcast video feed for a sporting event. The broadcast video feed includes a plurality of video frames. The computing system generates a set of frames for classification using a principal component analysis model. The set of frames are a subset of the plurality of video frames. The computing system partitions each frame of the set of frames into a plurality of clusters. The computing system classifies each frame of the plurality of frames as trackable or untrackable. Trackable frames capture a unified view of the sporting event. The computing system compares each cluster to a predetermined threshold to determine whether each cluster comprises at least a threshold number of trackable frames. The computing system classifies each cluster that includes at least the threshold number of trackable frames as trackable.

公开(公告)号：US11935247B2

公开(公告)日：2024-03-19

申请号：US18175278

申请日：2023-02-27

申请人： STATS LLC

发明人： Long Sha ,  Sujoy Ganguly ,  Xinyu Wei ,  Patrick Joseph Lucey ,  Aditya Cherukumudi

IPC分类号： G06T7/20 ,  G06F18/2135 ,  G06F18/214 ,  G06F18/22 ,  G06F18/232 ,  G06F18/2413 ,  G06N3/08 ,  G06T7/00 ,  G06T7/70 ,  G06T7/73 ,  G06T7/80 ,  G06V10/44 ,  G06V10/764 ,  G06V10/82 ,  G06V20/40 ,  G06V40/20 ,  H04N21/44

CPC分类号： G06T7/20 ,  G06F18/2135 ,  G06F18/214 ,  G06F18/22 ,  G06F18/232 ,  G06F18/2413 ,  G06N3/08 ,  G06T7/70 ,  G06T7/73 ,  G06T7/80 ,  G06T7/97 ,  G06V10/454 ,  G06V10/764 ,  G06V10/82 ,  G06V20/42 ,  G06V20/46 ,  G06V20/48 ,  G06V20/49 ,  G06V40/20 ,  H04N21/44008 ,  G06T2207/10016 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/30221 ,  G06T2207/30244 ,  G06V20/44

摘要： A system and method of calibrating moving cameras capturing a sporting event is disclosed herein. A computing system retrieves a broadcast video feed for a sporting event. The broadcast video feed includes a plurality of video frames. The computing system labels, via a neural network, components of a playing surface captured in each video frame. The computing system matches a subset of labeled video frames to a set of templates with various camera perspectives. The computing system fits a playing surface model to the set of labeled video frames that were matched to the set of templates. The computing system identifies camera motion in each video frame using an optical flow model. The computing system generates a homography matrix for each video frame based on the fitted playing surface model and camera motion. The computing system calibrates each camera based on the homography matrix generated for each video frame.

公开(公告)号：US20230169766A1

公开(公告)日：2023-06-01

申请号：US18154145

申请日：2023-01-13

申请人： STATS LLC

发明人： Sujoy Ganguly ,  Long Sha ,  Jennifer Hobbs ,  Xinyu Wei ,  Patrick Joseph Lucey

IPC分类号： G06V20/40 ,  A63B24/00 ,  G06N3/08 ,  G06V10/82

CPC分类号： G06V20/42 ,  A63B24/0021 ,  G06N3/08 ,  A63B24/0006 ,  A63B24/0087 ,  G06V10/82 ,  A63B2024/0028 ,  A63B2024/0009 ,  A63B2024/0025

摘要： A system and method for generating a play prediction for a team is disclosed herein. A computing system retrieves trajectory data for a plurality of plays from a data store. The computing system generates a predictive model using a variational autoencoder and a neural network by generating one or more input data sets, learning, by the variational autoencoder, to generate a plurality of variants for each play of the plurality of plays, and learning, by the neural network, a team style corresponding to each play of the plurality of plays. The computing system receives trajectory data corresponding to a target play. The predictive model generates a likelihood of a target team executing the target play by determining a number of target variants that correspond to a target team identity of the target team.

公开(公告)号：US20200279398A1

公开(公告)日：2020-09-03

申请号：US16805157

申请日：2020-02-28

申请人： STATS LLC

发明人： Long Sha ,  Sujoy Ganguly ,  Xinyu Wei ,  Patrick Joseph Lucey ,  Aditya Cherukumudi

IPC分类号： G06T7/80 ,  G06K9/00 ,  G06T7/70 ,  G06T7/00

摘要： A system and method of calibrating moving cameras capturing a sporting event is disclosed herein. A computing system retrieves a broadcast video feed for a sporting event. The broadcast video feed includes a plurality of video frames. The computing system labels, via a neural network, components of a playing surface captured in each video frame. The computing system matches a subset of labeled video frames to a set of templates with various camera perspectives. The computing system fits a playing surface model to the set of labeled video frames that were matched to the set of templates. The computing system identifies camera motion in each video frame using an optical flow model. The computing system generates a homography matrix for each video frame based on the fitted playing surface model and camera motion. The computing system calibrates each camera based on the homography matrix generated for each video frame.

公开(公告)号：US20240350890A1

公开(公告)日：2024-10-24

申请号：US18635903

申请日：2024-04-15

申请人： Stats LLC

发明人： Xinyu Wei ,  Robert Seidl ,  Ysabel Gonzalez-Rico ,  Stephen Andrew Skweres ,  Christian Marko ,  Patrick Joseph Lucey

IPC分类号： A63B71/06 ,  A63B24/00 ,  A63B102/02 ,  H04N21/2187 ,  H04N21/81

CPC分类号： A63B71/0616 ,  A63B24/0021 ,  A63B2024/0025 ,  A63B2024/0068 ,  A63B2102/02 ,  A63B2220/05 ,  H04N21/2187 ,  H04N21/8133

摘要： The present embodiments relate to generating various predictive overlays over a video of a tennis match. Tracking data of a tennis match can be processed to derive insights into the tennis match. For example, the tracking data can indicate a current state of the match and a likelihood of a ball being returned to various regions of the court. This can be used to create a first overlay that can be added over a video of the tennis match. Further, player rankings based on various categories (e.g., technical, tactical, mental, physical) can be generated to provide insights into skills of each player relative to other ranked players. Additional insights, such as a forecast predicting a likelihood of winning an upcoming match or tournament can also be generated. A player card can be generated using such information to provide various aspects of a player skill onto a single output.

公开(公告)号：US11861848B2

公开(公告)日：2024-01-02

申请号：US17810457

申请日：2022-07-01

申请人： STATS LLC

发明人： Long Sha ,  Sujoy Ganguly ,  Xinyu Wei ,  Patrick Joseph Lucey ,  Aditya Cherukumudi

IPC分类号： G06T7/20 ,  G06N3/08 ,  G06T7/73 ,  G06T7/80 ,  G06T7/00 ,  G06T7/70 ,  H04N21/44 ,  G06V20/40 ,  G06V40/20 ,  G06F18/22 ,  G06F18/214 ,  G06F18/232 ,  G06F18/2135 ,  G06F18/2413 ,  G06V10/764 ,  G06V10/82 ,  G06V10/44

CPC分类号： G06T7/20 ,  G06F18/214 ,  G06F18/2135 ,  G06F18/22 ,  G06F18/232 ,  G06F18/2413 ,  G06N3/08 ,  G06T7/70 ,  G06T7/73 ,  G06T7/80 ,  G06T7/97 ,  G06V10/454 ,  G06V10/764 ,  G06V10/82 ,  G06V20/42 ,  G06V20/46 ,  G06V20/48 ,  G06V20/49 ,  G06V40/20 ,  H04N21/44008 ,  G06T2207/10016 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/30221 ,  G06T2207/30244 ,  G06V20/44

摘要： A system and method of generating trackable frames from a broadcast video feed are provided herein. A computing system retrieves a broadcast video feed for a sporting event. The broadcast video feed includes a plurality of video frames. The computing system generates a set of frames for classification using a principal component analysis model. The set of frames are a subset of the plurality of video frames. The computing system partitions each frame of the set of frames into a plurality of clusters. The computing system classifies each frame of the plurality of frames as trackable or untrackable. Trackable frames capture a unified view of the sporting event. The computing system compares each cluster to a predetermined threshold to determine whether each cluster comprises at least a threshold number of trackable frames. The computing system classifies each cluster that includes at least the threshold number of trackable frames as trackable.

公开(公告)号：US11679299B2

公开(公告)日：2023-06-20

申请号：US16804964

申请日：2020-02-28

申请人： STATS LLC

发明人： Paul David Power ,  Aditya Cherukumudi ,  Sujoy Ganguly ,  Xinyu Wei ,  Long Sha ,  Jennifer Hobbs ,  Hector Ruiz ,  Patrick Joseph Lucey

IPC分类号： A63B24/00 ,  G06N3/08 ,  G06N20/00

CPC分类号： A63B24/0006 ,  A63B24/0021 ,  A63B24/0062 ,  A63B24/0087 ,  G06N3/08 ,  G06N20/00

摘要： A method of generating a player prediction is disclosed herein. A computing system retrieves data from a data store. The computing system generates a predictive model using an artificial neural network. The artificial neural network generates one or more personalized embeddings that include player-specific information based on historical performance. The computing system selects, from the data, one or more features related to each shot attempt captured in the data. The artificial neural network learns an outcome of each shot attempt based at least on the one or more personalized embeddings and the one or more features related to each shot attempt.

公开(公告)号：US11586840B2

公开(公告)日：2023-02-21

申请号：US17454952

申请日：2021-11-15

申请人： STATS LLC

发明人： Long Sha ,  Sujoy Ganguly ,  Xinyu Wei ,  Patrick Joseph Lucey ,  Aditya Cherukumudi

IPC分类号： G06K9/62 ,  G06N3/08 ,  G06T7/73 ,  G06T7/20 ,  G06T7/80 ,  G06T7/00 ,  G06T7/70 ,  H04N21/44 ,  G06V20/40 ,  G06V40/20

摘要： A system and method of re-identifying players in a broadcast video feed are provided herein. A computing system retrieves a broadcast video feed for a sporting event. The broadcast video feed includes a plurality of video frames. The computing system generates a plurality of tracks based on the plurality of video frames. Each track includes a plurality of image patches associated with at least one player. Each image patch of the plurality of image patches is a subset of the corresponding frame of the plurality of video frames. For each track, the computing system generates a gallery of image patches. A jersey number of each player is visible in each image patch of the gallery. The computing system matches, via a convolutional autoencoder, tracks across galleries. The computing system measures, via a neural network, a similarity score for each matched track and associates two tracks based on the measured similarity.