-
公开(公告)号:US12183019B2
公开(公告)日:2024-12-31
申请号:US17994696
申请日:2022-11-28
Inventor: Srikrishna Karanam , Meng Zheng , Ziyan Wu
Abstract: A human model such as a 3D human mesh may be generated for a person in a medical environment based on one or more images of the person. The images may be captured using a sensing device that may be attached to an existing medical device such as a medical scanner in the medical environment. Such an arrangement may ensure that unblocked views of the person (e.g., body keypoints of the person) may be obtained and used to generate the human model. The position of the medical device in the medical environment may be determined and used to facilitate the human model construction such that the pose and body shape of the person in the medical environment may be accurately represented by the human model.
-
公开(公告)号:US12138015B2
公开(公告)日:2024-11-12
申请号:US17737694
申请日:2022-05-05
Inventor: Ziyan Wu , Srikrishna Karanam , Arun Innanje , Shanhui Sun , Abhishek Sharma , Yimo Guo , Zhang Chen
IPC: G06T7/00 , A61B5/00 , G06F18/21 , G06F18/214 , G06T7/50 , G06T7/70 , G06T7/90 , G06T17/00 , G06T17/20 , G06V10/40 , G06V10/42 , G06V10/764 , G06V10/774 , G06V10/778 , G06V10/82 , G06V20/62 , G06V20/64 , G06V40/10 , G06V40/20 , G16H10/60 , G16H30/20 , G16H30/40
Abstract: A medical system may utilize a modular and extensible sensing device to derive a two-dimensional (2D) or three-dimensional (3D) human model for a patient in real-time based on images of the patient captured by a sensor such as a digital camera. The 2D or 3D human model may be visually presented on one or more devices of the medical system and used to facilitate a healthcare service provided to the patient. In examples, the 2D or 3D human model may be used to improve the speed, accuracy and consistency of patient positioning for a medical procedure. In examples, the 2D or 3D human model may be used to enable unified analysis of the patient's medical conditions by linking different scan images of the patient through the 2D or 3D human model. In examples, the 2D or 3D human model may be used to facilitate surgical navigation, patient monitoring, process automation, and/or the like.
-
公开(公告)号:US20230202044A1
公开(公告)日:2023-06-29
申请号:US17564919
申请日:2021-12-29
Inventor: Ziyan Wu , Srikrishna Karanam , Meng Zheng , Abhishek Sharma
CPC classification number: B25J9/1676 , G06V10/768 , G06V20/64 , G06T7/215 , B25J13/08 , G05D1/0253 , A61B6/102
Abstract: An apparatus for automated collision avoidance includes a sensor configured to detect an object of interest, predicting a representation of the object of interest at a future point in time, calculating an indication of a possibility of a collision with the object of interest based on the representation of the object of interest at the future point in time, and executing a collision avoidance action based on the indication.
-
公开(公告)号:US20230132936A1
公开(公告)日:2023-05-04
申请号:US18149111
申请日:2023-01-01
Inventor: Ziyan Wu , Srikrishna Karanam , Meng Zheng , Abhishek Sharma , Ren Li
Abstract: Systems, methods and instrumentalities are described herein for automating a medical environment. The automation may be realized using one or more sensing devices and at least one processing device. The sensing devices may be configured to capture images of the medical environment and provide the images to the processing device. The processing device may determine characteristics of the medical environment based on the images and automate one or more aspects of the operations in the medical environment. These characteristics may include, e.g., people and/or objects present in the images and respective locations of the people and/or objects in the medical environment. The operations that may be automated may include, e.g., maneuvering and/or positioning a medical device based on the location of a patient, determining and/or adjusting the parameters of a medical device, managing a workflow, providing instructions and/or alerts to a patient or a physician, etc.
-
公开(公告)号:US20230016765A1
公开(公告)日:2023-01-19
申请号:US17934186
申请日:2022-09-21
Inventor: Ziyan WU , Srikrishna Karanam
Abstract: A method for automated calibration is provided. The method may include obtaining a plurality of interest points based on prior information regarding a device and image data of the device captured by a visual sensor. The method may include identifying at least a portion of the plurality of interest points from the image data of the device. The method may also include determining a transformation relationship between a first coordinate system and a second coordinate system based on information of at least a portion of the identified interest points in the first coordinate system and in the second coordinate system that is applied to the visual sensor or the image data of the device.
-
公开(公告)号:US11430564B2
公开(公告)日:2022-08-30
申请号:US16814373
申请日:2020-03-10
Inventor: Srikrishna Karanam , Ziyan Wu
IPC: G16H30/40 , G06T7/00 , G06T7/90 , G06T17/00 , G06T7/50 , G06T7/70 , G06K9/62 , G06T17/20 , G16H10/60 , G16H30/20 , A61B5/00 , G06V10/40 , G06V10/42 , G06V20/64 , G06V40/10 , G06V40/20 , G06V20/62
Abstract: A patient's healthcare experience may be enhanced utilizing a system that automatically recognizes the patient based on one or more images of the patient and generates personalized medical assistance information for the patient based on electronic medical records stored for the patient. Such electronic medical records may comprise imagery data and/or non-imagery associated with a medical procedure performed or to be performed for the patient. As such, the imagery and/or non-imagery data may be incorporated into the personalized medical assistance information to provide positioning and/or other types of diagnostic or treatment guidance to the patient or a service provider.
-
公开(公告)号:US20210121244A1
公开(公告)日:2021-04-29
申请号:US16665804
申请日:2019-10-28
Inventor: Arun Innanje , Ziyan Wu , Srikrishna Karanam
Abstract: Methods and systems for locating one or more target features of a patient. For example, a computer-implemented method includes receiving a first input image; receiving a second input image; generating a first patient representation corresponding to the first input image; generating a second patient representation corresponding to the second input image; determining one or more first features corresponding to the first patient representation in a feature space; determining one or more second features corresponding to the second patient representation in the feature space; joining the one or more first features and the one or more second features into one or more joined features; determining one or more landmarks based at least in part on the one or more joined features; and providing a visual guidance for a medical procedure based at least in part on the information associated with the one or more landmarks.
-
公开(公告)号:US12136235B2
公开(公告)日:2024-11-05
申请号:US17559364
申请日:2021-12-22
Inventor: Meng Zheng , Srikrishna Karanam , Ziyan Wu
Abstract: Human model recovery may be realized utilizing pre-trained artificially neural networks. A first neural network may be trained to determine body keypoints of a person based on image(s) of a person. A second neural network may be trained to predict pose parameters associated with the person based on the body keypoints. A third neural network may be trained to predict shape parameters associated with the person based on depth image(s) of the person. A 3D human model may then be generated based on the pose and shape parameters respectively predicted by the second and third neural networks. The training of the second neural network may be conducted using synthetically generated body keypoints and the training of the third neural network may be conducted using normal maps. The pose and shape parameters predicted by the second and third neural networks may be further optimized through an iterative optimization process.
-
公开(公告)号:US20240177420A1
公开(公告)日:2024-05-30
申请号:US17994675
申请日:2022-11-28
Inventor: Srikrishna Karanam , Runze Li , Meng Zheng , Ziyan Wu
CPC classification number: G06T17/20 , A61B34/10 , G06T7/75 , A61B2034/105 , G06T2207/30196
Abstract: A video sequence depicting a person in a medical environment may be obtained and used for determining one or more human models of the person. A first human model representing a first pose or a first body shape of the person may be determined based on a first subset of images from the video sequence, while a second human model representing a second pose or a second body shape of the person may be determined based on a second subset of images from the video sequence. The second 2D or 3D representation of the person may include an adjustment to the first 2D or 3D representation of the person based on the observation of the person provided by the second subset of images.
-
公开(公告)号:US20240161440A1
公开(公告)日:2024-05-16
申请号:US17988328
申请日:2022-11-16
Inventor: Meng Zheng , Yuchun Liu , Fan Yang , Srikrishna Karanam , Ziyan Wu , Terrence Chen
CPC classification number: G06V10/24 , G06T7/80 , G06V10/751 , G06V10/82 , G06T2207/10024 , G06T2207/20081
Abstract: Images captured by different image capturing devices may have different fields of views and/or resolutions. One or more of these images may be aligned based on an image template, and additional details for the adapted images may be predicted using a machine-learned data recovery model and added to the adapted images such that the images may have the same field of view or the same resolution.
-
-
-
-
-
-
-
-
-