Method and system of hand segmentation and overlay using depth data

    公开(公告)号:US10929656B2

    公开(公告)日:2021-02-23

    申请号:US16527413

    申请日:2019-07-31

    Abstract: In a minimally invasive surgical system, a plurality of video images is acquired. Each image includes a hand pose image. Depth data for the hand pose image is also acquired or synthesized. The hand pose image is segmented from the image using the depth data. The segmented image is combined with an acquired surgical site image using the depth data. The combined image is displayed to a person at a surgeon's console of the minimally invasive surgical system. Processing each of the video images in the plurality video images in this way reproduces the hand gesture overlaid on the video of the surgical site in the display.

    SYSTEMS AND METHODS FOR RENDERING ONSCREEN IDENTIFICATION OF INSTRUMENTS IN A TELEOPERATIONAL MEDICAL SYSTEM

    公开(公告)号:US20200246094A1

    公开(公告)日:2020-08-06

    申请号:US16855144

    申请日:2020-04-22

    Abstract: A system comprises a teleoperational assembly including an operator control system and manipulators configured for teleoperation by the operator control system. A first manipulator controls a first medical instrument in a surgical environment and a second manipulator controls an imaging instrument. The system also comprises a processing unit to display an image of a field of view of the surgical environment captured by the imaging instrument and determine a position of a distal portion of the first medical instrument in an image coordinate space. The processing unit determines an initial position for a first badge associated with the distal portion of the first medical instrument and determine a badge placement boundary for the image of the field of view. The processing unit also adjusts the first badge from the initial position to a display position within the badge placement boundary of the image of the field of view.

    Methods of controlling motion of under-actuated joints in a surgical set-up structure

    公开(公告)号:US10709515B2

    公开(公告)日:2020-07-14

    申请号:US16002509

    申请日:2018-06-07

    Abstract: Robotic and/or surgical devices, systems, and methods include kinematic linkage structures and associated control systems configured to control movement of passive or under-actuated joints by coordinated joint braking of the under-actuated joints concurrent with driving of one or more driven joints. In one aspect, the methods include driving a set-up structure by pivoting an orienting platform supporting multiple manipulators back-and-forth in opposite directions while selectively braking the under-actuated joints to inhibit passive joint movement away from a reference joint state and releasing braking to facilitate movement of the joints toward the reference until each of the under-actuated joints of the multiple manipulators are at the respective reference states. In another aspect, a joint brake controller is provided that receives a motor torque input and converts the input to a brake control input by determining an impulse applied variable braking to deplete the impulse over time.

    SYSTEMS AND METHODS FOR SWITCHING CONTROL BETWEEN MULTIPLE INSTRUMENT ARMS

    公开(公告)号:US20200163731A1

    公开(公告)日:2020-05-28

    申请号:US16630134

    申请日:2018-07-12

    Abstract: Systems and methods for reassigning control by a master controller between a plurality of teleoperational instruments is provided herein. An exemplary method includes detecting activation of an instrument reassignment input, computing proxy positions of at least a first instrument and a second instrument of the plurality of teleoperational instruments, and computing a proxy position of the master controller. The exemplary method may also include receiving input from the master controller associating the proxy position of the master controller with the proxy position of the second medical instrument and assigning control of the second instrument to the master controller based on the association between the proxy position of the master controller with the proxy position of the second instrument.

    SYSTEMS AND METHODS FOR RENDERING ONSCREEN IDENTIFICATION OF INSTRUMENTS IN A TELEOPERATIONAL MEDICAL SYSTEM

    公开(公告)号:US20190388168A1

    公开(公告)日:2019-12-26

    申请号:US16558918

    申请日:2019-09-03

    Abstract: A teleoperational assembly is disclosed which includes an operator control system and a plurality of manipulators configured to control the movement of medical instruments in a surgical environment. The manipulators are teleoperationally controlled by the operator control system. The system further includes a processing unit configured to display an image of a field of view of the surgical environment, project the position of distal end portions of the medical instruments into the image's coordinate space, determine initial positions for badges associated with the distal end portions of each medical instrument, evaluate a display factor for each badge based on its initial position, and determine a final display position for each badge in the image's coordinate space based on the display factor.

Patent Agency Ranking