Abstract:
An operator telerobotically controls tools to perform a procedure on an object at a work site while viewing real-time images of the work site on a display. Tool information is provided in the operator's current gaze area on the display by rendering the tool information over the tool so as not to obscure objects being worked on at the time by the tool nor to require eyes of the user to refocus when looking at the tool information and the image of the tool on a stereo viewer.
Abstract:
In a minimally invasive surgical system, a plurality of video images is acquired. Each image includes a hand pose image. Depth data for the hand pose image is also acquired or synthesized. The hand pose image is segmented from the image using the depth data. The segmented image is combined with an acquired surgical site image using the depth data. The combined image is displayed to a person at a surgeon's console of the minimally invasive surgical system. Processing each of the video images in the plurality video images in this way reproduces the hand gesture overlaid on the video of the surgical site in the display.
Abstract:
The present disclosure relates to systems, methods, and tools for tool tracking using image-derived data from one or more tool-located references features. In some embodiments, an associated medical system includes a tool having a distal end that is insertable into a patient body, a stereo image capture device insertable into the patient body so that the stereo image capture device captures a stereo image of at least a portion of the a two-dimensional marker at least partially surrounding a portion of the tool, and a processor coupled to the image capture device and configured to determine a pose of the tool by processing the stereo image. Associated methods and tools are also provided.
Abstract:
A robotic system includes a camera having an image frame whose position and orientation relative to a fixed frame is determinable through one or more image frame transforms, a tool disposed within a field of view of the camera and having a tool frame whose position and orientation relative to the fixed frame is determinable through one or more tool frame transforms, and at least one processor programmed to identify pose indicating points of the tool from one or more camera captured images, determine an estimated transform for an unknown one of the image and tool frame transforms using the identified pose indicating points and known ones of the image and tool frame transforms, update a master-to-tool transform using the estimated and known ones of the image and tool frame transforms, and command movement of the tool in response to movement of a master using the updated master-to-tool transform.
Abstract:
An endoscope with an optical channel is held and positioned by a robotic surgical system. A capture unit captures (1) a visible first image at a first time and (2) a visible second image combined with a fluorescence image from the light at a second time. An image processing system receives (1) the visible first image and (2) the visible second image combined with the fluorescence image and generates at least one fluorescence image. A display system outputs an output image including an artificial fluorescence image.
Abstract:
A method of modeling anatomic deformation comprises receiving a reference three dimensional model of a branched anatomical formation in a reference state. The method further comprises applying a three dimensional deformation field to the reference three dimensional model to create a deformed three dimensional model of a deformed state of the branched anatomical formation and dynamically displaying an image of the deformed three dimensional model of the deformed state of the branched anatomical formation.
Abstract:
An anatomical probe system comprises an elongated flexible body and an elongated probe extending within the flexible body. The probe has a distal end and includes an outer wall defining a channel. The probe also includes an access port in the outer wall in communication with the channel. The access port is spaced proximally of the distal end.
Abstract:
A method of planning a procedure to deploy an interventional instrument comprises receiving a model of an anatomic structure. The anatomic structure includes a plurality of passageways. The method further includes identifying a target structure in the model and receiving information about an operational capability of the interventional instrument within the plurality of passageways. The method further comprises identifying a planned deployment location for positioning a distal tip of the interventional instrument to perform the procedure on the target structure based upon the operational capability of the interventional instrument.
Abstract:
An operator telerobotically controls tools to perform a procedure on an object at a work site while viewing real-time images of the work site on a display. Tool information is provided in the operator's current gaze area on the display by rendering the tool information over the tool so as not to obscure objects being worked on at the time by the tool nor to require eyes of the user to refocus when looking at the tool information and the image of the tool on a stereo viewer.
Abstract:
A system may comprise a tool including at least one reference feature. a processor, and a memory having computer readable instructions stored thereon. The computer readable instructions, when executed by the processor, may cause the system to receive image data including an image of the tool and the at least one reference feature, determine a pose of the tool from the image data, and modify the image data to visually decrement a portion of the image data corresponding to the at least one reference feature.