摘要:
A calibration platform may obtain measurements for aligning a real-world coordinate system and a display coordinate system. For example, the calibration platform may display, via an optical see-through head-mounted display (OST-HMD), a three-dimensional virtual object and receive, from a positional tracking device, information that relates to a current pose of a three-dimensional real-world object to be aligned with the three-dimensional virtual object. The calibration platform may record a three-dimensional position of a plurality of points on the three-dimensional real-world object based on the current pose of the three-dimensional real-world object, based on an indication that the plurality of points on the three-dimensional real-world object respectively corresponds with a plurality of points on the three-dimensional virtual object. Accordingly, based on the obtained measurements, the calibration platform may generate a transformation function to provide a mapping between three-dimensional points in the real-world coordinate system and three-dimensional points in the display coordinate system.
摘要:
A calibration platform may display, via an optical see-through head-mounted display (OST-HMD), a virtual image having at least one feature. The calibration platform may determine, based on information relating to a gaze of a user wearing the OST-HMD, that the user performed a voluntary eye blink to indicate that the at least one feature of the virtual image appears to the user to be aligned with at least one point on the three-dimensional real-world object. The calibration platform may record an alignment measurement based on a position of the at least one point on the three-dimensional real-world object in a real-world coordinate system based on a time when the user performed the voluntary eye blink. Accordingly, the alignment measurement may be used to generate a function providing a mapping between three-dimensional points in the real-world coordinate system and corresponding points in a display space of the OST-HMD.
摘要:
A device may determine a view of a user of a head mounted display. The device may obtain tracking data relating to a surgical procedure. The device may obtain, from an imaging device, surgical imaging relating to the surgical procedure. The device may orient models of objects based on the tracking data and the view of the user of the head mounted display, wherein the objects includes the imaging device. The device may augment, by providing output to the head mounted display for display, the view of the user with contextual information relating to the objects based on orienting the models based on the tracking data and the view of the user, wherein the contextual information includes the surgical imaging captured by an imaging device.
摘要:
In one embodiment of the invention, a a minimally invasive surgical system is disclosed. The system configured to capture and display camera images of a surgical site on at least one display device at a surgeon console; switch out of a following mode and into a masters-as-mice (MaM) mode; overlay a graphical user interface (GUI) including an interactive graphical object onto the camera images; and render a pointer within the camera images for user interactive control. In the following mode, the input devices of the surgeon console may couple motion into surgical instruments. In the MaM mode, the input devices interact with the GUI and interactive graphical objects. The pointer is manipulated in three dimensions by input devices having at least three degrees of freedom. Interactive graphical objects are related to physical objects in the surgical site or a function thereof and are manipulatable by the input devices.
摘要:
The present invention is directed to a method and system for photoacoustic imaging for guiding medical procedures. A transducer is placed near the site of the procedure. The optical fiber, coupled to an electromagnetic source, such as a laser, is attached to a medical device. During the procedure, the device and optical fiber are inserted into the procedure site where the optical fiber illuminates the procedure site, which has a thickness of approximately 2 mm. Photoacoustic images are acquired to visualize the procedure site as the procedure is proceeding in order to provide real-time guidance. This system is applicable to multiple surgical and interventional procedures, such as transsphenoidal surgery.