摘要:
A system captures and displays video of surgeries. The system may include at least one digital image sensor optically coupled to one or more lenses and configured to capture a video sequence of a scene in a surgery; at least one interface configured to receive at least one region on interest (ROI) of the captured video sequence; an electronic display, selected so that at least one of the digital image sensors has a pixel resolution which is substantially greater than the pixel resolution of the electronic display; and a computer processor configured to: receive the at least one captured video sequence and the at least one received ROI and display over the at least one electronic display a portion of the captured video sequence based on the at least one selected ROI.
摘要:
An eye-tracking system is provided that includes a light source configured to emit at least infrared (IR) light and a microelectromechanical system (MEMS) scanning mirror configured to direct the IR light. The system further includes a relay including at least one prism, and the relay is configured to receive the IR light directed by the MEMS scanning mirror and redirect the IR light. The system further includes a waveguide through which the IR light redirected by the relay passes to reach an eye, and at least one sensor configured to receive the IR light after being reflected by the eye.
摘要:
The invention relates to a head mounded display that outputs an audio signal of an external digital device according to whether the audio signal is directional output signal.
摘要:
A system and method are provided for facilitating hands free and precise movement, translation and repositioning of a movable mechanical apparatus, including an operating room lighting system, mounted to a mechanically-movable base component including, for example, an articulable or articulated robotic-type arm, according to user input pointing commands, including laser or other like pointing commands initiated by a user. The user provides hands free designation of a point of focus with a pointing device. A sensor associated with the movable mechanical apparatus automatically detects the designated point of focus and a processor determines and executes a scheme of movement for moving the movable mechanical apparatus from a current position to a position proximate to the designated point of focus. A collision avoidance scheme is also provided for safety and to alert the user as to the presence of any impediment in the determined scheme of movement.
摘要:
A system and related methods for visually augmenting an appearance of a physical environment as seen by a user through a head-mounted display device are provided. In one embodiment, a virtual environment generating program receives eye-tracking information, lighting information, and depth information from the head-mounted display. The program generates a virtual environment that models the physical environment and is based on the lighting information and the distance of a real-world object from the head-mounted display. The program visually augments a virtual object representation in the virtual environment based on the eye-tracking information, and renders the virtual object representation on a transparent display of the head-mounted display device.
摘要:
An adaptive learning interface system for end-users for controlling one or more machines or robots to perform a given task, combining identification of gaze patterns, EEG channel's signal patterns, voice commands and/or touch commands. The output streams of these sensors are analysed by the processing unit in order to detect one or more patterns that are translated into one or more commands to the robot, to the processing unit or to other devices. A pattern learning mechanism is implemented by keeping immediate history of outputs collected from those sensors, analysing their individual behaviour and analysing time correlation between patterns recognized from each of the sensors. Prediction of patterns or combination of patterns is enabled by analysing partial history of sensors' outputs. A method for defining a common coordinate system between robots and sensors in a given environment, and therefore dynamically calibrating these sensors and devices, is used to share characteristics and positions of each object detected on the scene.
摘要:
The invention relates to a head mounded display that outputs an audio signal of an external digital device according to whether the audio signal is directional output signal.
摘要:
A system and related methods for visually augmenting an appearance of a physical environment as seen by a user through a head-mounted display device are provided. In one embodiment, a virtual environment generating program receives eye-tracking information, lighting information, and depth information from the head-mounted display. The program generates a virtual environment that models the physical environment and is based on the lighting information and the distance of a real-world object from the head-mounted display. The program visually augments a virtual object representation in the virtual environment based on the eye-tracking information, and renders the virtual object representation on a transparent display of the head-mounted display device.