公开(公告)号：US20220202515A1

公开(公告)日：2022-06-30

申请号：US17612165

申请日：2020-05-27

Applicant: Intuitive Surgical Operations, Inc.

Inventor： Brandon D. Itkowitz ,  Heath Feather ,  Alexandre V. Matveev

IPC: A61B34/37 ,  A61B90/00 ,  G02B27/00 ,  G06F3/01 ,  G06F3/0346

Abstract: An exemplary system may access head presence data and eye tracking data. The head presence data indicates a presence or an absence of a head of a user within a vicinity of a viewer console. The eye tracking data indicates whether an eye of a user is gazing at a display device. If the head presence data indicates that the head of the user is present and the eye tracking data indicates that the eye of the user is gazing at the display device, the system directs the user control system to operate in a first operating mode. If the head presence data indicates that the head of the user is present and the eye tracking data indicates that the eye of the user is not gazing at the display device, the system directs the user control system to operate in a second operating mode different from the first operating mode.

公开(公告)号：US20240196099A1

公开(公告)日：2024-06-13

申请号：US18584185

申请日：2024-02-22

Applicant: Intuitive Surgical Operations, Inc.

Inventor： Zhen He ,  Jeffrey M. DiCarlo ,  Heath Feather

IPC: H04N23/73 ,  H04N23/62 ,  H04N23/741

CPC classification number: H04N23/73 ,  H04N23/62 ,  H04N23/741

Abstract: An illustrative apparatus may perform gaze-based auto-exposure management of images. For example, the apparatus may determine, for an image captured by an image capture system, auto-exposure-related characteristics of pixel units into which the image is divided. The apparatus may update, based on the auto-exposure-related characteristics determined for the pixel units and on eye tracking data for a viewer viewing the image, one or more auto-exposure parameters for use by the image capture system to capture an additional image within an image sequence. Corresponding apparatuses, systems, and methods for gaze-based auto-exposure management of images are also disclosed.

公开(公告)号：US11936989B2

公开(公告)日：2024-03-19

申请号：US17369688

申请日：2021-07-07

Applicant: Intuitive Surgical Operations, Inc.

Inventor： Zhen He ,  Jeffrey M. DiCarlo ,  Heath Feather

IPC: H04N23/73 ,  H04N23/62 ,  H04N23/741

CPC classification number: H04N23/73 ,  H04N23/62 ,  H04N23/741

Abstract: An illustrative apparatus may perform gaze-based auto-exposure management of image frames. For example, the apparatus may determine, for an image frame within an image frame sequence captured by an image capture system, auto-exposure values for pixel units into which the image frame is divided. The apparatus may then assign weight values to the pixel units based on a gaze direction of a viewer viewing the image frame sequence. Based on the auto-exposure values determined for the pixel units and the weight values assigned to the pixel units, the apparatus may update one or more auto-exposure parameters for use by the image capture system to capture an additional image frame within the image frame sequence. Corresponding apparatuses, systems, and methods for gaze-based auto-exposure management of image frames are also disclosed.

公开(公告)号：US20220014664A1

公开(公告)日：2022-01-13

申请号：US17369688

申请日：2021-07-07

Applicant: Intuitive Surgical Operations, Inc.

Inventor： Zhen He ,  Jeffrey M. DiCarlo ,  Heath Feather

IPC: H04N5/235 ,  H04N5/232

Abstract: An illustrative apparatus may perform gaze-based auto-exposure management of image frames. For example, the apparatus may determine, for an image frame within an image frame sequence captured by an image capture system, auto-exposure values for pixel units into which the image frame is divided. The apparatus may then assign weight values to the pixel units based on a gaze direction of a viewer viewing the image frame sequence. Based on the auto-exposure values determined for the pixel units and the weight values assigned to the pixel units, the apparatus may update one or more auto-exposure parameters for use by the image capture system to capture an additional image frame within the image frame sequence. Corresponding apparatuses, systems, and methods for gaze-based auto-exposure management of image frames are also disclosed.

公开(公告)号：US20240108425A1

公开(公告)日：2024-04-04

申请号：US18483272

申请日：2023-10-09

Applicant: INTUITIVE SURGICAL OPERATIONS, INC.

Inventor： Tabish Mustufa ,  Heath Feather ,  Daniel H. Gomez ,  Brian D. Hoffman ,  Paul W. Mohr ,  Huan L. Phan

IPC: A61B34/35 ,  A61B34/00 ,  A61B34/37 ,  A61B90/00

CPC classification number: A61B34/35 ,  A61B34/25 ,  A61B34/37 ,  A61B34/74 ,  A61B90/00 ,  A61B90/361 ,  A61B2017/00199 ,  A61B2034/254 ,  A61B2034/742

Abstract: A system comprises a teleoperational assembly including an operator control system and a first teleoperational manipulator configured for operation by an operator control device of the operator control system. The first teleoperational manipulator is configured to control the operation of a first medical instrument in a surgical environment. The system also comprises a processing unit including one or more processors. The processing unit is configured to display an image of a field of view of the surgical environment and display a menu proximate to an image of the first medical instrument in the image of the field of view. The menu includes at least one icon representing a function for the first medical instrument.

公开(公告)号：US11726559B2

公开(公告)日：2023-08-15

申请号：US16391981

申请日：2019-04-23

Applicant: INTUITIVE SURGICAL OPERATIONS, INC.

Inventor： Brandon D. Itkowitz ,  Joseph M. Arsanious ,  Christopher R. Burns ,  Heath Feather

IPC: G06F3/16 ,  G06F3/01 ,  G16H80/00 ,  G06F3/04817

CPC classification number: G06F3/013 ,  G06F3/04817 ,  G06F3/167 ,  G16H80/00

Abstract: A method comprises displaying an image of an environment on a graphical user interface, the environment including personnel elements visible in the image, detecting a gaze of a user directed at an image of a first personnel element corresponding to a first information conveyor of a plurality of information conveyors, changing a state of the first information conveyor corresponding to the first personnel element from a passive state to a listening state in response to detecting that the gaze is directed at the image of the first personnel element, wherein the first information conveyor includes a first audio output device, receiving audio information through an audio input device, and when the state of the first information conveyor is changed to the listening state, controlling an output operation, wherein the output operation includes directing the received audio information as an audio output through the first audio output device.

公开(公告)号：US20210344896A1

公开(公告)日：2021-11-04

申请号：US17271522

申请日：2019-08-28

Applicant: Intuitive Surgical Operations, Inc.

Inventor： Heath Feather ,  Randal P. Goldberg ,  Alexandre V. Matveev

IPC: H04N13/383 ,  H04N5/225 ,  G02B27/00 ,  G02B30/35 ,  G02B1/11

Abstract: An apparatus includes a controller coupled to a stereoscopic image viewer. The stereoscopic image viewer includes a viewing lens, an image capture unit, and a plurality of light sources. The image capture unit is configured to capture image frames. The controller receives the captured image frames. The controller is configured to switch light output from one of the plurality of light sources to another one of the plurality of light sources if a corneal reflection in a captured image frame intersects a fixed reflection in the captured image frame.

公开(公告)号：US20210212773A1

公开(公告)日：2021-07-15

申请号：US17055073

申请日：2019-05-15

Applicant: INTUITIVE SURGICAL OPERATIONS, INC.

Inventor： Heath Feather ,  Brandon D. Itkowitz ,  Alexandre V. Matveev

IPC: A61B34/00 ,  A61B34/37 ,  A61B34/20 ,  A61B90/00

Abstract: A console for a medical includes a display, an eye tracking input module, a second input module, and one or more processors coupled to the display, the eye tracking input module, and the second input module. The one or more processors is configured to perform operations including receiving a first user input from the eye tracking input module; determining, based on the first user input, whether a gaze of a user is directed toward an activation region of the display; in response to determining that the gaze of the user is directed toward the activation region, displaying, via the display, a control; receiving a second user input from the second input module; and adjusting the control based on the second user input.

公开(公告)号：US20210093402A1

公开(公告)日：2021-04-01

申请号：US17061785

申请日：2020-10-02

Applicant: INTUITIVE SURGICAL OPERATIONS, INC.

Inventor： Tabish Mustufa ,  Heath Feather ,  Daniel H. Gomez ,  Brian D. Hoffman ,  Paul W. Mohr ,  Huan L. Phan

IPC: A61B34/35 ,  A61B90/00 ,  A61B34/00 ,  A61B34/37

Abstract: A method comprises displaying an image of a field of view of a surgical environment. A first medical instrument in the field of view may be coupled to a first manipulator in a teleoperational assembly. The method may comprise displaying a menu proximate to an image of the first medical instrument in the image of the field of view. The menu may include a plurality of icons wherein each icon is associated with a function for the first medical instrument. The method may also comprise identifying a selected icon from the plurality of icons based upon a movement of an operator control device of a teleoperational operator control system.

公开(公告)号：US20190324533A1

公开(公告)日：2019-10-24

申请号：US16391981

申请日：2019-04-23

Applicant: INTUITIVE SURGICAL OPERATIONS, INC.

Inventor： Brandon D. Itkowitz ,  Joseph M. Arsanious ,  Christopher R. Burns ,  Heath Feather

IPC: G06F3/01 ,  G06F3/0481 ,  G16H80/00 ,  G06F3/16

Abstract: A method and apparatus for gaze-based communications. A gaze of a user is detected being directed at an element in a graphical user interface. The graphical user interface is displayed on a display system located in an environment. A state of the element is changed in response to detecting that the gaze is directed at the element. Audio information is received through an audio input device. An output operation is controlled based on the state of the element such that the audio information received through the audio input device is directed to an information conveyor corresponding to the element.