公开(公告)号：US20240370279A1

公开(公告)日：2024-11-07

申请号：US18646086

申请日：2024-04-25

Applicant: Apple Inc.

Inventor： Ashwin K. Vijay ,  Paul Ewers

IPC: G06F9/451 ,  G02B27/01 ,  G06F3/01 ,  G06F3/0484

Abstract: An electronic device may include one or more sensors that gather sensor data. The sensors may include cameras that capture images. The electronic device may determine contextual information based on the captured images and/or other sensor data. The determined contextual information may be compared to the contextual triggers of shortcuts in a shortcut database. In response to identifying a match between the determined contextual information and a shortcut in the shortcut database, the head-mounted device may present a suggestion associated with the shortcut. Based on user input, the head-mounted device may perform one or more actions associated with the shortcut and/or automatically perform the actions associated with the shortcut during subsequent identifications of the contextual trigger.

公开(公告)号：US20240393996A1

公开(公告)日：2024-11-28

申请号：US18640553

申请日：2024-04-19

Applicant: Apple Inc.

Inventor： Thomas J. Moore ,  Alesha Unpingco ,  Anshu K. Chimalamarri ,  Ashwin K. Vijay ,  Christopher D. Fu ,  Guilherme Klink ,  In Young Yang ,  Paul Ewers ,  Paulo R. Jansen dos Reis ,  Peter Burgner ,  Thomas G. Salter ,  Tigran Khachatryan

IPC: G06F3/14 ,  G06F3/01

Abstract: A head-mounted device may be used to perform a visual search on a physical environment around the head-mounted device. A user may wish to visually search one out of multiple physical objects in the physical environment. To clearly show the user which physical object was the target of a visual search, the head-mounted device may present a thumbnail of the candidate physical object on a display. The thumbnail may be cropped and/or zoomed using an image from a camera on the head-mounted device. By displaying a thumbnail that is taken by a camera on the head-mounted device, the thumbnail will directly match the physical object in the user's physical environment, eliminating ambiguity regarding which physical object is the subject of the visual search.

公开(公告)号：US20240370082A1

公开(公告)日：2024-11-07

申请号：US18644218

申请日：2024-04-24

Applicant: Apple Inc.

Inventor： Guilherme Klink ,  Andrew Muehlhausen ,  Gregory Lutter ,  Luis R. Deliz Centeno ,  Paulo R. Jansen dos Reis ,  Peter Burgner ,  Rahul Nair ,  Yutaka Yokokawa ,  Anshu K. Chimalamarri ,  Ashwin K. Vijay ,  Benjamin S. Phipps ,  Brandon K. Schmuck

IPC: G06F3/01 ,  G02B27/01 ,  G06F3/038

Abstract: A head-mounted device may be used to control one or more external electronic devices. Gaze input and camera images may be used to determine a point of gaze relative to a display for an external electronic device. The external electronic device may receive information regarding the user's gaze input from the head-mounted device and may highlight one out of multiple user interface elements that is targeted by the gaze input. The head-mounted device may receive input such as keystroke information from an accessory device and relay the input to an external electronic device that is being viewed. The head-mounted device may receive a display configuration request, determine layout information for displays in the physical environment of the head-mounted device, and transmit the layout information to an external device associated with the displays.