公开(公告)号：US20240411422A1

公开(公告)日：2024-12-12

申请号：US18695280

申请日：2022-08-30

Applicant: Apple Inc.

Inventor： Paulo R. Jansen dos Reis ,  Christopher D. Fu

IPC: G06F3/04817 ,  G06V10/26 ,  G06V10/762

Abstract: In one implementation, a method of displaying a plurality of glints method includes capturing an image of an environment including a plurality of objects. The method includes detecting, in the image of the environment, a plurality of actionable items respectively associated with a plurality of actions. The method includes relating the actionable items to respective ones of the plurality of objects. The method includes displaying a plurality of group user interface elements in respective association with the plurality of objects. The method includes detecting user input directed to a particular group user interface element of the plurality of group user interface elements associated with a particular object of the plurality of objects. The method includes displaying a plurality of user interface elements in respective association with those of the plurality of actionable items related to the particular object.

公开(公告)号：US20230297607A1

公开(公告)日：2023-09-21

申请号：US18121988

申请日：2023-03-15

Applicant: Apple Inc.

Inventor： Thomas G. Salter ,  Christopher D. Fu ,  Devin W. Chalmers ,  Paulo R. Jansen dos Reis

IPC: G06F16/438 ,  G06F16/432

CPC classification number: G06F16/438 ,  G06F16/434

Abstract: In one implementation, a method of presenting virtual content is performed by a device including an image sensor, one or more processors, and non-transitory memory. The method includes obtaining, using the image sensor, an image of a physical environment. The method includes detecting, in the image of the physical environment, machine-readable content associated with an object. The method includes determining an object type of the object. The method includes obtaining virtual content based on a search query creating using the machine-readable content and the object type. The method includes displaying the virtual content.

公开(公告)号：US20250111471A1

公开(公告)日：2025-04-03

申请号：US18825453

申请日：2024-09-05

Applicant: Apple Inc.

Inventor： Elena J. Nattinger ,  Michael J. Rockwell ,  Christopher I. Word ,  Devin W. Chalmers ,  Paulo R. Jansen dos Reis ,  Paul Ewers ,  Peter Burgner ,  Anna L. Brewer ,  Jeffrey S. Norris ,  Allison W. Dryer ,  Andrew Muehlhausen ,  Luis R. Deliz Centeno ,  Thomas J. Moore ,  Alesha Unpingco ,  Thomas G. Salter

IPC: G06T3/40 ,  G06F3/01

Abstract: Embodiments disclosed herein are directed to devices, systems, and methods for presenting a magnified view in an extended reality environment. Specifically, a magnified view includes a zoom reticle that is presented at a display location of a display. The zoom reticle includes magnified content that includes a magnified portion of a user's field of view. For example, the magnified content may be generated from image data selected from a corresponding portion of a field of view of a camera. The position of the zoom reticle on the display, as well as the portion of the field of view that is magnified, may vary in different circumstances such as described herein.

公开(公告)号：US20240393996A1

公开(公告)日：2024-11-28

申请号：US18640553

申请日：2024-04-19

Applicant: Apple Inc.

Inventor： Thomas J. Moore ,  Alesha Unpingco ,  Anshu K. Chimalamarri ,  Ashwin K. Vijay ,  Christopher D. Fu ,  Guilherme Klink ,  In Young Yang ,  Paul Ewers ,  Paulo R. Jansen dos Reis ,  Peter Burgner ,  Thomas G. Salter ,  Tigran Khachatryan

IPC: G06F3/14 ,  G06F3/01

Abstract: A head-mounted device may be used to perform a visual search on a physical environment around the head-mounted device. A user may wish to visually search one out of multiple physical objects in the physical environment. To clearly show the user which physical object was the target of a visual search, the head-mounted device may present a thumbnail of the candidate physical object on a display. The thumbnail may be cropped and/or zoomed using an image from a camera on the head-mounted device. By displaying a thumbnail that is taken by a camera on the head-mounted device, the thumbnail will directly match the physical object in the user's physical environment, eliminating ambiguity regarding which physical object is the subject of the visual search.

公开(公告)号：US20240370082A1

公开(公告)日：2024-11-07

申请号：US18644218

申请日：2024-04-24

Applicant: Apple Inc.

Inventor： Guilherme Klink ,  Andrew Muehlhausen ,  Gregory Lutter ,  Luis R. Deliz Centeno ,  Paulo R. Jansen dos Reis ,  Peter Burgner ,  Rahul Nair ,  Yutaka Yokokawa ,  Anshu K. Chimalamarri ,  Ashwin K. Vijay ,  Benjamin S. Phipps ,  Brandon K. Schmuck

IPC: G06F3/01 ,  G02B27/01 ,  G06F3/038

Abstract: A head-mounted device may be used to control one or more external electronic devices. Gaze input and camera images may be used to determine a point of gaze relative to a display for an external electronic device. The external electronic device may receive information regarding the user's gaze input from the head-mounted device and may highlight one out of multiple user interface elements that is targeted by the gaze input. The head-mounted device may receive input such as keystroke information from an accessory device and relay the input to an external electronic device that is being viewed. The head-mounted device may receive a display configuration request, determine layout information for displays in the physical environment of the head-mounted device, and transmit the layout information to an external device associated with the displays.

公开(公告)号：US20250045324A1

公开(公告)日：2025-02-06

申请号：US18695268

申请日：2022-09-16

Applicant: Apple Inc.

Inventor： Christopher D. Fu ,  Devin W. Chalmers ,  Matthias Dantone ,  Paulo R. Jansen dos Reis

IPC: G06F16/583 ,  G06F3/01 ,  G06F16/58 ,  G06F16/587

Abstract: In one implementation, a method of storing object information in association with contextual information is performed at a device including an image sensor, one or more processors, and non-transitory memory. The method includes capturing, using the image sensor, an image of an environment. The method includes detecting a user engagement with an object in the environment based on the image of the environment. The method includes, in response to detecting the user engagement with the object, obtaining information regarding the object, obtaining contextual information, and storing, in a database, an entry including the information regarding the object in association with the contextual information.

公开(公告)号：US20240393919A1

公开(公告)日：2024-11-28

申请号：US18666021

申请日：2024-05-16

Applicant: Apple Inc.

Inventor： Andrew Muehlhausen ,  Elena J. Nattinger ,  Devin W. Chalmers ,  Paul Ewers ,  Paulo R. Jansen dos Reis ,  Peter Burgner ,  Christopher D. Fu ,  Richard P. Lozada

IPC: G06F3/0482 ,  G06F3/01 ,  G06F3/04817 ,  G06F3/16

Abstract: Systems and methods for facilitating selection of a target object required by a request from a user from a set of candidate objects include identifying the set of candidate objects in a gaze region corresponding to a gaze of the user and generating a graphical user interface allowing a user to select the target object from the set of candidate objects.

公开(公告)号：US20240184986A1

公开(公告)日：2024-06-06

申请号：US18286608

申请日：2022-04-26

Applicant: Apple Inc.

Inventor： Christopher D. Fu ,  Devin W. Chalmers ,  Paulo R. Jansen dos Reis

IPC: G06F40/274 ,  G06F3/04886 ,  G06V20/50 ,  G06V20/70 ,  G10L25/51

CPC classification number: G06F40/274 ,  G06F3/04886 ,  G06V20/50 ,  G06V20/70 ,  G10L25/51

Abstract: In one implementation, a method of displaying text suggestions is performed at a device including an input device, a display, an image sensor, one or more processors, and non-transitory memory. The method includes obtaining, using the image sensor, one or more images of a physical environment. The method includes obtaining one or more semantic labels associated with the physical environment based on the one or more images of the physical environment. The method includes receiving, via the input device, text. The method includes determining one or more text suggestions based on the one or more semantic labels associated with the physical environment and the text. The method includes displaying, on the display, the one or more text suggestions.