公开(公告)号：US20240370279A1

公开(公告)日：2024-11-07

申请号：US18646086

申请日：2024-04-25

Applicant: Apple Inc.

Inventor： Ashwin K. Vijay ,  Paul Ewers

IPC: G06F9/451 ,  G02B27/01 ,  G06F3/01 ,  G06F3/0484

Abstract: An electronic device may include one or more sensors that gather sensor data. The sensors may include cameras that capture images. The electronic device may determine contextual information based on the captured images and/or other sensor data. The determined contextual information may be compared to the contextual triggers of shortcuts in a shortcut database. In response to identifying a match between the determined contextual information and a shortcut in the shortcut database, the head-mounted device may present a suggestion associated with the shortcut. Based on user input, the head-mounted device may perform one or more actions associated with the shortcut and/or automatically perform the actions associated with the shortcut during subsequent identifications of the contextual trigger.

公开(公告)号：US12213019B2

公开(公告)日：2025-01-28

申请号：US18511651

申请日：2023-11-16

Applicant: APPLE INC.

Inventor： David W. Padgett ,  Christopher D. Fu ,  Scott G. Wade ,  Paul Ewers ,  Ioana Negoita ,  Thomas G. Salter ,  Dhruv Aditya Govil ,  Dimitris Ladopoulos

IPC: H04W4/02 ,  A63F13/213 ,  G02B27/01 ,  G06F3/01 ,  G06F3/0482 ,  G06Q30/02 ,  G06T19/00

Abstract: A method includes obtaining an image of a machine-readable data representation that is located on a physical object using a camera of an electronic device. The machine-readable data representation includes an encoded form of a data value. The method further includes decoding the machine-readable data representation to determine the data value, whereby the data value includes a content identifier and a content source identifier. The method also includes selecting a content source based on the content source identifier, obtaining a content item and content location information based on the content identifier from the content source, determining a content position and a content orientation for the content item relative to the physical object based on the content location information, and displaying a representation of the content item using the electronic device according to the content position and the content orientation.

公开(公告)号：US20240393996A1

公开(公告)日：2024-11-28

申请号：US18640553

申请日：2024-04-19

Applicant: Apple Inc.

Inventor： Thomas J. Moore ,  Alesha Unpingco ,  Anshu K. Chimalamarri ,  Ashwin K. Vijay ,  Christopher D. Fu ,  Guilherme Klink ,  In Young Yang ,  Paul Ewers ,  Paulo R. Jansen dos Reis ,  Peter Burgner ,  Thomas G. Salter ,  Tigran Khachatryan

IPC: G06F3/14 ,  G06F3/01

Abstract: A head-mounted device may be used to perform a visual search on a physical environment around the head-mounted device. A user may wish to visually search one out of multiple physical objects in the physical environment. To clearly show the user which physical object was the target of a visual search, the head-mounted device may present a thumbnail of the candidate physical object on a display. The thumbnail may be cropped and/or zoomed using an image from a camera on the head-mounted device. By displaying a thumbnail that is taken by a camera on the head-mounted device, the thumbnail will directly match the physical object in the user's physical environment, eliminating ambiguity regarding which physical object is the subject of the visual search.

公开(公告)号：US20240089695A1

公开(公告)日：2024-03-14

申请号：US18511651

申请日：2023-11-16

Applicant: APPLE INC.

Inventor： David W. Padgett ,  Christopher D. Fu ,  Scott G. Wade ,  Paul Ewers ,  Ioana Negoita ,  Thomas G. Salter ,  Dhruv Aditya Govil ,  Dimitris Ladopoulos

IPC: H04W4/02 ,  A63F13/213 ,  G02B27/01 ,  G06F3/01 ,  G06F3/0482 ,  G06Q30/02 ,  G06T19/00

CPC classification number: H04W4/02 ,  A63F13/213 ,  G02B27/017 ,  G06F3/011 ,  G06F3/0482 ,  G06Q30/02 ,  G06T19/006

Abstract: A method includes obtaining an image of a machine-readable data representation that is located on a physical object using a camera of an electronic device. The machine-readable data representation includes an encoded form of a data value. The method further includes decoding the machine-readable data representation to determine the data value, whereby the data value includes a content identifier and a content source identifier. The method also includes selecting a content source based on the content source identifier, obtaining a content item and content location information based on the content identifier from the content source, determining a content position and a content orientation for the content item relative to the physical object based on the content location information, and displaying a representation of the content item using the electronic device according to the content position and the content orientation.

公开(公告)号：US11825375B2

公开(公告)日：2023-11-21

申请号：US17989226

申请日：2022-11-17

Applicant: APPLE INC.

Inventor： David W. Padgett ,  Christopher D. Fu ,  Scott G. Wade ,  Paul Ewers ,  Ioana Negoita ,  Thomas G. Salter ,  Dhruv Aditya Govil ,  Dimitris Ladopoulos

IPC: H04W4/02 ,  A63F13/213 ,  G02B27/01 ,  G06F3/01 ,  G06F3/0482 ,  G06Q30/02 ,  G06T19/00

CPC classification number: H04W4/02 ,  A63F13/213 ,  G02B27/017 ,  G06F3/011 ,  G06F3/0482 ,  G06Q30/02 ,  G06T19/006

Abstract: A method includes determining a device location of an electronic device, transmitting a request to a content source, the request including the device location of the electronic device, and receiving, from the content source in response to the request, a content item that is associated with display location information that describes a content position for the content item relative to a physical environment. The content item is selected by the content source based on the content position for the content item being within an area that is defined based on the device location. The method also includes displaying a representation of the content item as part of a computer-generated reality scene in which the representation of the content item is positioned relative to the physical environment according to the content position for the content item from the display location information for the content item.

公开(公告)号：US20240393919A1

公开(公告)日：2024-11-28

申请号：US18666021

申请日：2024-05-16

Applicant: Apple Inc.

Inventor： Andrew Muehlhausen ,  Elena J. Nattinger ,  Devin W. Chalmers ,  Paul Ewers ,  Paulo R. Jansen dos Reis ,  Peter Burgner ,  Christopher D. Fu ,  Richard P. Lozada

IPC: G06F3/0482 ,  G06F3/01 ,  G06F3/04817 ,  G06F3/16

Abstract: Systems and methods for facilitating selection of a target object required by a request from a user from a set of candidate objects include identifying the set of candidate objects in a gaze region corresponding to a gaze of the user and generating a graphical user interface allowing a user to select the target object from the set of candidate objects.

公开(公告)号：US20240338160A1

公开(公告)日：2024-10-10

申请号：US18578777

申请日：2022-08-22

Applicant: APPLE INC.

Inventor： Thomas G. Salter ,  Anshu K. Chimalamarri ,  Brian W. Temple ,  Paul Ewers

IPC: G06F3/14 ,  G06F3/01 ,  G06T19/00 ,  G06V40/16 ,  G10L17/00

CPC classification number: G06F3/14 ,  G06F3/011 ,  G06T19/006 ,  G06V40/172 ,  G10L17/00

Abstract: Various implementations disclosed herein include devices, systems, and methods for displaying presentation notes at varying positions within a presenter's field of view. In some implementations, a device includes a display, one or more processors, and a memory. A first portion of a media content item corresponding to a presentation is displayed at a first location in a three-dimensional environment. Audience engagement data corresponding to an engagement level of a member of an audience is received. A second portion of the media content item is displayed at a second location in the three-dimensional environment. The second location is selected based on the audience engagement data.

公开(公告)号：US20230074109A1

公开(公告)日：2023-03-09

申请号：US17989226

申请日：2022-11-17

Applicant: APPLE INC.

Inventor： David W. Padgett ,  Christopher D. Fu ,  Scott G. Wade ,  Paul Ewers ,  Ioana Negoita ,  Thomas G. Salter ,  Dhruv Aditya Govil ,  Dimitris Ladopoulos

IPC: H04W4/02 ,  G06Q30/02 ,  G06F3/0482 ,  A63F13/213 ,  G06F3/01 ,  G02B27/01 ,  G06T19/00

Abstract: A method includes determining a device location of an electronic device, transmitting a request to a content source, the request including the device location of the electronic device, and receiving, from the content source in response to the request, a content item that is associated with display location information that describes a content position for the content item relative to a physical environment. The content item is selected by the content source based on the content position for the content item being within an area that is defined based on the device location. The method also includes displaying a representation of the content item as part of a computer-generated reality scene in which the representation of the content item is positioned relative to the physical environment according to the content position for the content item from the display location information for the content item.

公开(公告)号：US11915097B1

公开(公告)日：2024-02-27

申请号：US17143411

申请日：2021-01-07

Applicant: Apple Inc.

Inventor： Mohamed Selim Ben Himane ,  Anselm Grundhoefer ,  Arun Srivatsan Rangaprasad ,  Jeffrey S. Norris ,  Paul Ewers ,  Scott G. Wade ,  Thomas G. Salter ,  Tom Sengelaub

IPC: G06K9/18 ,  G06K7/14 ,  G06T7/90 ,  G06N20/00

CPC classification number: G06K7/1443 ,  G06K7/1417 ,  G06K7/1456 ,  G06N20/00 ,  G06T7/90

Abstract: Various implementations disclosed herein include devices, systems, and methods that provide color visual markers that include colored markings that encode data, where the colors of the colored markings are determined by scanning (e.g., detecting the visual marker using a sensor of an electronic device) the visual marker itself. In some implementations, a visual marker is detected in an image of a physical environment. In some implementations, the visual marker is detected in the image by detecting a predefined shape of a first portion of the visual marker in the image. Then, a color-interpretation scheme is determined for interpreting colored markings of the visual marker that encode data by identifying a set of colors at a corresponding set of predetermined locations on the visual marker. Then, the data of the visual marker is decoded using the colored markings and the set of colors of the color-interpretation scheme.

公开(公告)号：US11533580B2

公开(公告)日：2022-12-20

申请号：US16861296

申请日：2020-04-29

Applicant: Apple Inc.

Inventor： David W. Padgett ,  Christopher D. Fu ,  Scott G. Wade ,  Paul Ewers ,  Ioana Negoita ,  Thomas G. Salter ,  Dhruv Aditya Govil ,  Dimitris Ladopoulos

IPC: H04W4/02 ,  G06Q30/02 ,  G06F3/0482 ,  A63F13/213 ,  G06F3/01 ,  G02B27/01 ,  G06T19/00

Abstract: A method includes determining a device location of an electronic device, and obtaining a content item to be output for display by the electronic device based on the device location, wherein the content item comprises coarse content location information and fine content location information. The method also includes determining an anchor in a physical environment based on the content item, determining a content position and a content orientation for the content item relative to the anchor based on the fine content location information, and displaying a representation of the content item using the electronic device using the content position and the content orientation.