公开(公告)号：US20250104368A1

公开(公告)日：2025-03-27

申请号：US18971490

申请日：2024-12-06

Applicant: Apple Inc.

Inventor： Thomas G. Salter ,  Gregory Patrick Lane Lutter ,  Rahul Nair ,  Devin William Chalmers ,  Ioana Negoita

IPC: G06T19/00 ,  G06F3/01 ,  G06F3/03 ,  G06T7/70 ,  G06T11/60

Abstract: A method is performed at an electronic device with a one or more processors, a non-transitory memory, and a display. The method includes obtaining a first semantic label value associated with a first object. The method includes determining, based on the first semantic label value, a first display priority value associated with the first object. The method includes prioritizing the first object over a second object based on the first display priority value. The method includes, in response to determining that the first object satisfies an offscreen criterion, displaying, on the display, an offscreen indicator that is associated with the first object according to the prioritization.

公开(公告)号：US12236819B1

公开(公告)日：2025-02-25

申请号：US17682681

申请日：2022-02-28

Applicant: Apple Inc.

Inventor： Thomas G. Salter ,  Anshu Kameswar Chimalamarri

IPC: G09G3/00 ,  G06Q10/1093 ,  G09G5/12

Abstract: Various implementations disclosed herein include devices, systems, and methods for augmenting a physical writing surface. In various implementations, a device includes a display, a non-transitory memory and one or more processors coupled with the display and the non-transitory memory. In various implementations, a method includes presenting, via the display, a pass-through representation of a physical writing surface that corresponds to an application installed on the device. In some implementations, the method includes detecting a difference between the physical writing surface and an electronic record stored in association with the application. In some implementations, the method includes overlaying an element on the pass-through representation of the physical writing surface based on the difference between the physical writing surface and the electronic record.

公开(公告)号：US12213019B2

公开(公告)日：2025-01-28

申请号：US18511651

申请日：2023-11-16

Applicant: APPLE INC.

Inventor： David W. Padgett ,  Christopher D. Fu ,  Scott G. Wade ,  Paul Ewers ,  Ioana Negoita ,  Thomas G. Salter ,  Dhruv Aditya Govil ,  Dimitris Ladopoulos

IPC: H04W4/02 ,  A63F13/213 ,  G02B27/01 ,  G06F3/01 ,  G06F3/0482 ,  G06Q30/02 ,  G06T19/00

Abstract: A method includes obtaining an image of a machine-readable data representation that is located on a physical object using a camera of an electronic device. The machine-readable data representation includes an encoded form of a data value. The method further includes decoding the machine-readable data representation to determine the data value, whereby the data value includes a content identifier and a content source identifier. The method also includes selecting a content source based on the content source identifier, obtaining a content item and content location information based on the content identifier from the content source, determining a content position and a content orientation for the content item relative to the physical object based on the content location information, and displaying a representation of the content item using the electronic device according to the content position and the content orientation.

公开(公告)号：US20250005873A1

公开(公告)日：2025-01-02

申请号：US18829450

申请日：2024-09-10

Applicant: Apple Inc.

Inventor： Yutaka Yokokawa ,  Devin W. Chalmers ,  Brian W. Temple ,  Rahul Nair ,  Thomas G. Salter

IPC: G06T19/00 ,  G06F3/01 ,  G06T7/246 ,  G06T7/73 ,  G06V20/50 ,  H04S7/00

Abstract: Various implementations disclosed herein include devices, systems, and methods that present virtual content based on detecting a reflective object and determining a three-dimensional (3D) position of the reflective object in a physical environment. For example, an example process may include obtaining sensor data in a physical environment that includes one or more objects. The method may further include detecting a reflection of a first object of the one or more objects upon a reflective surface of a reflective object based on the sensor data. The method may further include determining a 3D position of the reflective object in the physical environment based on determining a 3D position of the reflection of the first object. The method may further include presenting virtual content in a view of the physical environment. The virtual content may be positioned at a 3D location based on the 3D position of the reflective object.

公开(公告)号：US20240393996A1

公开(公告)日：2024-11-28

申请号：US18640553

申请日：2024-04-19

Applicant: Apple Inc.

Inventor： Thomas J. Moore ,  Alesha Unpingco ,  Anshu K. Chimalamarri ,  Ashwin K. Vijay ,  Christopher D. Fu ,  Guilherme Klink ,  In Young Yang ,  Paul Ewers ,  Paulo R. Jansen dos Reis ,  Peter Burgner ,  Thomas G. Salter ,  Tigran Khachatryan

IPC: G06F3/14 ,  G06F3/01

Abstract: A head-mounted device may be used to perform a visual search on a physical environment around the head-mounted device. A user may wish to visually search one out of multiple physical objects in the physical environment. To clearly show the user which physical object was the target of a visual search, the head-mounted device may present a thumbnail of the candidate physical object on a display. The thumbnail may be cropped and/or zoomed using an image from a camera on the head-mounted device. By displaying a thumbnail that is taken by a camera on the head-mounted device, the thumbnail will directly match the physical object in the user's physical environment, eliminating ambiguity regarding which physical object is the subject of the visual search.

公开(公告)号：US12154329B1

公开(公告)日：2024-11-26

申请号：US17387461

申请日：2021-07-28

Applicant: Apple Inc.

Inventor： Thomas G. Salter ,  Devin William Chalmers ,  Gregory Patrick Lane Lutter ,  Bart Colin Trzynadlowski ,  Rahul Nair

IPC: G06V20/20 ,  G06F3/0482 ,  G06T19/00 ,  G06V40/20

Abstract: In one implementation, a method of displaying a task list is performed by a device including an image sensor, a display, one or more processors, and non-transitory memory. The method includes obtaining, using the image sensor, a video stream of a physical environment. The method includes displaying, on the display in association with the physical environment, a task list including a plurality of task elements respectively associated with a plurality of tasks, wherein the plurality of task elements includes a first task element associated with a first task and a second task element associated with a second task. The method includes detecting, in the video stream of the physical environment, completion of the first task. The method includes, in response to detecting completion of the first task, changing display of the first task element.

公开(公告)号：US20240248532A1

公开(公告)日：2024-07-25

申请号：US18272261

申请日：2022-01-11

Applicant: Apple Inc.

Inventor： Thomas G. Salter ,  Brian W. Temple ,  Gregory Lutter

IPC: G06F3/01 ,  G06T19/00 ,  G09G3/00

CPC classification number: G06F3/013 ,  G06F3/012 ,  G06T19/006 ,  G09G3/001 ,  G06T2200/24 ,  G09G2354/00

Abstract: In one implementation, a method for visualizing multi-modal inputs includes: displaying a first user interface element within an extended reality (XR) environment; determining a gaze direction based on first input data; in response to determining that the gaze direction is directed to the first user interface element, displaying a focus indicator with a first appearance in association with the first user interface element; detecting a change in pose of at least one of a head pose or a body pose of a user of the computing system; and, in response to detecting the change of pose, modifying the focus indicator from the first appearance to a second appearance different from the first appearance.

公开(公告)号：US12026800B1

公开(公告)日：2024-07-02

申请号：US17543530

申请日：2021-12-06

Applicant: Apple Inc.

Inventor： Thomas G. Salter ,  Gregory Patrick Lane Lutter

IPC: G06T1/20 ,  G06F3/0346 ,  G06T1/60 ,  G06T3/02 ,  G06T7/70

CPC classification number: G06T1/20 ,  G06F3/0346 ,  G06T1/60 ,  G06T3/02 ,  G06T7/70

Abstract: A method is performed at an electronic device with a controller and a display. The method includes identifying, within a first memory, a first object that satisfies a locked criterion. For example, the first object corresponds to a head-locked object or a body-locked object. The first object is associated with a first plurality of pixel values. The method includes blitting, via the controller, the first plurality of pixel values from the first memory to a second memory. The method includes displaying, on the display, the first object by obtaining the first plurality of pixel values from the second memory. In some implementations, the method includes rendering, via a graphics processing unit (GPU), a second object that does not satisfy the locked criterion, such as a world-locked object. As compared with GPU rendering, blitting is less computationally expensive.

公开(公告)号：US12002140B1

公开(公告)日：2024-06-04

申请号：US18200540

申请日：2023-05-22

Applicant: Apple Inc.

Inventor： Matthew S. DeMers ,  Adeeti V. Ullal ,  Alexander G. Bruno ,  Daniel M. Trietsch ,  Ioana Negoita ,  James J. Dunne ,  Thomas G. Salter ,  Thomas J. Moore

IPC: G09G5/00 ,  A61B5/00 ,  G06F3/01 ,  G06T11/20 ,  G06T13/40 ,  G06T13/80

CPC classification number: G06T13/40 ,  A61B5/744 ,  G06F3/012 ,  G06T11/206 ,  G06T13/80 ,  G06T2200/24

Abstract: A method includes: presenting a posture summary interface including: a representation of the user, a visualization of a current accumulated strain value for the user, and a first affordance for initiating an animated posture summary associated with the accumulated strain value for the user over a respective time window; and in response to detecting a user input directed to the first affordance within the posture summary interface, presenting an animation of the representation of the user over the respective time window that corresponds to one or more instances in which head pose information changes associated with the user caused an increase or a decrease to the accumulated strain value greater than a significance threshold, wherein an appearance of the visualization of the current accumulated strain value for the user changes to represent the accumulated strain value for the user over the respective time window.

公开(公告)号：US20240111911A1

公开(公告)日：2024-04-04

申请号：US18538955

申请日：2023-12-13

Applicant: Apple Inc.

Inventor： Bart Colin Trzynadlowski ,  Thomas G. Salter ,  Devin William Chalmers ,  Anshu Kameswar Chimalamarri ,  Gregory Patrick Lane Lutter

IPC: G06F21/84 ,  G06F21/10 ,  G06F21/57

CPC classification number: G06F21/84 ,  G06F21/10 ,  G06F21/57 ,  G06F21/1066 ,  G06F2221/032

Abstract: In one implementation, a method for spatially designating private content. The method includes: presenting, via a display device, an indication of a private viewing region relative to a location of the computing system; determining a first location for presentation of graphical content; and presenting, via the display device, the graphical content at the first location. The method further includes: transmitting a characterization vector associated with the graphical content to at least one other device for display thereon according to a determination that the first location of the graphical content is outside of the private viewing area; and forgoing transmission of the characterization vector associated with the graphical content to the at least one other device according to a determination that the first location of the graphical content is inside of the private viewing area.