-
公开(公告)号:US20240338921A1
公开(公告)日:2024-10-10
申请号:US18626729
申请日:2024-04-04
Applicant: Apple Inc.
Inventor: Peter Burgner , Paulo R Jansen dos Reis , Michael R Alger
CPC classification number: G06V10/225 , G06V20/50
Abstract: A head-mounted device may be paired with an external electronic device such as a cellular telephone. The head-mounted device may be used to perform visual searches. In some cases, a user provides input directly to the head-mounted device to trigger a visual search and the visual search is performed without any input or communication from the external electronic device. Alternatively, the external electronic device may be used to trigger a visual search performed by the head-mounted device, may serve as an optical marker to indicate a target region for the physical search, and/or may present content associated with the visual search performed by the head-mounted device. The external electronic device may use sensor data to detect a user's intent for a visual search and wirelessly transmit a visual search trigger to the head-mounted device.
-
公开(公告)号:US20240393919A1
公开(公告)日:2024-11-28
申请号:US18666021
申请日:2024-05-16
Applicant: Apple Inc.
Inventor: Andrew Muehlhausen , Elena J. Nattinger , Devin W. Chalmers , Paul Ewers , Paulo R. Jansen dos Reis , Peter Burgner , Christopher D. Fu , Richard P. Lozada
IPC: G06F3/0482 , G06F3/01 , G06F3/04817 , G06F3/16
Abstract: Systems and methods for facilitating selection of a target object required by a request from a user from a set of candidate objects include identifying the set of candidate objects in a gaze region corresponding to a gaze of the user and generating a graphical user interface allowing a user to select the target object from the set of candidate objects.
-
公开(公告)号:US20240070902A1
公开(公告)日:2024-02-29
申请号:US18342477
申请日:2023-06-27
Applicant: Apple Inc.
Inventor: Richard P Lozada , Peter Burgner , Thomas J Moore
CPC classification number: G06T7/73 , G06F3/011 , G06T7/90 , G06T2207/30204
Abstract: An electronic device may use one or more sensors to detect a user intent for content associated with a point of interest in the physical environment of the user. In response to the user intent for content, the electronic device may transmit information associated with the point of interest to an external server. The transmitted information may include depth information, color information, feature point information, location information, etc. The external server may compare the received information to a database of points of interest and identify a matching point of interest in the database. The external server then transmits additional contextual information and/or application information associated with the matching point of interest to the electronic device. The electronic device may run an application and/or present content based on the received information associated with the matching point of interest.
-
公开(公告)号:US20250104456A1
公开(公告)日:2025-03-27
申请号:US18884605
申请日:2024-09-13
Applicant: Apple Inc.
Inventor: Marc Geese , Thomas G. Salter , Ryan J. Dunn , Peter Burgner , Lionel E. Edwin
IPC: G06V30/10 , G06T3/4053 , G06T5/50 , G06T7/20 , G06V10/25
Abstract: Electronic devices, methods, and program storage devices for achieving improved optical character recognition (OCR) operations are disclosed. Performing OCR operations on captured images, e.g., images captured by cameras that are affixed to a user's body (e.g., from mixed reality devices, such as smart HMDs) requires a low-power, robust camera design. Obtaining high spatial resolution in such captured images faces many challenges. However, images with higher spatial resolution can be created by combining information extracted from multiple images captured by such devices, leveraging information obtained from positional sensors of such devices, and performing SR post-processing operations. Such higher spatial resolution images may then be used to enable high-acuity OCR capabilities. The solutions disclosed herein also compensate for the missing ability of such devices due to the lack of a vestibulo-ocular reflex (i.e., the human visual system's ability to use compensating eye movement to fixate and read text clearly, despite head movement).
-
公开(公告)号:US20250111471A1
公开(公告)日:2025-04-03
申请号:US18825453
申请日:2024-09-05
Applicant: Apple Inc.
Inventor: Elena J. Nattinger , Michael J. Rockwell , Christopher I. Word , Devin W. Chalmers , Paulo R. Jansen dos Reis , Paul Ewers , Peter Burgner , Anna L. Brewer , Jeffrey S. Norris , Allison W. Dryer , Andrew Muehlhausen , Luis R. Deliz Centeno , Thomas J. Moore , Alesha Unpingco , Thomas G. Salter
Abstract: Embodiments disclosed herein are directed to devices, systems, and methods for presenting a magnified view in an extended reality environment. Specifically, a magnified view includes a zoom reticle that is presented at a display location of a display. The zoom reticle includes magnified content that includes a magnified portion of a user's field of view. For example, the magnified content may be generated from image data selected from a corresponding portion of a field of view of a camera. The position of the zoom reticle on the display, as well as the portion of the field of view that is magnified, may vary in different circumstances such as described herein.
-
公开(公告)号:US20240393996A1
公开(公告)日:2024-11-28
申请号:US18640553
申请日:2024-04-19
Applicant: Apple Inc.
Inventor: Thomas J. Moore , Alesha Unpingco , Anshu K. Chimalamarri , Ashwin K. Vijay , Christopher D. Fu , Guilherme Klink , In Young Yang , Paul Ewers , Paulo R. Jansen dos Reis , Peter Burgner , Thomas G. Salter , Tigran Khachatryan
Abstract: A head-mounted device may be used to perform a visual search on a physical environment around the head-mounted device. A user may wish to visually search one out of multiple physical objects in the physical environment. To clearly show the user which physical object was the target of a visual search, the head-mounted device may present a thumbnail of the candidate physical object on a display. The thumbnail may be cropped and/or zoomed using an image from a camera on the head-mounted device. By displaying a thumbnail that is taken by a camera on the head-mounted device, the thumbnail will directly match the physical object in the user's physical environment, eliminating ambiguity regarding which physical object is the subject of the visual search.
-
公开(公告)号:US20240370082A1
公开(公告)日:2024-11-07
申请号:US18644218
申请日:2024-04-24
Applicant: Apple Inc.
Inventor: Guilherme Klink , Andrew Muehlhausen , Gregory Lutter , Luis R. Deliz Centeno , Paulo R. Jansen dos Reis , Peter Burgner , Rahul Nair , Yutaka Yokokawa , Anshu K. Chimalamarri , Ashwin K. Vijay , Benjamin S. Phipps , Brandon K. Schmuck
Abstract: A head-mounted device may be used to control one or more external electronic devices. Gaze input and camera images may be used to determine a point of gaze relative to a display for an external electronic device. The external electronic device may receive information regarding the user's gaze input from the head-mounted device and may highlight one out of multiple user interface elements that is targeted by the gaze input. The head-mounted device may receive input such as keystroke information from an accessory device and relay the input to an external electronic device that is being viewed. The head-mounted device may receive a display configuration request, determine layout information for displays in the physical environment of the head-mounted device, and transmit the layout information to an external device associated with the displays.
-
公开(公告)号:US20230368327A1
公开(公告)日:2023-11-16
申请号:US18196241
申请日:2023-05-11
Applicant: Apple Inc.
Inventor: Elena J. Nattinger , Peter Burgner , Anna L. Brewer , Devin W. Chalmers
CPC classification number: G06T1/60 , G06V10/761 , G06V40/174 , G06F3/013 , A61B5/024
Abstract: A method includes, while presenting a representation of a physical environment of the device, obtaining contextual data that indicates a characteristic of the physical environment, the device or a user of the device, and obtaining an indication of historical content associated with the device. The method includes determining, based on the characteristic indicated by the contextual data and the historical content, a user interest value that indicates a user interest level in the physical environment. The method includes storing an image captured by an image sensor in response to the user interest value being greater than a threshold interest value.
-
-
-
-
-
-
-