-
公开(公告)号:US20250104456A1
公开(公告)日:2025-03-27
申请号:US18884605
申请日:2024-09-13
Applicant: Apple Inc.
Inventor: Marc Geese , Thomas G. Salter , Ryan J. Dunn , Peter Burgner , Lionel E. Edwin
IPC: G06V30/10 , G06T3/4053 , G06T5/50 , G06T7/20 , G06V10/25
Abstract: Electronic devices, methods, and program storage devices for achieving improved optical character recognition (OCR) operations are disclosed. Performing OCR operations on captured images, e.g., images captured by cameras that are affixed to a user's body (e.g., from mixed reality devices, such as smart HMDs) requires a low-power, robust camera design. Obtaining high spatial resolution in such captured images faces many challenges. However, images with higher spatial resolution can be created by combining information extracted from multiple images captured by such devices, leveraging information obtained from positional sensors of such devices, and performing SR post-processing operations. Such higher spatial resolution images may then be used to enable high-acuity OCR capabilities. The solutions disclosed herein also compensate for the missing ability of such devices due to the lack of a vestibulo-ocular reflex (i.e., the human visual system's ability to use compensating eye movement to fixate and read text clearly, despite head movement).
-
公开(公告)号:US12175009B2
公开(公告)日:2024-12-24
申请号:US18538955
申请日:2023-12-13
Applicant: Apple Inc.
Inventor: Bart Colin Trzynadlowski , Thomas G. Salter , Devin William Chalmers , Anshu Kameswar Chimalamarri , Gregory Patrick Lane Lutter
Abstract: In one implementation, a method for spatially designating private content. The method includes: presenting, via a display device, an indication of a private viewing region relative to a location of the computing system; determining a first location for presentation of graphical content; and presenting, via the display device, the graphical content at the first location. The method further includes: transmitting a characterization vector associated with the graphical content to at least one other device for display thereon according to a determination that the first location of the graphical content is outside of the private viewing area; and forgoing transmission of the characterization vector associated with the graphical content to the at least one other device according to a determination that the first location of the graphical content is inside of the private viewing area.
-
公开(公告)号:US20240089695A1
公开(公告)日:2024-03-14
申请号:US18511651
申请日:2023-11-16
Applicant: APPLE INC.
Inventor: David W. Padgett , Christopher D. Fu , Scott G. Wade , Paul Ewers , Ioana Negoita , Thomas G. Salter , Dhruv Aditya Govil , Dimitris Ladopoulos
IPC: H04W4/02 , A63F13/213 , G02B27/01 , G06F3/01 , G06F3/0482 , G06Q30/02 , G06T19/00
CPC classification number: H04W4/02 , A63F13/213 , G02B27/017 , G06F3/011 , G06F3/0482 , G06Q30/02 , G06T19/006
Abstract: A method includes obtaining an image of a machine-readable data representation that is located on a physical object using a camera of an electronic device. The machine-readable data representation includes an encoded form of a data value. The method further includes decoding the machine-readable data representation to determine the data value, whereby the data value includes a content identifier and a content source identifier. The method also includes selecting a content source based on the content source identifier, obtaining a content item and content location information based on the content identifier from the content source, determining a content position and a content orientation for the content item relative to the physical object based on the content location information, and displaying a representation of the content item using the electronic device according to the content position and the content orientation.
-
公开(公告)号:US11825375B2
公开(公告)日:2023-11-21
申请号:US17989226
申请日:2022-11-17
Applicant: APPLE INC.
Inventor: David W. Padgett , Christopher D. Fu , Scott G. Wade , Paul Ewers , Ioana Negoita , Thomas G. Salter , Dhruv Aditya Govil , Dimitris Ladopoulos
IPC: H04W4/02 , A63F13/213 , G02B27/01 , G06F3/01 , G06F3/0482 , G06Q30/02 , G06T19/00
CPC classification number: H04W4/02 , A63F13/213 , G02B27/017 , G06F3/011 , G06F3/0482 , G06Q30/02 , G06T19/006
Abstract: A method includes determining a device location of an electronic device, transmitting a request to a content source, the request including the device location of the electronic device, and receiving, from the content source in response to the request, a content item that is associated with display location information that describes a content position for the content item relative to a physical environment. The content item is selected by the content source based on the content position for the content item being within an area that is defined based on the device location. The method also includes displaying a representation of the content item as part of a computer-generated reality scene in which the representation of the content item is positioned relative to the physical environment according to the content position for the content item from the display location information for the content item.
-
公开(公告)号:US20230290270A1
公开(公告)日:2023-09-14
申请号:US18112450
申请日:2023-02-21
Applicant: Apple Inc.
Inventor: Brian W. Temple , Devin W. Chalmers , Thomas G. Salter
CPC classification number: G09B19/06 , G06T19/006 , G06F3/011
Abstract: Devices, systems, and methods that facilitate learning a language in an extended reality (XR) environment. This may involve identifying objects or activities in the environment, identifying a context associated with the user or the environment, and providing language teaching content based on the objects, activities, or contexts. In one example, the language teaching content provides individual words, phrases, or sentences corresponding to the objects, activities, or contexts. In another example, the language teaching content requests user interaction (e.g., via quiz questions or educational games) corresponding to the objects, activities, or contexts. Context may be used to determine whether or how to provide the language teaching content. For example, based on a user's current course of language study (e.g., this week's vocabulary list), corresponding object or activities may be identified in the environment for use in providing the language teaching content.
-
公开(公告)号:US20220291743A1
公开(公告)日:2022-09-15
申请号:US17689460
申请日:2022-03-08
Applicant: APPLE INC.
Inventor: Brian W. Temple , Devin W. Chalmers , Thomas G. Salter
Abstract: Various implementations disclosed herein include devices, systems, and methods that determine that a user is interested in audio content by determining that a movement (e.g., a user's head bob) has a time-based relationship with detected audio content (e.g., the beat of music playing in the background). Some implementations involve obtaining first sensor data and second sensor data corresponding to a physical environment, the first sensor data corresponding to audio in the physical environment and the second sensor data corresponding to a body movement in the physical environment. A time-based relationship between one or more elements of the audio and one or more aspects of the body movement is identified based on the first sensor data and the second sensor data. An interest in content of the audio is identified based on identifying the time-based relationship. Various actions may be performed proactively based on identifying the interest in the content.
-
公开(公告)号:US20240256215A1
公开(公告)日:2024-08-01
申请号:US18487909
申请日:2023-10-16
Applicant: Apple Inc.
Inventor: Christopher T. Eubank , Devin W. Chalmers , Kirill Kalinichev , Rahul Nair , Thomas G. Salter
IPC: G06F3/16 , G06F3/01 , G06V40/19 , G10K11/175 , G10K11/178 , G10L25/51 , G10L25/78 , H04R1/08 , H04R1/10 , H04R1/40 , H04R3/00
CPC classification number: G06F3/165 , G06F3/013 , G06F3/017 , G06V40/19 , G10K11/1754 , G10K11/17881 , G10L25/51 , G10L25/78 , H04R1/08 , H04R1/1041 , H04R1/406 , H04R3/005 , G10K2210/1081 , G10K2210/3026 , G10K2210/3027 , G10K2210/3044 , H04R2430/01
Abstract: A method performed by an audio system comprising a headset. The method sends a playback signal containing user-desired audio content to drive a speaker of the headset that is being worn by a user, receives a microphone signal from a microphone that is arranged to capture sounds within an ambient environment in which the user is located, performs a speech detection algorithm upon the microphone signal to detect speech contained therein, in response to a detection of speech, determines that the user intends to engage in a conversation with a person who is located within the ambient environment, and, in response to determining that the user intends to engage in the conversation, adjusts the playback signal based on the user-desired audio content.
-
公开(公告)号:US11915097B1
公开(公告)日:2024-02-27
申请号:US17143411
申请日:2021-01-07
Applicant: Apple Inc.
Inventor: Mohamed Selim Ben Himane , Anselm Grundhoefer , Arun Srivatsan Rangaprasad , Jeffrey S. Norris , Paul Ewers , Scott G. Wade , Thomas G. Salter , Tom Sengelaub
CPC classification number: G06K7/1443 , G06K7/1417 , G06K7/1456 , G06N20/00 , G06T7/90
Abstract: Various implementations disclosed herein include devices, systems, and methods that provide color visual markers that include colored markings that encode data, where the colors of the colored markings are determined by scanning (e.g., detecting the visual marker using a sensor of an electronic device) the visual marker itself. In some implementations, a visual marker is detected in an image of a physical environment. In some implementations, the visual marker is detected in the image by detecting a predefined shape of a first portion of the visual marker in the image. Then, a color-interpretation scheme is determined for interpreting colored markings of the visual marker that encode data by identifying a set of colors at a corresponding set of predetermined locations on the visual marker. Then, the data of the visual marker is decoded using the colored markings and the set of colors of the color-interpretation scheme.
-
公开(公告)号:US20240062485A1
公开(公告)日:2024-02-22
申请号:US18385129
申请日:2023-10-30
Applicant: Apple Inc.
Inventor: Thomas G. Salter , Ganghun Kim , Ioana Negoita , Devin William Chalmers , Anshu Kameswar Chimalamarri , Thomas Justin Moore
CPC classification number: G06T19/006 , G06T7/70
Abstract: In one implementation, a method of performing late-stage shift is performed at a device including a display, one or more processors, and non-transitory memory. The method includes generating, based on a first predicted pose of the device for a display time period, a first image. The method includes generating a mask indicating a first region of the first image and a second region of the first image. The method includes generating a second image by shifting, based on a second predicted pose of the device for the display time period, the first region of the first image without shifting the second region of the first image. The method includes displaying, on the display at the display time period, the second image.
-
公开(公告)号:US20240019928A1
公开(公告)日:2024-01-18
申请号:US18374125
申请日:2023-09-28
Applicant: Apple Inc.
Inventor: Thomas G. Salter , Anshu K. Chimalamarri , Bryce L. Schmidtchen , Devin W. Chalmers , Gregory Lutter
Abstract: Various implementations disclosed herein include devices, systems, and methods for using a gaze vector and head pose information to effectuate a user interaction with a virtual object. In some implementations, a device includes a sensor for sensing a head pose of a user, a display, one or more processors, and a memory. In various implementations, a method includes displaying a set of virtual objects. Based on a gaze vector, it is determined that a gaze of the user is directed to a first virtual object of the set of virtual objects. A head pose value corresponding to the head pose of the user is obtained. An action relative to the first virtual object is performed based on the head pose value satisfying a head pose criterion.
-
-
-
-
-
-
-
-
-