Triggering a Visual Search in an Electronic Device

    公开(公告)号:US20240338921A1

    公开(公告)日:2024-10-10

    申请号:US18626729

    申请日:2024-04-04

    Applicant: Apple Inc.

    CPC classification number: G06V10/225 G06V20/50

    Abstract: A head-mounted device may be paired with an external electronic device such as a cellular telephone. The head-mounted device may be used to perform visual searches. In some cases, a user provides input directly to the head-mounted device to trigger a visual search and the visual search is performed without any input or communication from the external electronic device. Alternatively, the external electronic device may be used to trigger a visual search performed by the head-mounted device, may serve as an optical marker to indicate a target region for the physical search, and/or may present content associated with the visual search performed by the head-mounted device. The external electronic device may use sensor data to detect a user's intent for a visual search and wirelessly transmit a visual search trigger to the head-mounted device.

    Presenting Content Based on a Point of Interest

    公开(公告)号:US20240070902A1

    公开(公告)日:2024-02-29

    申请号:US18342477

    申请日:2023-06-27

    Applicant: Apple Inc.

    CPC classification number: G06T7/73 G06F3/011 G06T7/90 G06T2207/30204

    Abstract: An electronic device may use one or more sensors to detect a user intent for content associated with a point of interest in the physical environment of the user. In response to the user intent for content, the electronic device may transmit information associated with the point of interest to an external server. The transmitted information may include depth information, color information, feature point information, location information, etc. The external server may compare the received information to a database of points of interest and identify a matching point of interest in the database. The external server then transmits additional contextual information and/or application information associated with the matching point of interest to the electronic device. The electronic device may run an application and/or present content based on the received information associated with the matching point of interest.

    Optical Character Recognition (OCR) Enhancement via Inertial Measurement Unit (IMU)-Supported Super-Resolution Imaging

    公开(公告)号:US20250104456A1

    公开(公告)日:2025-03-27

    申请号:US18884605

    申请日:2024-09-13

    Applicant: Apple Inc.

    Abstract: Electronic devices, methods, and program storage devices for achieving improved optical character recognition (OCR) operations are disclosed. Performing OCR operations on captured images, e.g., images captured by cameras that are affixed to a user's body (e.g., from mixed reality devices, such as smart HMDs) requires a low-power, robust camera design. Obtaining high spatial resolution in such captured images faces many challenges. However, images with higher spatial resolution can be created by combining information extracted from multiple images captured by such devices, leveraging information obtained from positional sensors of such devices, and performing SR post-processing operations. Such higher spatial resolution images may then be used to enable high-acuity OCR capabilities. The solutions disclosed herein also compensate for the missing ability of such devices due to the lack of a vestibulo-ocular reflex (i.e., the human visual system's ability to use compensating eye movement to fixate and read text clearly, despite head movement).

Patent Agency Ranking