Ambient Augmented Language Tutoring
    3.
    发明公开

    公开(公告)号:US20230290270A1

    公开(公告)日:2023-09-14

    申请号:US18112450

    申请日:2023-02-21

    申请人: Apple Inc.

    IPC分类号: G09B19/06 G06T19/00 G06F3/01

    摘要: Devices, systems, and methods that facilitate learning a language in an extended reality (XR) environment. This may involve identifying objects or activities in the environment, identifying a context associated with the user or the environment, and providing language teaching content based on the objects, activities, or contexts. In one example, the language teaching content provides individual words, phrases, or sentences corresponding to the objects, activities, or contexts. In another example, the language teaching content requests user interaction (e.g., via quiz questions or educational games) corresponding to the objects, activities, or contexts. Context may be used to determine whether or how to provide the language teaching content. For example, based on a user's current course of language study (e.g., this week's vocabulary list), corresponding object or activities may be identified in the environment for use in providing the language teaching content.

    Proactive Actions Based on Audio and Body Movement

    公开(公告)号:US20220291743A1

    公开(公告)日:2022-09-15

    申请号:US17689460

    申请日:2022-03-08

    申请人: APPLE INC.

    摘要: Various implementations disclosed herein include devices, systems, and methods that determine that a user is interested in audio content by determining that a movement (e.g., a user's head bob) has a time-based relationship with detected audio content (e.g., the beat of music playing in the background). Some implementations involve obtaining first sensor data and second sensor data corresponding to a physical environment, the first sensor data corresponding to audio in the physical environment and the second sensor data corresponding to a body movement in the physical environment. A time-based relationship between one or more elements of the audio and one or more aspects of the body movement is identified based on the first sensor data and the second sensor data. An interest in content of the audio is identified based on identifying the time-based relationship. Various actions may be performed proactively based on identifying the interest in the content.

    METHOD AND DEVICE FOR VISUALIZING MULTI-MODAL INPUTS

    公开(公告)号:US20240248532A1

    公开(公告)日:2024-07-25

    申请号:US18272261

    申请日:2022-01-11

    申请人: Apple Inc.

    IPC分类号: G06F3/01 G06T19/00 G09G3/00

    摘要: In one implementation, a method for visualizing multi-modal inputs includes: displaying a first user interface element within an extended reality (XR) environment; determining a gaze direction based on first input data; in response to determining that the gaze direction is directed to the first user interface element, displaying a focus indicator with a first appearance in association with the first user interface element; detecting a change in pose of at least one of a head pose or a body pose of a user of the computing system; and, in response to detecting the change of pose, modifying the focus indicator from the first appearance to a second appearance different from the first appearance.

    Blitting a display-locked object
    6.
    发明授权

    公开(公告)号:US12026800B1

    公开(公告)日:2024-07-02

    申请号:US17543530

    申请日:2021-12-06

    申请人: Apple Inc.

    摘要: A method is performed at an electronic device with a controller and a display. The method includes identifying, within a first memory, a first object that satisfies a locked criterion. For example, the first object corresponds to a head-locked object or a body-locked object. The first object is associated with a first plurality of pixel values. The method includes blitting, via the controller, the first plurality of pixel values from the first memory to a second memory. The method includes displaying, on the display, the first object by obtaining the first plurality of pixel values from the second memory. In some implementations, the method includes rendering, via a graphics processing unit (GPU), a second object that does not satisfy the locked criterion, such as a world-locked object. As compared with GPU rendering, blitting is less computationally expensive.

    Localization based on Detected Spatial Features

    公开(公告)号:US20230102686A1

    公开(公告)日:2023-03-30

    申请号:US17852114

    申请日:2022-06-28

    申请人: Apple Inc.

    IPC分类号: G06T7/70 G06T19/00 G06T7/12

    摘要: In one implementation, a method of localizing a device is performed at a device including one or more processors and non-transitory memory. The method includes obtaining an estimate of a pose of the device in an environment. The method includes obtaining an environmental model of the environment including a spatial feature in the environment defined by a first spatial feature location. The method includes determining a second spatial feature location of the spatial feature based on the estimate of the pose of the device. The method includes determining an updated estimate of the pose of the device based on the first spatial feature location and the second spatial feature location.