ACTIVE SPEAKER DETECTION USING IMAGE DATA

    公开(公告)号:US20230068798A1

    公开(公告)日:2023-03-02

    申请号:US17465143

    申请日:2021-09-02

    Abstract: A system can operate a speech-controlled device to perform active speaker detection to detect an utterance using image data showing a user speaking the utterance. This enables the device to perform utterance detection using the image data and/or determine which user is speaking the utterance. To perform active speaker detection, the device processes the image data to determine expression parameters associated with the user's face and generates facial measurements based on the expression parameters. For example, the device can use the expression parameters to generate a 3D model including an agnostic facial representation and determine a mouth aspect ratio by measuring a mouth height and a mouth width of the agnostic facial representation. As the mouth aspect ratio changes when the user is speaking, the device can determine that the user is speaking and/or detect an utterance based on an amount of variation of the mouth aspect ratio.

    Natural language processing
    2.
    发明授权

    公开(公告)号:US11532301B1

    公开(公告)日:2022-12-20

    申请号:US17113823

    申请日:2020-12-07

    Abstract: Devices and techniques are generally described for inference reduction in natural language processing using semantic similarity-based caching. In various examples, first automatic speech recognition (ASR) data representing a first natural language input may be determined. A cache may be searched using the first ASR data. A first skill associated with the first ASR data may be determined from the cache. In some examples, first intent data representing a semantic interpretation of the first natural language input data may be determined by using a first natural language process associated with the first skill.

    TASK-BASED IMAGE MASKING
    3.
    发明申请

    公开(公告)号:US20210406589A1

    公开(公告)日:2021-12-30

    申请号:US16913837

    申请日:2020-06-26

    Abstract: Techniques for masking images based on a particular task are described. A system masks portions of an image that are not relevant to a particular task, thus, reducing the amount of data used by applications for image processing tasks. For example, images to be processed using a hair color classification model are masked so that only portions that show the person's hair are available for the model to analyze. The system configures different masker components to mask images for different tasks. A masker component can be implemented at a user device to mask images prior to sending to an application/task-specific model.

    Natural language processing
    4.
    发明授权

    公开(公告)号:US11626107B1

    公开(公告)日:2023-04-11

    申请号:US17114116

    申请日:2020-12-07

    Abstract: Devices and techniques are generally described for inference reduction in natural language processing using semantic similarity-based caching. In various examples, first automatic speech recognition (ASR) data representing a first natural language input may be determined. A cache may be searched using the first ASR data. A first skill associated with the first ASR data may be determined from the cache. In some examples, first intent data representing a semantic interpretation of the first natural language input data may be determined by using a first natural language process associated with the first skill.

    Natural language processing
    6.
    发明授权

    公开(公告)号:US12165636B1

    公开(公告)日:2024-12-10

    申请号:US17984511

    申请日:2022-11-10

    Abstract: Devices and techniques are generally described for inference reduction in natural language processing using semantic similarity-based caching. In various examples, first automatic speech recognition (ASR) data representing a first natural language input may be determined. A cache may be searched using the first ASR data. A first skill associated with the first ASR data may be determined from the cache. In some examples, first intent data representing a semantic interpretation of the first natural language input data may be determined by using a first natural language process associated with the first skill.

    Listener animation
    9.
    发明授权

    公开(公告)号:US12254548B1

    公开(公告)日:2025-03-18

    申请号:US18082709

    申请日:2022-12-16

    Abstract: A system configured to perform style-aware listener animation. By representing different listening styles (e.g., facial expressions) using an embedding space, a single model can be trained to generate unique facial animations for a number of distinct listeners. Thus, individual listening styles can be associated with a listener identifier, enabling the system to (i) animate a plurality of different listeners with unique nonverbal behavior and/or (ii) select a particular listener identifier or desired type of listener style with which to animate. This enables the model to be generalized to new listeners to generate additional listener facial responses without needing training data for each new listener. The model may process a listener representation style or listener identifier, along with input data corresponding to a speaker talking, to generate unique facial animation responsive to the speech.

    TASK-BASED IMAGE MASKING
    10.
    发明申请

    公开(公告)号:US20220405528A1

    公开(公告)日:2022-12-22

    申请号:US17740533

    申请日:2022-05-10

    Abstract: Techniques for masking images based on a particular task are described. A system masks portions of an image that are not relevant to a particular task, thus, reducing the amount of data used by applications for image processing tasks. For example, images to be processed using a hair color classification model are masked so that only portions that show the person's hair are available for the model to analyze. The system configures different masker components to mask images for different tasks. A masker component can be implemented at a user device to mask images prior to sending to an application/task-specific model.

Patent Agency Ranking