公开(公告)号：US11983462B2

公开(公告)日：2024-05-14

申请号：US17446513

申请日：2021-08-31

Applicant: Snap Inc.

Inventor： Jackie Assa ,  Alan Bekker ,  Gilad Landau

IPC: G06F3/16 ,  G06F3/01 ,  G06N3/02 ,  G06Q30/0601 ,  G10L15/16 ,  G10L15/22

CPC classification number: G06F3/167 ,  G06F3/011 ,  G06N3/02 ,  G06Q30/0643 ,  G10L15/16 ,  G10L15/22 ,  G10L2015/223 ,  G10L2015/225

Abstract: Systems and methods are provided for providing an augmented reality experience. The systems and methods perform operations comprising: generating, for display by a messaging application, an image comprising one or more augmented reality elements, the one or more augmented reality elements being associated with a configurable entity; receiving, by the messaging application, speech input from a user; determining a schema associated with the one or more augmented reality elements; causing the speech input to be processed by a speech understanding model in accordance with the schema to determine one or more configurable state entity update values; updating the configurable entity associated with the one or more augmented reality elements based on the one or more configurable state entity update values; and modifying the one or more augmented reality elements in the image based on the updated configurable entity.

公开(公告)号：US20230067305A1

公开(公告)日：2023-03-02

申请号：US17446513

申请日：2021-08-31

Applicant: Snap Inc.

Inventor： Jackie Assa ,  Alan Bekker ,  Gilad Landau

IPC: G06F3/16 ,  G06F3/01 ,  G06Q30/06 ,  G10L15/22 ,  G10L15/16 ,  G06N3/02

Abstract: Systems and methods are provided for providing an augmented reality experience. The systems and methods perform operations comprising: generating, for display by a messaging application, an image comprising one or more augmented reality elements, the one or more augmented reality elements being associated with a configurable entity; receiving, by the messaging application, speech input from a user; determining a schema associated with the one or more augmented reality elements; causing the speech input to be processed by a speech understanding model in accordance with the schema to determine one or more configurable state entity update values; updating the configurable entity associated with the one or more augmented reality elements based on the one or more configurable state entity update values; and modifying the one or more augmented reality elements in the image based on the updated configurable entity.