公开(公告)号：US11507752B1

公开(公告)日：2022-11-22

申请号：US17002862

申请日：2020-08-26

Applicant: Amazon Technologies, Inc.

Inventor： Pavel Bhowmik ,  Melanie C B Gens ,  Sachin Midha ,  Rahul Gupta ,  Sriram Venkatapathy ,  Xinhong Zhang ,  Anoop Kumar ,  Pooja Sanjay Sonawane ,  Samuel Harry Ingbar

IPC: G06F17/00 ,  G06F40/30 ,  G10L15/18 ,  G10L15/22

Abstract: Techniques for evaluating a natural language understanding (NLU) component and determining an action to resolve an issue processing a user input are described. The system determines which component is invoked by a baseline NLU component is processing the user input, and which component is invoked by an updated NLU component. Based on that information, the system selects the action to resolve the updated NLU component generating an undesired response to the user input.

公开(公告)号：US12112752B1

公开(公告)日：2024-10-08

申请号：US17688279

申请日：2022-03-07

Applicant: Amazon Technologies, Inc.

Inventor： Rahul Gupta ,  Jwala Dhamala ,  Apurv Verma ,  Qingwen Ye ,  Mayur Himmatbhai Dabhi ,  Srinivasan Rengarajan Veeravanallur ,  Spyridon Matsoukas ,  Melanie C B Gens ,  Seyed Omid Razavi ,  Avni Khatri ,  Premkumar Natarajan

IPC: G10L15/22 ,  G10L15/01 ,  G10L15/06 ,  G10L15/08

CPC classification number: G10L15/22 ,  G10L15/01 ,  G10L15/063 ,  G10L15/08 ,  G10L2015/0631 ,  G10L2015/223

Abstract: Devices and techniques are generally described for cohort determination in natural language processing. In various examples, a first natural language input to a natural language processing system may be determined. The first natural language input may be associated with a first account identifier. A first machine learning model may determine first data representing one or more words of the first natural language input. A second machine learning model may determine second data representing one or more acoustic characteristics of the first natural language input. Third data may be determined, the third data including a predicted performance for processing the first natural language input by the natural language processing system. The third data may be determined based on the first data representation and the second data representation.

公开(公告)号：US11869490B1

公开(公告)日：2024-01-09

申请号：US16993482

申请日：2020-08-14

Applicant: Amazon Technologies, Inc.

Inventor： Rahul Gupta ,  Jwala Dhamala ,  Melanie C B Gens ,  Sachin Midha ,  Jennifer Yuen ,  Dewan Muhammed Ibtesham ,  Wael Hamza ,  Xinhong Zhang ,  Md Humayun Arafat

IPC: G10L15/183 ,  G10L15/06 ,  G06N3/08 ,  G06N20/00

CPC classification number: G10L15/183 ,  G06N3/08 ,  G06N20/00 ,  G10L15/063

Abstract: Techniques for tuning parameters for machine learning models are described. Different values for a parameter are tested to determine the value that results in an optimized model. A parameter value may be selected for testing using a search algorithm based on how the model performs with respect to other values for the parameter. Different values may be tested until a stopping criterion (such as time for testing, number of trials, amount of enhancement in performance, etc.) is met. In some embodiments, the techniques may be used to determine parameter values for natural language processing models.

公开(公告)号：US12197871B2

公开(公告)日：2025-01-14

申请号：US17973674

申请日：2022-10-26

Applicant: Amazon Technologies, Inc.

Inventor： Pavel Bhowmik ,  Melanie C B Gens ,  Sachin Midha ,  Rahul Gupta ,  Sriram Venkatapathy ,  Xinhong Zhang ,  Anoop Kumar ,  Pooja Sanjay Sonawane ,  Samuel Harry Ingbar

IPC: G06F17/00 ,  G06F40/30 ,  G10L15/18 ,  G10L15/22

Abstract: Techniques for evaluating a natural language understanding (NLU) component and determining an action to resolve an issue processing a user input are described. The system determines which component is invoked by a baseline NLU component is processing the user input, and which component is invoked by an updated NLU component. Based on that information, the system selects the action to resolve the updated NLU component generating an undesired response to the user input.

公开(公告)号：US20230142272A1

公开(公告)日：2023-05-11

申请号：US17973674

申请日：2022-10-26

Applicant: Amazon Technologies, Inc.

Inventor： Pavel Bhowmik ,  Melanie C B Gens ,  Sachin Midha ,  Rahul Gupta ,  Sriram Venkatapathy ,  Xinhong Zhang ,  Anoop Kumar ,  Pooja Sanjay Sonawane ,  Samuel Harry Ingbar

IPC: G06F40/30 ,  G10L15/18

CPC classification number: G06F40/30 ,  G10L15/1822 ,  G10L2015/223

Abstract: Techniques for evaluating a natural language understanding (NLU) component and determining an action to resolve an issue processing a user input are described. The system determines which component is invoked by a baseline NLU component is processing the user input, and which component is invoked by an updated NLU component. Based on that information, the system selects the action to resolve the updated NLU component generating an undesired response to the user input.

公开(公告)号：US12254879B2

公开(公告)日：2025-03-18

申请号：US17952630

申请日：2022-09-26

Applicant: Amazon Technologies, Inc.

Inventor： Ramya Chaganti ,  Mark Lawrence ,  Ryan McCrate ,  Melanie C B Gens ,  Andrew Smith ,  Raja Bose ,  Zexiong Yan ,  Jyoti Chhabra

IPC: G10L15/22 ,  G10L15/06 ,  G10L15/08 ,  G06F3/16 ,  G10L13/00

Abstract: Techniques for enabling access in a multi-assistant speech processing system are described, where a first assistant system may use components of a second assistant system as data processing components. Runtime operational data and user input data related to the first assistant may be kept separate from the processing data and input data related to the second assistant by propagating a first account ID, for user inputs directed to the first assistant, through the processing pipeline, and using a second account for user inputs directed to the second assistant. A mapping between the first account ID and the second account ID may be accessible to a select number of system components. Handoffs between the two assistants are handled in a manner where data related to one assistant is not accessible by the other assistant.

公开(公告)号：US20250006196A1

公开(公告)日：2025-01-02

申请号：US18345455

申请日：2023-06-30

Applicant: Amazon Technologies, Inc.

Inventor： Hann Wang ,  Angeliki Metallinou ,  Melanie C B Gens ,  Arijit Biswas ,  Ying Shi

IPC: G10L15/26 ,  G10L13/08

Abstract: Techniques for generating a prompt for a language model to determine an action responsive to a user input, are described. In some embodiments, the system receives a user input, determines one or more application programming interfaces (APIs) configured to perform actions that are relevant to the user input and exemplars representing examples of using the APIs with respect to user inputs similar to the current user input. The system further determines device states of devices that are determined to be related to the user input and also determines other contextual information (e.g., weather information, time of day, geographic location, etc.). The system generates a prompt including the user input, the APIs, the exemplars, the device states, and the other contextual information. A language model processes the prompt to determine an action responsive to the user input and the system causes performance of the action.