Invention Application
- Patent Title: SEMI-SORTED BATCHING WITH VARIABLE LENGTH INPUT FOR EFFICIENT TRAINING
-
Application No.: US17107362Application Date: 2020-11-30
-
Publication No.: US20220148569A1Publication Date: 2022-05-12
- Inventor: Zhenhao Ge , Lakshmish Kaushik , Saket Kumar , Masanori Omote
- Applicant: Sony Interactive Entertainment Inc.
- Applicant Address: JP Tokyo
- Assignee: Sony Interactive Entertainment Inc.
- Current Assignee: Sony Interactive Entertainment Inc.
- Current Assignee Address: JP Tokyo
- Main IPC: G10L15/06
- IPC: G10L15/06 ; G10L13/02

Abstract:
Techniques are described for training neural networks on variable length datasets. The numeric representation of the length of each training sample is randomly perturbed to yield a pseudo-length, and the samples sorted by pseudo-length to achieve lower zero padding rate (ZPR) than completely randomized batching (thus saving computation time) yet higher randomness than strictly sorted batching (thus achieving better model performance than strictly sorted batching).
Public/Granted literature
- US11615782B2 Semi-sorted batching with variable length input for efficient training Public/Granted day:2023-03-28
Information query