This document describes techniques and systems that enable grid-based enrollment for face authentication. The techniques and systems include overlaying a three-dimensional (3D) tracking window over a preview image of the user's face displayed via a display device. The 3D tracking window includes a plurality of segments, which persist to correspond to an approximate direction that the user's face is facing. Based on the tracking, segments are highlighted to indicate the approximate direction that the user's face is facing, a camera captures enrollment images of the user's face facing that direction, and embeddings are generated based on the enrollment images and stored in a fixed grid of pose cells corresponding to various facial poses for use in face authentication. Responsive to generation and storage of the embeddings, an indication that the one or more segments are completed is provided.