Some examples of the techniques described herein may provide encoding or decoding approaches to generate vectors that meet an orthogonality condition in vector compression procedures (e.g., vector compression or decompression). Encoder layers (e.g., neural network layers) on the encode side may generate orthogonal compressed vectors or decoder layers (e.g., neural network layers) on the decode side may generate orthogonal decompressed vectors. For instance, a neural network layer may be trained to generate a compressed or decompressed vector that satisfies an orthogonality condition relative to one or more previously compressed or decompressed vectors in accordance with a dependency order or a compression sequence. An indication of the dependency order may be communicated between the encode side and the decode side to order encoder or decoder layers (e.g., to execute encoder or decoder layers in the compression sequence) to produce compressed or decompressed vectors that satisfy an orthogonality condition.