In some embodiments, a video encoder or a video decoder obtains a pair of motion vectors for a current coding block of a video signal with respect to two reference frames. Predictions of the current block are generated using the pair of motion vectors from respective reference frames. The video encoder or video decoder further determine an optical flow for the current coding block based on samples values in the predictions. One component of the optical flow is determined based on the other component of the optical flow. Bi-predictive optical flow (BPOF) can be performed on the current coding block using the determined optical flow.