A washing machine appliance includes a wash basket that is rotatably mounted within a wash tub and that defines a wash chamber for receiving a load of clothes. A motor assembly selectively rotates the wash basket, a drain pump assembly selectively drains wash fluid from the wash tub, and a camera assembly is used to monitor an out-of-balance value to minimize out-of-balance issues. Specifically, a controller of the washing machine appliance uses the camera assembly to obtain one or more images of the wash chamber, analyze the one or more images using a machine learning image recognition process to determine the out-of-balance value of the load of clothes in the wash basket, and perform a cloth redistribution process based at least in part on determining that the out-of-balance value is greater than a predetermined out-of-balance threshold.