A system and method are disclosed for virtual planogram automation with computer vision, comprising a retail entity comprising a product display area; and a planogram planner configured to access images of products prior to the display of the products in the product display area, classify the images by using a convolutional neural network, assign a bounding box to the products identified in the images, localize and detect objects and estimate product dimensions corresponding to the objects, determine changes in the estimated product dimensions by comparing the estimated product dimensions with corresponding baseline product dimensions to determine whether product dimensions has changed, and determine a total area remaining in a simulated planogram for alternative product placements after factoring in the determined changes in product dimensions.