Segmentation of three dimensional objects may be implemented using a neural network model, a clustering module, a factorization module, and a geometric fitting module. The neural network model is configured to analyze point cloud data for a geographic region and assign probability values outputted from the neural network to points in the point cloud data. The clustering module is configured to group a subset of the probability values based on relative locations of the assigned points in the point cloud data. The factorization module is configured to factor a matrix with the subset of the clustered probability values to assign a line for a three dimensional object of the geographic region. The geometric fitting module is configured to fit at least one predetermined shape for the three dimensional object to the point cloud data based at least on the assigned line.