A method of simplified depth-based block partitioning (DBBP) for three-dimensional and multi-view video coding is disclosed. In one embodiment, the method receives input data associated with a current texture block in a dependent view, and determines a corresponding depth block or a reference texture block in a reference view for the current texture block. Then, the method derives a representative value based on the corresponding depth block or the reference texture block, and generates a current segmentation mask from the corresponding depth block or the reference texture block. Then, the method selects a current block partition from block partition candidates, wherein the representative value is used for generating the segmentation mask or selecting the current block partition or both, and applies DBBP coding to the current texture block according to the current segmentation mask generated and the current block partition selected.