A method of depth map coding for a three-dimensional video coding system incorporating extended reconstructed neighboring depth samples is disclosed. The depth block is partitioned into one or more segments. A prediction value for each segment is derived based on reconstructed neighboring depth samples. The reconstructed neighboring depth samples for at least one segment include at least one reconstructed sample from an extended top neighboring row or an extended left neighboring column. The extended top neighboring row includes at least one extended top-row reconstructed depth sample located adjacent to top side of a second depth block adjacent to right side of the current depth block. The extended left neighboring column includes at least one extended left-column reconstructed depth sample located adjacent to left side of a third depth block adjacent to bottom side of the current depth block.