A method for forming a semiconductor device includes forming a plurality of non-semiconductor material portions at a first side of a semiconductor substrate; forming semiconductor material on the plurality of non-semiconductor material portions to bury the plurality of non-semiconductor material portions within semiconductor material; removing at least a portion of the semiconductor substrate from a second side of the semiconductor substrate to uncover the plurality of non-semiconductor material portions at a backside of the semiconductor device; and forming a rough surface at the backside of the semiconductor device by removing at least a subset of the plurality of non-semiconductor material portions while at least a part of a semiconductor material located laterally between the plurality of non-semiconductor material portions remains or by removing at least a part of a semiconductor material located laterally between the plurality of non-semiconductor material portions while the plurality of non-semiconductor material portions remain.