Needles of a multiple-needle sewing machine are set on its needle holder so that the form which the needle tips form is not in alignment in parallel with the surface of a cloth to be sewn but deviates from the surface in vertical direction.Accordingly, since plural needles will stick into a cloth not all at once but with time lags, the forces exerted on the needles, needle holder, needle rods, etc. may be dispersed. It is also possible that more needles may be used than the conventional multiple-needle sewing machine.