A semiconductor laser device includes a base, a semiconductor laser element, a lid, a support member, a wavelength converting member, a holding member, and a buffer material. The lid has a recess formed in an upper portion of the lid, and a through-hole formed in the bottom of the recess. The support member is disposed in the recess and has a through-hole. A diameter of the through-hole of the support member is smaller than that of the through-hole of the lid. A coefficient of thermal expansion of the support member is different from that of the lid. The wavelength converting member is supported in the through-hole of the support member. The holding member is fixed to the lid and holds the support member. The buffer material is disposed in at least a part of a space between the lateral surfaces of the recess and the support member.