A camera module for a vehicular vision system includes a front camera housing having a housing portion and a cylindrical lens barrel extending from the housing portion and accommodating a lens. An imager printed circuit board is attached at the front camera housing portion. With the imager printed circuit board attached at the front camera housing, the imager is optically aligned with an optical axis of the lens. A rear camera housing portion is mated with the housing portion of the front camera housing so as to encase the imager printed circuit board in the camera module. The housing portion of the front camera housing includes mounting structure configured to mount the camera module at a vehicle. The lens barrel includes a material having a lower coefficient of thermal expansion as compared to the material of the front camera housing.