A sampling while drilling tool positionable in a wellbore penetrating a subterranean formation is provided. The tool includes a drill collar, at least one sample chamber, at least one flowline and at least one cover. The drill collar is operatively connectable to a drill string of the sampling while drilling tool. The drill collar has at least one opening extending through an outer surface thereof and into a cavity. The drill collar has a passage therein for conducting mud therethrough. The sample chamber is positionable in the cavity of the drill collar. The flowline in the drill collar, the at least one flowline operatively connectable to the sample chamber for passing a downhole fluid thereto. The cover is positionable about the at least one opening of the drill collar whereby the sample chamber is removably secured therein.