An apparatus for producing hydrogen gas wherein the apparatus includes a reactor. In one embodiment, the reactor includes at least two conversion-removal portions. Each conversion-removal portion comprises a catalyst section configured to convert CO in the stream to CO2 and a membrane section located downstream of and in flow communication with the catalyst section. The membrane section is configured to selectively remove the CO2 from the stream and to be in flow communication with a sweep gas.