An apparatus and a method adapted for shielding and removing fine particles for a portable camera module generated during a portable camera module fabricating process. The portable camera module includes an image sensor and an infrared ray filter. The apparatus includes a tape attaching device for attaching a surface protective tape on a surface of the infrared ray filter so as to prevent fine particles from being attached to the surface of the infrared ray filter, and a tape detaching device movably installed above the surface protective tape in order to detach the surface protective tape having fine particles shielded from the surface of the infrared ray filter. The fine particles are attached to the surface protective tape, which remains shielding the surface of the infrared ray filter during the holder attaching, primary heat treatment, secondary heat treatment, and under filling processes are subsequently carried out. The tape detaching device is moved downward to attach to the surface of the protective tape using vacuum, and is moved upwardly to separate the surface protective tape from the surface of the infrared ray filter, while the vacuum is still being applied.