A debris removal device features structural support from an exterior housing that allows more space for debris collection. The debris enters the collection volume from the top to eliminate debris from having to go through a valve. The screen in the device is disposed internally to protect it during handling and running. A variety of external flow diverters are used to direct debris laden fluid into the tool and to keep debris out of an annular space around the tool that could interfere with its removal. The diverters can be actuated by relative movement in the tool or applied pressure to a piston which can inflate a sleeve or orient or misalign paths through brushes for selective bypassing of fluid exterior to the tool.