The invention relates to a hand-operated device for smashing waste refractory bricks, mainly comprising a raw material hopper (1), a mechanical gear (2), a handle (5) and a bracket (7), wherein, the bracket (7) is composed of support legs formed by connected support plates; the raw material hopper (1) is fixed on the support plate; a feed opening is arranged in the middle of the support plate; the mechanical gear (2) is positioned in the raw material hopper (1); the shaft (3) of the mechanical gear is supported by a support (4) after passing through the two side walls of the raw material hopper (1); the handle (5) is arranged on one end or two ends of the shaft (3); a plurality of vertically arranged deformed steel bars are welded on the inner wall of the raw material hopper (1) opposite to the mechanical gear (2); and clearance is reserved between the deformed steel bars. The device of the invention can flexibly process skeletal materials with uniform particles, greatly improves recycling rate of the damaged refractory brick materials, and has the advantages of light weight, economy, practicability and easy popularization.