A punch system or assembly includes a punch body and a punch tip or insert with a working end and a stem configured for selective engagement and disengagement within a cavity in the punch body. A latch mechanism which can be operated without tools is configured to engage the punch tip stem within the axial cavity in a closed position, and to disengage the punch tip from the punch body in an open position.