A biopsy device includes a body portion, a cannula, a cutter, and a tissue stop having a proximal face. The cannula has a transverse aperture that is defined in part by a proximal edge and a distal edge. The cutter is movable to a distal position to sever tissue protruding through the transverse aperture. A tip at the distal end of the cannula has a sharp edge that extends proximally to a longitudinal position that is proximal to the longitudinal position of the distal edge of the transverse aperture. The sharp edge of the tip extends to a longitudinal position that is proximal to the longitudinal position of the distal cutting edge of the cutter when the cutter is at the distal position. The sharp edge of the tip extends to a longitudinal position that is proximal to the longitudinal position of the proximal face of the tissue stop.