An implantable delivery device including a housing, a port assembly, and a plurality of grooves. The housing includes an outer wall defining an exterior face. The port assembly includes a septum and a port opening that is exteriorly open relative to the housing face. The plurality of grooves are formed in the exterior face proximate the port opening, and are sized to receive a needle tip to guide the needle tip toward the port opening. In one embodiment, the port assembly is fluidly connected to a reservoir, such that the port assembly constitutes a reservoir refill port.