Methods and compositions for systemically or locally administering by implantation a beneficial agent to a subject are described, and include, for example, depot gel compositions that can be injected into a desired location and which can provide controlled release of a beneficial agent over a short duration of time. The compositions include a low molecular weight biocompatible polymer, a biocompatible solvent having low water miscibility that forms a viscous gel with the polymer and limits water uptake by the implant, and a beneficial agent.