Techniques for are described which enable users of a service provider network to manage local storage devices connected to computer systems of the service provider network as a service. A service provider network provides an application programming interface (API) that enables users to manage local storage devices in association with compute instances created by users using a hardware virtualization service of the service provider network. The API can be used to attach local storage devices to compute instances (that is, make local storage devices available for use as a block storage device), detach local storage devices from compute instances (that is, make local storage devices unavailable for use by a compute instance and possibly available for use by other compute instances on the same computer system), among other possible operations.