A battery holder for use with a battery-powered sensor may be configured such that removing the battery involves at least two distinct motions. The battery holder may include a cradle and a resilient retention strap configured to be deflectable between relaxed and deflected positions. With the retention strap in the relaxed position, the cradle and the retention strap may cooperate to retain the battery in the inserted position within the battery holder. The battery may be removed by first manipulating the retention strap from the relaxed position to the deflected position, and then using a distinct second motion to remove the battery from the holder. The battery holder may be configured to substantially prevent movement of the battery relative to the cradle when the battery is in the inserted position. The battery holder may be configured to facilitate insertion of the battery into the holder in a desired orientation.