A bone void filler composition is described containing an acidic mineral component that contains a calcium source and a phosphate source or a lower alkyl carboxylate source; an osteoinductive component that contains demineralized bone; and a three-dimensional, osteoconductive biologically acceptable carrier component that contains a collagenous material. The bone void filler composition may be in the form of a sponge or in the form of a paste or putty used to form a sponge or is obtained from particulated sponge, or that forms after a sponge is rehydrated. A pre-mixed bone void filler composition is described containing the acidic mineral component or the lower alkyl carboxylate source; the osteoinductive component; and a biologically acceptable carrier component that contains a liquid carrier. Methods of making and using the compositions are also described. The ratio of demineralized bone component to acidic mineral component may range from about 0.5:1 to about 80:1.