A system and method for optimizing defragmentation of content in a content delivery network (CDN). In an example, a manifest available to the content delivery node with respect to a particular content as well as segment files stored in a database cache of the content delivery node are analyzed to determine if any segment files referenced by the manifest are absent from the database cache. If so, one or more delivery rules associated with the content delivery node based on historical ABR asset delivery patterns may be applied to determine representations of the absent segment files that satisfy the one or more delivery rules. After determining compliant representations of the absent segment files, they may be pulled from another content delivery node of the CDN (e.g., a parent node or an edge server node).