The present invention involves a new system and method for synthesizing textures from an input sample. A system and method according to the present invention uses a unique accelerated patch-based sampling system to synthesize high-quality textures in real-time using a small input texture sample. The patch-based sampling system of the present invention works well for a wide variety of textures ranging from regular to stochastic. Potential feature mismatches across patch boundaries are avoided by sampling patches according to a non-parametric estimation of the local conditional Markov Random Field (MRF) density function.