The invention discloses an aluminum-based composite material with superfine crystal texture and a preparation method thereof, and belongs to the technical field of superfine material crystallization and composite material preparation. Wrought aluminum alloy or Al-Mg series cast aluminum alloy is used as a matrix material. The method comprises the following steps of: forming grooves or holes in the matrix material, filling amorphous alloy serving as a thinning factor with good compatibility with the matrix material into the grooves or the holes, and performing stirring friction machining on the grooves or the holes filled with the thinning factor to obtain the aluminum-based composite material with superfine crystal texture, wherein the filling amount of the thinning factor is 1 to 10 weight percent of the matrix material, and the stirring friction machining parameters comprise that the revolving speed of a stirring tool is 500 to 1,000rpm, the pressure is 10 to 20MPa and the advancingspeed is 40 to 150 millimeters per minute. By the method, the matrix material can obtain remarkable superfine crystal texture, and the performance of the composite material is remarkably improved; and meanwhile, because of the solid machining method, the processing process is simple, and environmental pollution is avoided.