The invention provides a method of producing a filler comprising calcium carbonate (PCC), preferably to be used in paper or paper board production or in fibre based composites. The method of the invention comprises the steps of; —providing fly ash generated in paper or paper board production; —fractionating said fly ash in at least one step, whereby a coarser fraction is separated from a finer fraction; —forming a suspension of said coarser fraction; —adding carbon dioxide to said suspension to form precipitated calcium carbonate. The method of the invention avoids problems with high amounts of arsenic and heavy metals in the production of filler comprising PCC, when using ash generated in paper or paper board production as a raw material. It has been shown that harmful elements, such as arsenic and heavy metals, are primarily accumulated in the finer fractions of the fly ash. Thus, by using the coarser fraction in the step of carbonation, the amount of arsenic and heavy metals in the final product is reduced.