Try soaking it in a bucket of Evaporust. That stuff really works to dissolve rust and doesn't hurt non ferrous metals or fibers. It is also non toxic. First non toxic thing I have tried that really worked!!
It is not cheap, but it is cheaper than all new fiber discs. I buy it at Harbor Freight and use the 20% off coupons.