I am assuming that you have to play it too loud to put your ear close enough to each speaker to single out which one is making the fuzzy noise.
The fuzzy noise can come from the voice coil rubbing the sides of its gap. To test, simply remove the covers and gently push them in and see if you 'feel' or hear rubbing. If so, it is probably a misalligned spider, or something has gotten into the gap between the coil and the pole or rear structure. It probably not worth the trouble to fix - replace it. If they are pricey, say so, and I will tell you how to center them. It is not fun.
If none rub, it is probably time to get out the ohm meter and isolate and test each speaker. If it reads infinity - It is blown, replace it. If it reads far below the others, it has shorted across the gap, and might be rubbing, also. Replace it.
If these are pricey little speakers, think about reconing them. I am also assuming there is no crossover in these. If so, that could be the source.
I am assuming you switched channels of your amp, so it is not a blown channel there? Also, passive cones may have a voice coil on them, but they do not have magnets or gaps, so I am a little lost if you were refering that they could produce the fuzz sound. They would ness up if there were cracks in the cone or suspension, possible. A simple visual examination should pretty much cover those.
It is very hard to cover all the variables like this. It is kind of fun though. In person, you fiddle a bit, and poof, there is the problem and solution. You say there are five speakers in the fronts. What are the interesting looking middle ones?