I found the original jackets have much more liner friction that a more modern 3M jacket, so putting the media in a new jacket is always my first step (make sure you note which side is up
)
I think the biggest problem with the dusty disks is how fast the heads collect it, which renders them unable to operate properly. So cleaning often (eg. after each scan of the disk) may be required. At least inspect often and don't assume the rear head is clean just because the front one is.
I expect clogging of the felt pads will accelerate wear, but I'd guess it doesn't interfere with reading the way that dirty heads does.
I also expect that the dust will accumulate on the jacket liners where the soft foam pads press on the jackets; I've disabled those pads to minimize this and reduce jacket friction. As far as I know, no other floppy drive design has those, so I figure they aren't necessary.
Originally I disabled the foam jacket pads to get the disks to turn as the old belts would slip so easily; I've been working on a 3D printed belt tension idler to address this (which will be published at some point, but if you want to volunteer as an alpha tester and have a 3D printer, lmk). If you know of a current source for replacement belts, that would be a valuable contribution.