Have you measured the actual clearance of each bearing to each journal?
That will tell you if you have a clearance issue (and if so, how bad) or some other issue, like alignment, burrs or bend in shaft (not likely).
if they are tri-metal bearings you would not want to remove any material from the bearing to gain clearance. I'd remove material from journal before that or look for other bearings that offer correct clearance.