Get the right size and that will not happen.
It's obvious that you have never tried to replace one of these. The ID is almost as tight as those Japanese washers which are hopelessly trapped on the bolt they came with.
But, I know, you just spin up a new one on the lathe.