The sleeve is to "stop shaft whip" according to the manual, so there's no big load on it. You might get away with it the way it is.