Just the smallest amount,on the cylinder wall only,not the shoulder.No need for the smoothing out,just sit the new bearing in the housing,up against the shoulder and let it set.Then keep an eye on any deterioration in the fit.Likely to work fine.
I have used similar for stearing head bearing after crash(someone else's) ovalised the bearing housing.I did make up a Dolly on a lathe sitting in the other bearing housing too and peened the thing back into shape as well.
I'm surprised you could not find Loctite.look it up and make sure your litigious society hasn't banned it...
Out back, here, we can fix anything with #8 fencing wire but we also have a high degree of self responsibility to go with this....