Transfer box rear output bearing

I'm just catching up on a few little jobs on my 1982 2.25 Petrol Series 3.
At MOT time the inspector pointed out some movement in the rear output bearing. The handbrake drum can me moved around 2-3mm max from side to side. I've removed the drum and the castle nut and there is a small amount of movement in the shaft. So...
1) Is this normal
2) if not... is it a case of replacing the bearing or using shims
3) if bearing replacement is the answer how do I get it out without taking the transfer box to bits!!
Thanks chaps!

if you remove speedo housing the shims are behind it ,but usually if shims need to be removed brg worn but worth a look ,brg would really need transfer box to be stripped to do properly as there is a taper brg behind front out put to