If the rotor arm itself is loose on the distributor shaft, then either it is cracked, or the little flat steel spring inside it is lost or broken. Get a new rotor arm quick.
If the distributor SHAFT is wobbling about, it's time to think about a new distributor.
When that shaft runs off true, the ignition timing and dwell angle are both going to go wrong.
Worth fixing.
CharlesY