If either side is compromised it is difficult to reissue (e.g. if they are undercover in another country).
The beauty of public keys is that they can be revoked and the other side can use your new key without you having to transport/transmit a private key in peril.