How do I tell Kraken what my public PGP key is?

Under "Settings" on your account screen you'll find a field for entering your PGP public key.