Create Azure Key Vault Secrets with Azure CLI drops caret ^ character in value

Question

I am trying to create a new Azure Key Vault secret using the Azure Cli v2.9.0 (we use this version in our pipelines and upgrading would be difficult at the moment.) via the