When I attempt to delete a blob from my storage account container, I get an error message, \"There is currently a lease on the blob and no lease ID was specified in
You should have images associated to your VMs. Even if you have deleted your VMs, the images have to be explicitly deleted.
Once the images are deleted, you should see VHD getting cleared as well