S3 state file does not get created when using Terraform workspaces

Question

I am using S3 backend for my Terraform scripts:

terraform {
  backend "s3" {
    bucket = "mybucket"
    key    = "path/to/my/key"