How can we reduce the size of homebrew-cask and homebrew-core folders?

Question

Is there a way to reduce the size of homebrew-cask and homebrew-core folders? They are 230.7 MB and 346.5 MB respectively.

Also, brew cleanup does not do a w