I opened a ticket with Google for this same question and they responded back that it is not possible currently but to stay tuned because they do plan on adding it to the UI shortly.
In the meantime you have to use the storage browser to delete any that you want removed.