After asking this question it is clear to me that I need to be able to perform the garbage collection in the fastest possible time.
How is it possible to tell SQL Server
Apparently there now is a way, by using
sp_filestream_force_garbage_collection
in SQL Server 2012