Sadly, this is the major area where Java Generics falls down... there is just no good solution.
I've generally resorted to making a new class, with the interface as Set>, but that wraps Set> (without extending it, which would cause the same problem).