I have a TFS environment with the following branching setup
You'll have to do some trickery...
This does mean that you'll have to have a different nuget.config file per branch and that you should be careful when merging/branching.