I've just been battling a similar issue. For me it turned out to be that I had enabled internal logging for NLog. It added about 3 minutes to the startup time!
Original config
Fixed Config
For Info I discovered this by using SysInternals' ProcMon.exe, filtering on the Process Name "w3wp.exe"