Gcc can profile itself, and with this you can see which part of the compilation process takes the longest.
A sample output:
Time variable