I have a core set of files I use for almost every project, but each project also has its own unique files too.
When i work on one project i sometime update these core files
branches in git are probably not the best solution for your problem, but submodules are! but you need a repository for each project, plus a repository for your core files/libs.