I finally managed to build a working solution of a plugin architecture with help of some guys over here, but now a new problem arises.
My hosting application uses it\'s
You could make the each plug in read it's own ConfigurationSection then in the main config file use the ConfigSource setting to point to an external file. (See this link for more information)
You don't fully escape having plugin config information in the main app.config file but at least the plugin specific settings are in separate files.