It isn't necessary to have the query as you're just doing a projection. Move the projection into the call to ToDictionary()
:
var configDictionary = xmlDocument.Descendants("Config")
.ToDictionary(e => e.Attribute("name").Value,
e => e.Attribute("value").Value);