The general graph description format DOT seems the most appropriate to me: it is easy to describe a huge variety of graphs, with this (text) format, and you can plot them with one of the many tools available (Graphviz comes to mind, for example).
You also have the specialized python-graph module at your disposal (which can work with the DOT format too).
