I stumbled across your question when trying to find a good starting point example of a Support Vector Machine implementation in C#. If someone wants to write their own SVM, and has no desire to use a toolkit or can't use a toolkit for some reason... this served as a good reference for myself.
kernel-support-vector-machines-example-C#