Pointers to some good SVM Tutorial

algorithm machine-learning svm libsvm

20,240

Solution 1

The standard recommendation for a tutorial in SVMs is A Tutorial on Support Vector Machines for Pattern Recognition by Christopher Burges. Another good place to learn about SVMs is the Machine Learning Course at Stanford (SVMs are covered in lectures 6-8). Both these are quite theoretical and heavy on the maths.

As for source code; SVMLight, libsvm and TinySVM are all open-source, but the code is not very easy to follow. I haven't looked at each of them very closely, but the source for TinySVM is probably the is easiest to understand. There is also a pseudo-code implementation of the SMO algorithm in this paper.

Solution 2

This is a very good beginner's tutorial on SVM:

SVM explained

I always thought StompChicken's recommended tutorial was a bit confusing in the way that they jump right into talking about bounds and VC statistics and trying to find the optimal machine and such. It's good if you already understand the basics, though.

Solution 3

Lots of video lectures on SVM:
http://videolectures.net/Top/Computer_Science/Machine_Learning/Kernel_Methods/Support_Vector_Machines/

I found the one by Colin Campbell to be very useful.

Solution 4

A practical guide to SVM classification for libsvm
PyML Tutorial for PyML I think 1 is practical for use, 3 is clear for understanding.

Solution 5

Assuming you know the basics (eg max margin classifiers, constructing a kernel), solve Problem Set 2 (handout #5) of that stanford machine learning course. There's answer keys & he holds your hand through the whole process. Use Lecture notes 3 & video #7-8 as references.

If you don't know the basics, watch earlier videos.

View more solutions

20,240

Alphaneo

An electrical engineer, who is a programmer by profession

Updated on January 08, 2020

Comments

Alphaneo over 4 years
I have been trying to grasp the basics of Support Vector Machines, and downloaded and read many online articles. But still am not able to grasp it.

I would like to know, if there are some
- nice tutorial
- sample code which can be used for understanding
or something, that you can think of, and that will enable me to learn SVM Basics easily.

PS: I somehow managed to learn PCA (Principal Component Analysis). BTW, you guys would have guessed that I am working on Machine Learning.
- Mike Williamson almost 11 years
  
  regarding closing this "question", I understand it is not following StackOverflow's "rules", but S.O. needs to recognize that it has become so great & ubiquitous that the community uses it for many purposes. There is no forum of equivalent quality wherein Alphaneo could have made his inquiry. Perhaps Quora? But really, S.O. is my "go-to" for true expertise, not Quora.
- Stompchicken almost 11 years
  
  Machine learning isn't particularly well served by any QA community but I think stats.stackexhange.com or metaoptimize.com/qa are now better sites to use than stackoverflow.com
- Abhijat Biswas almost 9 years
  
  @MikeWilliamson What about Cross-Validated? It exactly caters to this sort of question.
Alphaneo almost 15 years

I only wish I can give you 2 up-votes. A very nice tutorial, I am already on my way ... thanks.
Alphaneo almost 15 years

I agree, it good to "play with the black box before poking into the basics" ...
Ivan Xiao almost 13 years

This is definitely a very easy and intuitive introduction materials for newbies.
Adam Parkin over 12 years

^^ for newbies with a very strong background in "calculus, vector geometry, and lagrange multipliers", which seems to me if you already have that, then any of the "math heavy" intros would be better suited.
The Unfun Cat over 11 years

Problem set seems like an excellent resource. Thanks!
stealthspy over 11 years

Thanks. This is brilliant!
Mike Williamson almost 11 years

That link for the article by Christopher Burges is stale, but StompChicken provided enough details to find it in a search. It is an AWESOME article; both exceedingly "detailed & comprehensive", while also very easily understandable. Christopher Burges did a wonderful job. Great read for anyone interested in SVMs.
Stompchicken almost 11 years

@MikeWilliamson Thanks for pointing out the broken link. I've pointed it at a new and hopefully more permanent URL.
Ashish Negi over 10 years

could you please tell what is [1] and [3] in your answer ?
Reut over 10 years

@ASHISHNEGI sorry, don't why [1] and [3] lost it's link, and I can't remember the specific information. and the answer maybe OUTDATED.
Kaijju almost 7 years

link is broken now
Steve over 6 years

link is fixed now.