History of Learning Theory

According to Vapnik, history of research of the learning problem can be thought of as:

1. Constructing the first learning machines
2. Constructing the fundamentals of the theory
3. Constructing neural networks
4. Constructing alternatives to neural network


You cannot always model learning theory by looking at neural networks and modelling the human brain. Not everything can be modeled from nature. Look at the aircraft. It cannot be modeled from studying birds.
And that's all Vapnik has to say about that.