Reading List – May 2015
For many in ML and AI, biological knowledge is focussed on cortex. This paper gives an excellent broad overview of current biological understanding of intelligence.
Sebastian Billaudelle and Subutai Ahmad, “Porting HTM Models to the Heidelberg Neuromorphic Computing Platform“, arXiv.org, 2015
Progress in Numenta’s HTM and particularly interesting to see collaboration with the Human Brain Project. Does this signify growing collaboration with computational biologists?
Yann LeCun, Yoshua Bengio and Geoffrey Hinton, “Deep learning“, Nature, 2015
Review of Deep learning by the guys that are recognised as THE fathers of the field – they have been working on NN for years without due acclaim, until recently.
LSTM Tutorial, Department of Computer Science, University of Kaiserslautem, 2015
￼Nitish Srivastava, Elman Mansimov and Ruslan Salakhutdinov, Unsupervised Learning of Video Representations using LSTMs“, arXiv.org, 2015
Andrej Karpathy, “The Unreasonable Effectiveness of Recurrent Neural Networks“, Andrej Karpathy blog, 2015
We have a renewed interest in RNN’s and LSTM’s and their great potential. Here are a few papers and tutorials that are well worthwhile for learning about this area.