Tag Archives

8 Articles

Reading List

Reading list – July 2015

Posted by ProjectAGI on

This month's reading list continues with a subtheme on recurrent neural networks, and in particular Long Short Term Memory (LSTM).First here's an interesting report on a panel discussion about the future of Deep Learning at the International Conference on Machine Learning (ICML), 2015:http://deeplea ...

Reading List

Reading List – May 2015

Posted by ProjectAGI on

John Lisman, "The Challenge of Understanding the Brain: Where We Stand in 2015", Neuron, 2015For many in ML and AI,  biological knowledge is focussed on cortex. This paper gives an excellent broad overview of current biological understanding of intelligence.Sebastian Billaudelle and Subuta ...

Theory

TP 3/3: Proposed Temporal Pooler

Posted by David Rawlinson on

by David Rawlinson and Gideon KowadloA Temporal Pooler ProposalWe will describe a Temporal Pooler design below. We have tested this design and it gives satisfactory output given the criteria and expectations described below and in the previous articles in this series (post #1, post #2). It is also r ...

Theory

TP 1/3: Temporal Pooler background

Posted by David Rawlinson on

by David Rawlinson and Gideon KowadloArticle SeriesThis is the first of 3 articles about temporal pooler design for Numenta's Cortical Learning Algorithm (CLA) and related methods (e.g. HTM/MPF). It has limited relevance to Deep Belief Networks.This first part will describe some of the consideration ...