Dr. Oliver Obst
Neurocomputing & Distributed Systems
 
Autonomous Systems Lab, CSIRO ICT Centre, Sydney, Australia

Initialization and self-organized optimization of recurrent neural network connectivity

Our new paper describes a mathematical model for generic neural microcircuits, with potential engineering applications, as well as implications to understand how networks in biology are shaped to be optimally adapted to requirements of their environment.

Reservoir computing (RC) is a recent paradigm in the field of recurrent neural networks. Networks in RC have a sparsely and randomly connected fixed hidden layer, and only output connections are trained. RC networks have recently received increased attention as a mathematical model for generic neural microcircuits to investigate and explain computations in neocortical columns. Applied to specific tasks, their fixed random connectivity, however, leads to significant variation in performance. Few problem-specific optimization procedures are known, which would be important for engineering applications, but also in order to understand how networks in biology are shaped to be optimally adapted to requirements of their environment. We study a general network initialization method using permutation matrices and derive a new unsupervised learning rule based on intrinsic plasticity (IP). The IP-based learning uses only local learning, and its aim is to improve network performance in a self-organized way. Using three different benchmarks, we show that networks with permutation matrices for the reservoir connectivity have much more persistent memory than the other methods but are also able to perform highly nonlinear mappings. We also show that IP-based on sigmoid transfer functions is limited concerning the output distributions that can be achieved.

, , , , , ,

Jobs: Open PhD positions on Brain-Computer Interaction at IDIAP

The Idiap research institute (http://www.idiap.ch) seeks several PhD
students in the field of brain-computer interfaces (BCI) to work in the
team of Prof. José del R. Millán (http://people.epfl.ch/jose.millan).

The doctoral student will work in the framework of European and Swiss
projects related to the development of noninvasive brain-actuated
devices in areas ranging from communication to neuroprostheses, and from
interaction to rehabilitation. Projects aim at developing practical BCI
technology, but will also investigate basic questions such as online
adaptation, cognitive processes, multimodal signal fusion, and
brain-robot interaction.

Interested candidates should apply through the Idiap online recruitment
system http://jobs.idiap.ch and send the requested material.

Technorati Tags: , , , , , ,

Summer schools on Neural Networks and on Functional Genomics

There is an international summer school on Functional Genomics at the Baia Samuele Conference Centre, Scicli, Sicily, Italy, July 5th-19th 2008. The webpage is http://www.functional-genomics.it/school, registration deadline May 20th.

Also in Italy, there is the Bertinoro International Summer School of Natural Computation – BNC 2008. It is to be held at the University Residential Center – Bertinoro (Forlì-Cesena), Italy, September 20-27, 2008. See the webpage at http://www.dmi.unict.it/~bnc/index.html for details.

Finally, in Porto, there is NN2008, the 2008 summer school on neural networks in classification, regression and data mining. July 7-11, Porto, Portugal. http://www.nn.isep.ipp.pt.

Technorati Tags: , , , , ,

CFP: Special Issue on Perspectives and Challenges for Recurrent Neural Networks

Special issue of the Elsevier Journal of Algorithms in Cognition, Informatics and Logic.

Submissions connected to the following non-exhaustive list of topics are particularly encouraged:

  • new learning paradigms of RNNs such as unsupervised learning or reservoire learning
  • biologically plausible methods
  • integration of RNNs and symbolic reasoning
  • universal approaches for general data structures such as sets or graphs
  • methods which address the generalization ability of RNNs
  • challenging applications which have the potential to be benchmark problems
  • visionary papers concerning the future of RNNs

Deadline for submissions is 18th of July, 2008.

Technorati Tags: , , , , ,

CFP: 7th International Conference on Development and Learning (ICDL 2008)

The scope of development and learning covered by this conference includes perceptual, cognitive, behavioral, emotional and all other mental capabilities that are exhibited by humans, higher animals, artificial systems and robots. Investigations of the biological and computational mechanisms of mental development are expected to improve our understanding of the working of the whole range of mental capabilities in humans and to enable autonomous development of these highly complex capabilities by robots and other artificial systems. The International Conference on Development and Learning strives to bring together researchers in neuroscience, psychology, artificial intelligence and robotics and other related areas to encourage understanding and cross-fertilization of the latest ideas and results from the different disciplines. Full papers are due March 14. ICDL 2008 takes place Aug 9th-12 in Monterey, California. For details see http://www.icdl08.org/.