Computational neuroscience
This article may be too technical for most readers to understand. Please help improve it to make it understandable to non-experts, without removing the technical details. (March 2014) (Learn how and when to remove this template message) |
Computational neuroscience (also known as theoretical neuroscience or mathematical neuroscience) is a branch of neuroscience which employs mathematical models, theoretical analysis and abstractions of the brain to understand the principles that govern the development, structure, physiology and cognitive abilities of the nervous system.[1][2][3][4]
Computational neuroscience focuses on the description of biologically plausible neurons (and neural systems) and their physiology and dynamics, and it is therefore not concerned with biologically unrealistic disciplines such as connectionism, machine learning, artificial neural networks, artificial intelligence and computational learning theory.[5][6][7][8][9][10][11][12]
In theory, computational neuroscience would be a sub-field of theoretical neuroscience which employs computational simulations to validate and solve the mathematical models. However, since the biologically plausible mathematical models formulated in neuroscience are in most cases too complex to be solved analytically, the two terms are essentially synonyms and are used interchangeably.[1] The term mathematical neuroscience is also used sometimes, to stress the quantitative nature of the field.[13]
The mathematical models formulated in computational neuroscience are useful since they capture the essential features of the biological system at multiple spatial-temporal scales, from membrane currents, proteins, and chemical coupling to network oscillations, columnar and topographic architecture, and learning and memory. Furthermore, these computational models frame hypotheses that can be directly tested by biological or psychological experiments.
History[edit]
The term 'computational neuroscience' was introduced by Eric L. Schwartz, who organized a conference, held in 1985 in Carmel, California, at the request of the Systems Development Foundation to provide a summary of the current status of a field which until that point was referred to by a variety of names, such as neural modeling, brain theory and neural networks. The proceedings of this definitional meeting were published in 1990 as the book Computational Neuroscience.[14] The first open international meeting focused on Computational Neuroscience was organized by James M. Bower and John Miller in San Francisco, California in 1989 and has continued each year since as the annual CNS meeting.[15] The first graduate educational program in computational neuroscience was organized as the Computational and Neural Systems Ph.D. program at the California Institute of Technology in 1985.
The early historical roots of the field can be traced to the work of people such as Louis Lapicque, Hodgkin & Huxley, Hubel & Wiesel, and David Marr, to name a few. Lapicque introduced the integrate and fire model of the neuron in a seminal article published in 1907.[16] This model is still popular today for artificial neural networks studies because of its simplicity (see a recent review[17]).
About 40 years later, Hodgkin & Huxley developed the voltage clamp and created the first biophysical model of the action potential. Hubel & Wiesel discovered that neurons in the primary visual cortex, the first cortical area to process information coming from the retina, have oriented receptive fields and are organized in columns.[18] David Marr's work focused on the interactions between neurons, suggesting computational approaches to the study of how functional groups of neurons within the hippocampus and neocortex interact, store, process, and transmit information. Computational modeling of biophysically realistic neurons and dendrites began with the work of Wilfrid Rall, with the first multicompartmental model using cable theory.
Major topics[edit]
Research in computational neuroscience can be roughly categorized into several lines of inquiry. Most computational neuroscientists collaborate closely with experimentalists in analyzing novel data and synthesizing new models of biological phenomena.
Single-neuron modeling[edit]
Even single neurons have complex biophysical characteristics and can perform computations (e.g.[19]). Hodgkin and Huxley's original model only employed two voltage-sensitive currents (Voltage sensitive ion channels are glycoprotein molecules which extend through the lipid bilayer, allowing ions to traverse under certain conditions through the axolemma), the fast-acting sodium and the inward-rectifying potassium. Though successful in predicting the timing and qualitative features of the action potential, it nevertheless failed to predict a number of important features such as adaptation and shunting. Scientists now believe that there are a wide variety of voltage-sensitive currents, and the implications of the differing dynamics, modulations, and sensitivity of these currents is an important topic of computational neuroscience.[20]
The computational functions of complex dendrites are also under intense investigation. There is a large body of literature regarding how different currents interact with geometric properties of neurons.[21]
Some models are also tracking biochemical pathways at very small scales such as spines or synaptic clefts.
There are many software packages, such as GENESIS and NEURON, that allow rapid and systematic in silico modeling of realistic neurons. Blue Brain, a project founded by Henry Markram from the École Polytechnique Fédérale de Lausanne, aims to construct a biophysically detailed simulation of a cortical column on the Blue Gene supercomputer.
Modeling the richness of biophysical properties on the single-neuron scale can supply mechanisms that serve as the building blocks for network dynamics.[22] However, detailed neuron descriptions are computationally expensive and this can handicap the pursuit of realistic network investigations, where many neurons need to be simulated. As a result, researchers that study large neural circuits typically represent each neuron and synapse with an artificially simple model, ignoring much of the biological detail. Hence there is a drive to produce simplified neuron models that can retain significant biological fidelity at a low computational overhead. Algorithms have been developed to produce faithful, faster running, simplified surrogate neuron models from computationally expensive, detailed neuron models.[23]
Development, axonal patterning, and guidance[edit]
Computational neuroscience aims to address a wide array of questions. How do axons and dendrites form during development? How do axons know where to target and how to reach these targets? How do neurons migrate to the proper position in the central and peripheral systems? How do synapses form? We know from molecular biology that distinct parts of the nervous system release distinct chemical cues, from growth factors to hormones that modulate and influence the growth and development of functional connections between neurons.
Theoretical investigations into the formation and patterning of synaptic connection and morphology are still nascent. One hypothesis that has recently garnered some attention is the minimal wiring hypothesis, which postulates that the formation of axons and dendrites effectively minimizes resource allocation while maintaining maximal information storage.[24]
Sensory processing[edit]
Early models of sensory processing understood within a theoretical framework are credited to Horace Barlow. Somewhat similar to the minimal wiring hypothesis described in the preceding section, Barlow understood the processing of the early sensory systems to be a form of efficient coding, where the neurons encoded information which minimized the number of spikes. Experimental and computational work have since supported this hypothesis in one form or another.
Current research in sensory processing is divided among a biophysical modelling of different subsystems and a more theoretical modelling of perception. Current models of perception have suggested that the brain performs some form of Bayesian inference and integration of different sensory information in generating our perception of the physical world.[25][26]
Memory and synaptic plasticity[edit]
Earlier models of memory are primarily based on the postulates of Hebbian learning. Biologically relevant models such as Hopfield net have been developed to address the properties of associative (also known as "content-addressable") style of memory that occur in biological systems. These attempts are primarily focusing on the formation of medium- and long-term memory, localizing in the hippocampus. Models of working memory, relying on theories of network oscillations and persistent activity, have been built to capture some features of the prefrontal cortex in context-related memory.[27] Additional models look at the close relationship between the basal ganglia and the prefrontal cortex and how that contributes to working memory.[28]
One of the major problems in neurophysiological memory is how it is maintained and changed through multiple time scales. Unstable synapses are easy to train but also prone to stochastic disruption. Stable synapses forget less easily, but they are also harder to consolidate. One recent computational hypothesis involves cascades of plasticity that allow synapses to function at multiple time scales.[29] Stereochemically detailed models of the acetylcholine receptor-based synapse with the Monte Carlo method, working at the time scale of microseconds, have been built.[30] It is likely that computational tools will contribute greatly to our understanding of how synapses function and change in relation to external stimulus in the coming decades.
Behaviors of networks[edit]
Biological neurons are connected to each other in a complex, recurrent fashion. These connections are, unlike most artificial neural networks, sparse and usually specific. It is not known how information is transmitted through such sparsely connected networks, although specific areas of the brain, such as the Visual cortex, are understood in some detail.[31] It is also unknown what the computational functions of these specific connectivity patterns are, if any.
The interactions of neurons in a small network can be often reduced to simple models such as the Ising model. The statistical mechanics of such simple systems are well-characterized theoretically. There has been some recent evidence that suggests that dynamics of arbitrary neuronal networks can be reduced to pairwise interactions.[32] It is not known, however, whether such descriptive dynamics impart any important computational function. With the emergence of two-photon microscopy and calcium imaging, we now have powerful experimental methods with which to test the new theories regarding neuronal networks.
In some cases the complex interactions between inhibitory and excitatory neurons can be simplified using mean field theory, which gives rise to the population model of neural networks [33]. While many neurotheorists prefer such models with reduced complexity, others argue that uncovering structural functional relations depends on including as much neuronal and network structure as possible. Models of this type are typically built in large simulation platforms like GENESIS or NEURON. There have been some attempts to provide unified methods that bridge and integrate these levels of complexity.[34]
Cognition, discrimination, and learning[edit]
Computational modeling of higher cognitive functions has only recently[when?] begun. Experimental data comes primarily from single-unit recording in primates. The frontal lobe and parietal lobe function as integrators of information from multiple sensory modalities. There are some tentative ideas regarding how simple mutually inhibitory functional circuits in these areas may carry out biologically relevant computation.[35]
The brain seems to be able to discriminate and adapt particularly well in certain contexts. For instance, human beings seem to have an enormous capacity for memorizing and recognizing faces. One of the key goals of computational neuroscience is to dissect how biological systems carry out these complex computations efficiently and potentially replicate these processes in building intelligent machines.
The brain's large-scale organizational principles are illuminated by many fields, including biology, psychology, and clinical practice. Integrative neuroscience attempts to consolidate these observations through unified descriptive models and databases of behavioral measures and recordings. These are the bases for some quantitative modeling of large-scale brain activity.[36]
The Computational Representational Understanding of Mind (CRUM) is another attempt at modeling human cognition through simulated processes like acquired rule-based systems in decision making and the manipulation of visual representations in decision making.
Consciousness[edit]
One of the ultimate goals of psychology/neuroscience is to be able to explain the everyday experience of conscious life. Francis Crick and Christof Koch made some attempts to formulate a consistent framework for future work in neural correlates of consciousness (NCC), though much of the work in this field remains speculative.[37]
Computational clinical neuroscience[edit]
Computational Clinical Neuroscience is a field that brings together experts in neuroscience, neurology, psychiatry, decision sciences and computational modeling to quantitatively define and investigate problems in neurological and psychiatric diseases, and to train scientists and clinicians that wish to apply these models to diagnosis and treatment.[38][39]
See also[edit]
- Action potential
- Biological neuron models
- Bayesian Brain
- Brain simulation
- Computational anatomy
- Connectomics
- Electrophysiology
- Goldman equation
- Hodgkin–Huxley model
- Information theory
- Mathematical model
- Nonlinear dynamics
- Neural coding
- Neural decoding
- Neural oscillation
- Neurocomputational speech processing
- Neuroinformatics
- Neuroplasticity
- Neurophysiology
- Systems neuroscience
- Theoretical Biology
- Theta model
Notes and references[edit]
- ^ a b Trappenberg, Thomas P. (2002). Fundamentals of Computational Neuroscience. United States: Oxford University Press Inc. p. 1. ISBN 978-0-19-851582-1.
- ^ What is computational neuroscience? Patricia S. Churchland, Christof Koch, Terrence J. Sejnowski. in Computational Neuroscience pp.46-55. Edited by Eric L. Schwartz. 1993. MIT Press "Archived copy". Archived from the original on 2011-06-04. Retrieved 2009-06-11.CS1 maint: Archived copy as title (link)
- ^ Press, The MIT. "Theoretical Neuroscience". The MIT Press. Retrieved 2018-05-24.
- ^ Gerstner, W.; Kistler, W.; Naud, R.; Paninski, L. (2014). Neuronal Dynamics. Cambridge, UK: Cambridge University Press. ISBN 9781107447615.
- ^ "Encephalos Journal". www.encephalos.gr. Retrieved 2018-02-20.
- ^ Zorzi, Marco; Testolin, Alberto; Stoianov, Ivilin P. (2013-08-20). "Modeling language and cognition with deep unsupervised learning: a tutorial overview". Frontiers in Psychology. 4: 515. doi:10.3389/fpsyg.2013.00515. ISSN 1664-1078. PMC 3747356. PMID 23970869.
- ^ "Organismically-inspired robotics: homeostatic adaptation and teleology beyond the closed sensorimotor loop" (PDF).
- ^ Pfeifer, R.; Schreter, Z.; Fogelman-Soulié, F.; Steels, L. (1989-08-23). Connectionism in Perspective. Elsevier. ISBN 9780444598769.
- ^ "ANALYTIC AND CONTINENTAL PHILOSOPHY".
- ^ Shai, Adam; Larkum, Matthew Evan (2017-12-05). "Branching into brains". eLife. 6. doi:10.7554/eLife.33066. ISSN 2050-084X. PMC 5716658. PMID 29205152.
- ^ Brooks, R.; Hassabis, D.; Bray, D.; Shashua, A. (2012-02-22). "Turing centenary: Is the brain a good model for machine intelligence?". Nature. 482 (7386): 462–463. doi:10.1038/482462a. ISSN 0028-0836. PMID 22358812.
- ^ Browne, A. (1997-01-01). Neural Network Perspectives on Cognition and Adaptive Robotics. CRC Press. ISBN 9780750304559.
- ^ Gutkin, Boris; Pinto, David; Ermentrout, Bard (March 2003). "Mathematical neuroscience: from neurons to circuits to systems". Journal of Physiology, Paris. 97 (2–3): 209–219. CiteSeerX 10.1.1.5.9572. doi:10.1016/j.jphysparis.2003.09.005. ISSN 0928-4257. PMID 14766142.
- ^ Schwartz, Eric (1990). Computational neuroscience. Cambridge, Mass: MIT Press. ISBN 978-0-262-19291-0.
- ^ Bower, James M. (2013). 20 years of Computational neuroscience. Berlin, Germany: Springer. ISBN 978-1461414230.
- ^ Lapicque L (1907). "Recherches quantitatives sur l'excitation électrique des nerfs traitée comme une polarisation". J. Physiol. Pathol. Gen. 9: 620–635.
- ^ Brunel N, Van Rossum MC (2007). "Lapicque's 1907 paper: from frogs to integrate-and-fire". Biol. Cybern. 97 (5–6): 337–339. doi:10.1007/s00422-007-0190-0. PMID 17968583.
- ^ Hubel DH, Wiesel TN (1962). "Receptive fields, binocular interaction and functional architecture in the cat's visual cortex". J. Physiol. 160 (1): 106–54. doi:10.1113/jphysiol.1962.sp006837. PMC 1359523. PMID 14449617.
- ^ Forrest MD (2014). "Intracellular Calcium Dynamics Permit a Purkinje Neuron Model to Perform Toggle and Gain Computations Upon its Inputs". Frontiers in Computational Neuroscience. 8: 86. doi:10.3389/fncom.2014.00086. PMC 4138505. PMID 25191262.
- ^ Wu, Samuel Miao-sin; Johnston, Daniel (1995). Foundations of cellular neurophysiology. Cambridge, Mass: MIT Press. ISBN 978-0-262-10053-3.
- ^ Koch, Christof (1999). Biophysics of computation: information processing in single neurons. Oxford [Oxfordshire]: Oxford University Press. ISBN 978-0-19-510491-2.
- ^ Forrest MD (2014). "Intracellular Calcium Dynamics Permit a Purkinje Neuron Model to Perform Toggle and Gain Computations Upon its Inputs". Frontiers in Computational Neuroscience. 8: 86. doi:10.3389/fncom.2014.00086. PMC 4138505. PMID 25191262.
- ^ Forrest MD (April 2015). "Simulation of alcohol action upon a detailed Purkinje neuron model and a simpler surrogate model that runs >400 times faster". BMC Neuroscience. 16 (27): 27. doi:10.1186/s12868-015-0162-6. PMC 4417229. PMID 25928094.
- ^ Chklovskii DB, Mel BW, Svoboda K (October 2004). "Cortical rewiring and information storage". Nature. 431 (7010): 782–8. Bibcode:2004Natur.431..782C. doi:10.1038/nature03012. PMID 15483599.
Review article - ^ Weiss, Yair; Simoncelli, Eero P.; Adelson, Edward H. (20 May 2002). "Motion illusions as optimal percepts". Nature Neuroscience. 5 (6): 598–604. doi:10.1038/nn0602-858. PMID 12021763.
- ^ Ernst, Marc O.; Bülthoff, Heinrich H. (April 2004). "Merging the senses into a robust percept". Trends in Cognitive Sciences. 8 (4): 162–169. CiteSeerX 10.1.1.299.4638. doi:10.1016/j.tics.2004.02.002.
- ^ Durstewitz D, Seamans JK, Sejnowski TJ (2000). "Neurocomputational models of working memory". Nat. Neurosci. 3 (Suppl): 1184–91. doi:10.1038/81460. PMID 11127836.
- ^ Frank, M. J.; Loughry, B.; O'Reilly, R. C. (2001). "Interactions between frontal cortex and basal ganglia in working memory: A computational model" (PDF). Cognitive, Affective, & Behavioral Neuroscience. 1 (2): 137–160. doi:10.3758/cabn.1.2.137. Retrieved 2018-12-06.
- ^ Fusi S, Drew PJ, Abbott LF (2005). "Cascade models of synaptically stored memories". Neuron. 45 (4): 599–611. doi:10.1016/j.neuron.2005.02.001. PMID 15721245.
- ^ Coggan JS, Bartol TM, Esquenazi E, et al. (2005). "Evidence for ectopic neurotransmission at a neuronal synapse". Science. 309 (5733): 446–51. Bibcode:2005Sci...309..446C. doi:10.1126/science.1108239. PMC 2915764. PMID 16020730.
- ^ Olshausen, Bruno A.; Field, David J. (1997-12-01). "Sparse coding with an overcomplete basis set: A strategy employed by V1?". Vision Research. 37 (23): 3311–3325. doi:10.1016/S0042-6989(97)00169-7.
- ^ Schneidman E, Berry MJ, Segev R, Bialek W (2006). "Weak pairwise correlations imply strongly correlated network states in a neural population". Nature. 440 (7087): 1007–12. arXiv:q-bio/0512013. Bibcode:2006Natur.440.1007S. doi:10.1038/nature04701. PMC 1785327. PMID 16625187.
- ^ Wilson, H. R.; Cowan, J.D. (1973). "A mathematical theory of the functional dynamics of cortical and thalamic nervous tissue". Kybernetik. 13 (2): 55–80. doi:10.1007/BF00288786. PMID 4767470.
- ^ Anderson, Charles H.; Eliasmith, Chris (2004). Neural Engineering: Computation, Representation, and Dynamics in Neurobiological Systems (Computational Neuroscience). Cambridge, Mass: The MIT Press. ISBN 978-0-262-55060-4.
- ^ Machens CK, Romo R, Brody CD (2005). "Flexible control of mutual inhibition: a neural model of two-interval discrimination". Science. 307 (5712): 1121–4. Bibcode:2005Sci...307.1121M. CiteSeerX 10.1.1.523.4396. doi:10.1126/science.1104171. PMID 15718474.
- ^ Robinson PA, Rennie CJ, Rowe DL, O'Connor SC, Gordon E (2005). "Multiscale brain modelling". Philosophical Transactions of the Royal Society B. 360 (1457): 1043–1050. doi:10.1098/rstb.2005.1638. PMC 1854922. PMID 16087447.
- ^ Crick F, Koch C (2003). "A framework for consciousness". Nat. Neurosci. 6 (2): 119–26. doi:10.1038/nn0203-119. PMID 12555104.
- ^ Adaszewski S1, Dukart J, Kherif F, Frackowiak R, Draganski B; Alzheimer's Disease Neuroimaging Initiative (2013). "How early can we predict Alzheimer's disease using computational anatomy?". Neurobiol Aging. 34 (12): 2815–26. doi:10.1016/j.neurobiolaging.2013.06.015. PMID 23890839.CS1 maint: Multiple names: authors list (link)
- ^ Friston KJ, Stephan KE, Montague R, Dolan RJ (2014). "Computational psychiatry: the brain as a phantastic organ". Lancet Psychiatry. 1 (2): 148–58. doi:10.1016/S2215-0366(14)70275-5. PMID 26360579.
Bibliography[edit]
- Chklovskii DB (2004). "Synaptic connectivity and neuronal morphology: two sides of the same coin". Neuron. 43 (5): 609–17. doi:10.1016/j.neuron.2004.08.012. PMID 15339643.
- Sejnowski, Terrence J.; Churchland, Patricia Smith (1992). The computational brain. Cambridge, Mass: MIT Press. ISBN 978-0-262-03188-2.
- Gerstner, W.; Kistler, W.; Naud, R.; Paninski, L. (2014). Neuronal Dynamics. Cambridge, UK: Cambridge University Press. ISBN 9781107447615.
- Abbott, L. F.; Dayan, Peter (2001). Theoretical neuroscience: computational and mathematical modeling of neural systems. Cambridge, Mass: MIT Press. ISBN 978-0-262-04199-7.
- Eliasmith, Chris; Anderson, Charles H. (2003). Neural engineering: Representation, computation, and dynamics in neurobiological systems. Cambridge, Mass: MIT Press. ISBN 978-0-262-05071-5.
- Hodgkin AL, Huxley AF (28 August 1952). "A quantitative description of membrane current and its application to conduction and excitation in nerve". J. Physiol. 117 (4): 500–44. doi:10.1113/jphysiol.1952.sp004764. PMC 1392413. PMID 12991237.
- William Bialek; Rieke, Fred; David Warland; Rob de Ruyter van Steveninck (1999). Spikes: exploring the neural code. Cambridge, Mass: MIT. ISBN 978-0-262-68108-7.CS1 maint: Multiple names: authors list (link)
- Schutter, Erik de (2001). Computational neuroscience: realistic modeling for experimentalists. Boca Raton: CRC. ISBN 978-0-8493-2068-2.
- Sejnowski, Terrence J.; Hemmen, J. L. van (2006). 23 problems in systems neuroscience. Oxford [Oxfordshire]: Oxford University Press. ISBN 978-0-19-514822-0.
- Michael A. Arbib; Shun-ichi Amari; Prudence H. Arbib (2002). The Handbook of Brain Theory and Neural Networks. Cambridge, Massachusetts: The MIT Press. ISBN 978-0-262-01197-6.
External links[edit]
Wikimedia Commons has media related to Computational neuroscience. |
Journals[edit]
- Journal of Mathematical Neuroscience
- Journal of Computational Neuroscience
- Neural Computation
- Cognitive Neurodynamics
- Frontiers in Computational Neuroscience
- PLoS Computational Biology
- Frontiers in Neuroinformatics
Software[edit]
- BRIAN, a Python based simulator
- Budapest Reference Connectome, web based 3D visualization tool to browse connections in the human brain
- Emergent, neural simulation software.
- GENESIS, a general neural simulation system.
Conferences[edit]
- Computational and Systems Neuroscience (COSYNE) – a computational neuroscience meeting with a systems neuroscience focus.
- Annual Computational Neuroscience Meeting (CNS)– a yearly computational neuroscience meeting.
- Neural Information Processing Systems (NIPS)– a leading annual conference covering other machine learning topics as well.
- International Conference on Cognitive Neurodynamics (ICCN)– a yearly conference.
- UK Mathematical Neurosciences Meeting– a new yearly conference, focused on mathematical aspects.
- The NeuroComp Conference– a yearly computational neuroscience conference (France).
- Bernstein Conference on Computational Neuroscience (BCCN)– a yearly conference in Germany, organized by the Bernstein Network for Computational Neuroscience.
- AREADNE Conferences– a biennial meeting that includes theoretical and experimental results, held in even years in Santorini, Greece.
Websites[edit]
- Encyclopedia of Computational Neuroscience, part of Scholarpedia, an online expert curated encyclopedia on computational neuroscience and dynamical systems