Reinforcement Learning Using a Continuous Time Actor-Critic Framework with Spiking Neurons

Nicolas Frémaux; Henning Sprekeler; Wulfram Gerstner

doi:10.1371/journal.pcbi.1003024

Loading metrics

Open Access

Peer-reviewed

Research Article

Reinforcement Learning Using a Continuous Time Actor-Critic Framework with Spiking Neurons

Nicolas Frémaux,

Affiliation School of Computer and Communication Sciences and School of Life Sciences, Brain Mind Institute, École Polytechnique Fédérale de Lausanne, 1015 Lausanne EPFL, Switzerland
⨯
Henning Sprekeler,

Affiliations School of Computer and Communication Sciences and School of Life Sciences, Brain Mind Institute, École Polytechnique Fédérale de Lausanne, 1015 Lausanne EPFL, Switzerland, Theoretical Neuroscience Lab, Institute for Theoretical Biology, Humboldt-Universität zu Berlin, Berlin, Germany
⨯
Wulfram Gerstner

* E-mail: wulfram.gerstner@epfl.ch

Affiliation School of Computer and Communication Sciences and School of Life Sciences, Brain Mind Institute, École Polytechnique Fédérale de Lausanne, 1015 Lausanne EPFL, Switzerland
⨯

Reinforcement Learning Using a Continuous Time Actor-Critic Framework with Spiking Neurons

Nicolas Frémaux,
Henning Sprekeler,
Wulfram Gerstner

Published: April 11, 2013
https://doi.org/10.1371/journal.pcbi.1003024

About the Authors

Nicolas Frémaux

Affiliation School of Computer and Communication Sciences and School of Life Sciences, Brain Mind Institute, École Polytechnique Fédérale de Lausanne, 1015 Lausanne EPFL, Switzerland

Henning Sprekeler

Affiliations School of Computer and Communication Sciences and School of Life Sciences, Brain Mind Institute, École Polytechnique Fédérale de Lausanne, 1015 Lausanne EPFL, Switzerland, Theoretical Neuroscience Lab, Institute for Theoretical Biology, Humboldt-Universität zu Berlin, Berlin, Germany

Wulfram Gerstner

* E-mail: wulfram.gerstner@epfl.ch

Affiliation School of Computer and Communication Sciences and School of Life Sciences, Brain Mind Institute, École Polytechnique Fédérale de Lausanne, 1015 Lausanne EPFL, Switzerland

Competing Interests

The authors have declared that no competing interests exist.

Author Contributions

Conceived and designed the experiments: NF HS. Performed the experiments: NF. Analyzed the data: NF. Wrote the paper: NF WG. Contributed to the analytical derivations: NF HS WG.

Subject Areas
?

For more information about PLOS Subject Areas, click here.
We want your feedback. Do these Subject Areas make sense for this article? Click the target next to the incorrect Subject Area and let us know. Thanks for your help!

Neurons
Is the Subject Area "Neurons" applicable to this article?

Thanks for your feedback.
Learning
Is the Subject Area "Learning" applicable to this article?

Thanks for your feedback.
Action potentials
Is the Subject Area "Action potentials" applicable to this article?

Thanks for your feedback.
Neuronal tuning
Is the Subject Area "Neuronal tuning" applicable to this article?

Thanks for your feedback.
Synapses
Is the Subject Area "Synapses" applicable to this article?

Thanks for your feedback.
Dopamine
Is the Subject Area "Dopamine" applicable to this article?

Thanks for your feedback.
Coding mechanisms
Is the Subject Area "Coding mechanisms" applicable to this article?

Thanks for your feedback.
Decision making
Is the Subject Area "Decision making" applicable to this article?

Thanks for your feedback.