Dalarna University's logo and link to the university's website

du.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • chicago-author-date
  • chicago-note-bibliography
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Neuroevolution gives rise to more focused information transfer compared to backpropagation in recurrent neural networks
Dalarna University, School of Information and Engineering, Computing.ORCID iD: 0000-0002-4872-1961
2025 (English)In: Neural Computing & Applications, ISSN 0941-0643, E-ISSN 1433-3058, Vol. 37, no 2, p. 757-767Article in journal (Refereed) Published
Abstract [en]

Artificial neural networks (ANNs) are one of the most promising tools in the quest to develop general artificial intelligence. Their design was inspired by how neurons in natural brains connect and process, the only other substrate to harbor intelligence. Compared to biological brains that are sparsely connected and that form sparsely distributed representations, ANNs instead process information by connecting all nodes of one layer to all nodes of the next. In addition, modern ANNs are trained with backpropagation, while their natural counterparts have been optimized by natural evolution over eons. We study whether the training method influences how information propagates through the brain by measuring the transfer entropy, that is, the information that is transferred from one group of neurons to another. We find that while the distribution of connection weights in optimized networks is largely unaffected by the training method, neuroevolution leads to networks in which information transfer is significantly more focused on small groups of neurons (compared to those trained by backpropagation) while also being more robust to perturbations of the weights. We conclude that the specific attributes of a training method (local vs. global) can significantly affect how information is processed and relayed through the brain, even when the overall performance is similar.

Place, publisher, year, edition, pages
2025. Vol. 37, no 2, p. 757-767
Keywords [en]
Recurrent neural network, Transfer entropy, Computation, Memory
National Category
Computer and Information Sciences
Identifiers
URN: urn:nbn:se:du-44778DOI: 10.1007/s00521-022-08125-0ISI: 000900059700001PubMedID: 39866639Scopus ID: 2-s2.0-85144237925OAI: oai:DiVA.org:du-44778DiVA, id: diva2:1722719
Available from: 2022-12-30 Created: 2022-12-30 Last updated: 2025-10-09

Open Access in DiVA

fulltext(5752 kB)207 downloads
File information
File name FULLTEXT01.pdfFile size 5752 kBChecksum SHA-512
5ea12b4ed7d8fa9d75164ed77dfd58f641093c55d419b391d6fd3850c34d635290c32cc30cb47aca16ac0c9a6886d27e6c207300d856b4a4376faa609e30cb69
Type fulltextMimetype application/pdf

Other links

Publisher's full textPubMedScopus

Authority records

Hintze, Arend

Search in DiVA

By author/editor
Hintze, Arend
By organisation
Computing
In the same journal
Neural Computing & Applications
Computer and Information Sciences

Search outside of DiVA

GoogleGoogle Scholar
Total: 211 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
pubmed
urn-nbn

Altmetric score

doi
pubmed
urn-nbn
Total: 456 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • chicago-author-date
  • chicago-note-bibliography
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf