Dalarna University's logo and link to the university's website

du.sePublications
Planned maintenance
A system upgrade is planned for 24/9-2024, at 12:00-14:00. During this time DiVA will be unavailable.
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • chicago-author-date
  • chicago-note-bibliography
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Robustness of Sparsely Distributed Representations to Adversarial Attacks in Deep Neural Networks
Dalarna University, School of Information and Engineering.
Dalarna University, School of Information and Engineering.
Dalarna University, School of Information and Engineering, Microdata Analysis. BEACON Center for the Study of Evolution in Action, Michigan State University, East Lansing, MI, USA.ORCID iD: 0000-0002-4872-1961
Dalarna University, School of Information and Engineering, Microdata Analysis.ORCID iD: 0000-0001-9523-6689
2023 (English)In: Entropy, E-ISSN 1099-4300, Vol. 25, no 6, article id 933Article in journal (Refereed) Published
Abstract [en]

Deep learning models have achieved an impressive performance in a variety of tasks, but they often suffer from overfitting and are vulnerable to adversarial attacks. Previous research has shown that dropout regularization is an effective technique that can improve model generalization and robustness. In this study, we investigate the impact of dropout regularization on the ability of neural networks to withstand adversarial attacks, as well as the degree of "functional smearing" between individual neurons in the network. Functional smearing in this context describes the phenomenon that a neuron or hidden state is involved in multiple functions at the same time. Our findings confirm that dropout regularization can enhance a network's resistance to adversarial attacks, and this effect is only observable within a specific range of dropout probabilities. Furthermore, our study reveals that dropout regularization significantly increases the distribution of functional smearing across a wide range of dropout rates. However, it is the fraction of networks with lower levels of functional smearing that exhibit greater resilience against adversarial attacks. This suggests that, even though dropout improves robustness to fooling, one should instead try to decrease functional smearing.

Place, publisher, year, edition, pages
2023. Vol. 25, no 6, article id 933
Keywords [en]
adversarial attacks, artificial neural networks, dropout, fast gradient sign method, information relay, information smearedness
National Category
Computer and Information Sciences
Identifiers
URN: urn:nbn:se:du-46366DOI: 10.3390/e25060933ISI: 001017335800001PubMedID: 37372277Scopus ID: 2-s2.0-85163826427OAI: oai:DiVA.org:du-46366DiVA, id: diva2:1779370
Available from: 2023-07-04 Created: 2023-07-04 Last updated: 2023-08-04Bibliographically approved

Open Access in DiVA

fulltext(660 kB)67 downloads
File information
File name FULLTEXT01.pdfFile size 660 kBChecksum SHA-512
ce5d1238c5bc2361786a480815adf4c43da577e06bb4b3c7426abcdba2e4398110692605948e084fdbf8c2e8bf2f70a72abb74e06dedf32958deabe491e30206
Type fulltextMimetype application/pdf

Other links

Publisher's full textPubMedScopus

Authority records

Hintze, ArendMehra, Priyanka

Search in DiVA

By author/editor
Hintze, ArendMehra, Priyanka
By organisation
School of Information and EngineeringMicrodata Analysis
In the same journal
Entropy
Computer and Information Sciences

Search outside of DiVA

GoogleGoogle Scholar
Total: 67 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
pubmed
urn-nbn

Altmetric score

doi
pubmed
urn-nbn
Total: 146 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • chicago-author-date
  • chicago-note-bibliography
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf