NeuroX Library for Neuron Analysis of Deep NLP Models

Fahlin Daiv; Hassan Sajjad; Nadir Durrani

doi:10.18653/v1/2023.acl-demo.21

NeuroX Library for Neuron Analysis of Deep NLP Models

Fahlin Daiv, Hassan Sajjad, Nadir Durrani

Qatar Computing Research Institute

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

5 Citations (Scopus)

Abstract

Neuron analysis provides insights into how knowledge is structured in representations and discovers the role of neurons in the network, in addition to developing an understanding of our models, neuron analysis enables various applications such as debiasing, domain adaptation and architectural search. We present NeuroX, a comprehensive open -source toolkit to conduct neuron analysis of natural language processing models. It implements various interpretation methods under a unified API, and provides a framework for data processing and evaluation, thus making it easier for researchers and practitioners to perform neuron analysis. The Python toolkit is available at https: //ww, github. com/fdalvi iNeuroX.

Original language	English
Title of host publication	Proceedings Of The 61st Annual Meeting Of The Association For Computational Linguistics, Acl-demo 2023, Vol 3
Editors	D Bollegala, R Huang, A Ritter
Publisher	Assoc Computational Linguistics-Acl
Pages	226-234
Number of pages	9
ISBN (Electronic)	978-1-959429-70-8
DOIs	https://doi.org/10.18653/v1/2023.acl-demo.21
Publication status	Published - 2023
Event	61st Annual Meeting of the Association-for-Computational-Linguistics - System Demonstrations (ACL-DEMO) - Toronto, Canada Duration: 9 Jul 2023 → 14 Jul 2023

Publication series

Name	Proceedings of the Annual Meeting of the Association for Computational Linguistics
Volume	3
ISSN (Print)	0736-587X

Conference

Conference	61st Annual Meeting of the Association-for-Computational-Linguistics - System Demonstrations (ACL-DEMO)
Country/Territory	Canada
City	Toronto
Period	9/07/23 → 14/07/23

Access to Document

10.18653/v1/2023.acl-demo.21

Cite this

Daiv, F., Sajjad, H., & Durrani, N. (2023). NeuroX Library for Neuron Analysis of Deep NLP Models. In D. Bollegala, R. Huang, & A. Ritter (Eds.), Proceedings Of The 61st Annual Meeting Of The Association For Computational Linguistics, Acl-demo 2023, Vol 3 (pp. 226-234). (Proceedings of the Annual Meeting of the Association for Computational Linguistics; Vol. 3). Assoc Computational Linguistics-Acl. https://doi.org/10.18653/v1/2023.acl-demo.21

Daiv, Fahlin ; Sajjad, Hassan ; Durrani, Nadir. / NeuroX Library for Neuron Analysis of Deep NLP Models. Proceedings Of The 61st Annual Meeting Of The Association For Computational Linguistics, Acl-demo 2023, Vol 3. editor / D Bollegala ; R Huang ; A Ritter. Assoc Computational Linguistics-Acl, 2023. pp. 226-234 (Proceedings of the Annual Meeting of the Association for Computational Linguistics).

@inproceedings{ace632c137f54e1b9cf8fa202415a252,

title = "NeuroX Library for Neuron Analysis of Deep NLP Models",

abstract = "Neuron analysis provides insights into how knowledge is structured in representations and discovers the role of neurons in the network, in addition to developing an understanding of our models, neuron analysis enables various applications such as debiasing, domain adaptation and architectural search. We present NeuroX, a comprehensive open -source toolkit to conduct neuron analysis of natural language processing models. It implements various interpretation methods under a unified API, and provides a framework for data processing and evaluation, thus making it easier for researchers and practitioners to perform neuron analysis. The Python toolkit is available at https: //ww, github. com/fdalvi iNeuroX.",

author = "Fahlin Daiv and Hassan Sajjad and Nadir Durrani",

note = "Publisher Copyright: {\textcopyright} ACL-DEMO 2023. All rights reserved.; 61st Annual Meeting of the Association-for-Computational-Linguistics - System Demonstrations (ACL-DEMO) ; Conference date: 09-07-2023 Through 14-07-2023",

year = "2023",

doi = "10.18653/v1/2023.acl-demo.21",

language = "English",

series = "Proceedings of the Annual Meeting of the Association for Computational Linguistics",

publisher = "Assoc Computational Linguistics-Acl",

pages = "226--234",

editor = "D Bollegala and R Huang and A Ritter",

booktitle = "Proceedings Of The 61st Annual Meeting Of The Association For Computational Linguistics, Acl-demo 2023, Vol 3",

}

Daiv, F, Sajjad, H & Durrani, N 2023, NeuroX Library for Neuron Analysis of Deep NLP Models. in D Bollegala, R Huang & A Ritter (eds), Proceedings Of The 61st Annual Meeting Of The Association For Computational Linguistics, Acl-demo 2023, Vol 3. Proceedings of the Annual Meeting of the Association for Computational Linguistics, vol. 3, Assoc Computational Linguistics-Acl, pp. 226-234, 61st Annual Meeting of the Association-for-Computational-Linguistics - System Demonstrations (ACL-DEMO), Toronto, Canada, 9/07/23. https://doi.org/10.18653/v1/2023.acl-demo.21

NeuroX Library for Neuron Analysis of Deep NLP Models. / Daiv, Fahlin; Sajjad, Hassan; Durrani, Nadir.
Proceedings Of The 61st Annual Meeting Of The Association For Computational Linguistics, Acl-demo 2023, Vol 3. ed. / D Bollegala; R Huang; A Ritter. Assoc Computational Linguistics-Acl, 2023. p. 226-234 (Proceedings of the Annual Meeting of the Association for Computational Linguistics; Vol. 3).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - NeuroX Library for Neuron Analysis of Deep NLP Models

AU - Daiv, Fahlin

AU - Sajjad, Hassan

AU - Durrani, Nadir

PY - 2023

Y1 - 2023

N2 - Neuron analysis provides insights into how knowledge is structured in representations and discovers the role of neurons in the network, in addition to developing an understanding of our models, neuron analysis enables various applications such as debiasing, domain adaptation and architectural search. We present NeuroX, a comprehensive open -source toolkit to conduct neuron analysis of natural language processing models. It implements various interpretation methods under a unified API, and provides a framework for data processing and evaluation, thus making it easier for researchers and practitioners to perform neuron analysis. The Python toolkit is available at https: //ww, github. com/fdalvi iNeuroX.

AB - Neuron analysis provides insights into how knowledge is structured in representations and discovers the role of neurons in the network, in addition to developing an understanding of our models, neuron analysis enables various applications such as debiasing, domain adaptation and architectural search. We present NeuroX, a comprehensive open -source toolkit to conduct neuron analysis of natural language processing models. It implements various interpretation methods under a unified API, and provides a framework for data processing and evaluation, thus making it easier for researchers and practitioners to perform neuron analysis. The Python toolkit is available at https: //ww, github. com/fdalvi iNeuroX.

UR - https://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=hbku_researchportal&SrcAuth=WosAPI&KeyUT=WOS:001181040500021&DestLinkType=FullRecord&DestApp=WOS_CPL

U2 - 10.18653/v1/2023.acl-demo.21

DO - 10.18653/v1/2023.acl-demo.21

M3 - Conference contribution

T3 - Proceedings of the Annual Meeting of the Association for Computational Linguistics

SP - 226

EP - 234

BT - Proceedings Of The 61st Annual Meeting Of The Association For Computational Linguistics, Acl-demo 2023, Vol 3

A2 - Bollegala, D

A2 - Huang, R

A2 - Ritter, A

PB - Assoc Computational Linguistics-Acl

T2 - 61st Annual Meeting of the Association-for-Computational-Linguistics - System Demonstrations (ACL-DEMO)

Y2 - 9 July 2023 through 14 July 2023

ER -

Daiv F, Sajjad H, Durrani N. NeuroX Library for Neuron Analysis of Deep NLP Models. In Bollegala D, Huang R, Ritter A, editors, Proceedings Of The 61st Annual Meeting Of The Association For Computational Linguistics, Acl-demo 2023, Vol 3. Assoc Computational Linguistics-Acl. 2023. p. 226-234. (Proceedings of the Annual Meeting of the Association for Computational Linguistics). doi: 10.18653/v1/2023.acl-demo.21

NeuroX Library for Neuron Analysis of Deep NLP Models

Abstract

Publication series

Conference

Access to Document

Other files and links

Fingerprint

Cite this