Interpretation of 3D CNNs for Brain MRI Data Classification

Maxim Kan1Ruslan Aliev1Anna Rudenko1Nikita Drobyshev1Nikita Petrashen1Ekaterina Kondrateva1Maxim Sharaev1Alexander Bernstein1Evgeny Burnaev1

Skolkovo Institute of Science and Technology

The 9th International Conference on Analysis of Images, Social Networks and Texts (AIST2020)


Deep learning shows high potential for many medical image analysis tasks. Neural networks can work with full-size data without extensive preprocessing and feature generation and, thus, information loss. Recent work has shown that the morphological difference in specific brain regions can be found on MRI with the means of Convolution Neural Networks (CNN). However, interpretation of the existing models is based on a region of interest and can not be extended to voxel-wise image interpretation on a whole image. In the current work, we consider the classification task on a large-scale open-source dataset of young healthy subjects — an exploration of brain differences between men and women. In this paper, we extend the previous findings in gender differences from diffusion-tensor imaging on T1 brain MRI scans. We provide the voxel-wise 3D CNN interpretation comparing the results of three interpretation methods: Meaningful Perturbations, Grad CAM and Guided Backpropagation, and contribute with the open-source library.




Copy bibtex


If you have any questions about this work, please contact us under