Do it the transformer way: A comprehensive review of brain and vision transformers for autism spectrum disorder diagnosis and classification
- PMID: 37939407
- DOI: 10.1016/j.compbiomed.2023.107667
Do it the transformer way: A comprehensive review of brain and vision transformers for autism spectrum disorder diagnosis and classification
Abstract
Autism spectrum disorder (ASD) is a condition observed in children who display abnormal patterns of interaction, behavior, and communication with others. Despite extensive research efforts, the underlying causes of this neurodevelopmental disorder and its biomarkers remain unknown. However, advancements in artificial intelligence and machine learning have improved clinicians' ability to diagnose ASD. This review paper investigates various MRI modalities to identify distinct features that characterize individuals with ASD compared to typical control subjects. The review then moves on to explore deep learning models for ASD diagnosis, including convolutional neural networks (CNNs), autoencoders, graph convolutions, attention networks, and other models. CNNs and their variations are particularly effective due to their capacity to learn structured image representations and identify reliable biomarkers for brain disorders. Computer vision transformers often employ CNN architectures with transfer learning techniques like fine-tuning and layer freezing to enhance image classification performance, surpassing traditional machine learning models. This review paper contributes in three main ways. Firstly, it provides a comprehensive overview of a recommended architecture for using vision transformers in the systematic ASD diagnostic process. To this end, the paper investigates various pre-trained vision architectures such as VGG, ResNet, Inception, InceptionResNet, DenseNet, and Swin models that were fine-tuned for ASD diagnosis and classification. Secondly, it discusses the vision transformers of 2020th like BiT, ViT, MobileViT, and ConvNeXt, and applying transfer learning methods in relation to their prospective practicality in ASD classification. Thirdly, it explores brain transformers that are pre-trained on medically rich data and MRI neuroimaging datasets. The paper recommends a systematic architecture for ASD diagnosis using brain transformers. It also reviews recently developed brain transformer-based models, such as METAFormer, Com-BrainTF, Brain Network, ST-Transformer, STCAL, BolT, and BrainFormer, discussing their deep transfer learning architectures and results in ASD detection. Additionally, the paper summarizes and discusses brain-related transformers for various brain disorders, such as MSGTN, STAGIN, and MedTransformer, in relation to their potential usefulness in ASD. The study suggests that developing specialized transformer-based models, following the success of natural language processing (NLP), can offer new directions for image classification problems in ASD brain biomarkers learning and classification. By incorporating the attention mechanism, treating MRI modalities as sequence prediction tasks trained on brain disorder classification problems, and fine-tuned on ASD datasets, brain transformers can show a great promise in ASD diagnosis.
Keywords: ASD; Autism spectrum disorder; Brain transformers; Classification; Deep learning; MRI; Neuroimaging; Transfer learning; Vision transformers; fMRI; sMRI.
Copyright © 2023 Elsevier Ltd. All rights reserved.
Conflict of interest statement
Declaration of competing interest The author declares that they have no known conflict of interests, and no competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
Similar articles
-
Multi-Slice Generation sMRI and fMRI for Autism Spectrum Disorder Diagnosis Using 3D-CNN and Vision Transformers.Brain Sci. 2023 Nov 10;13(11):1578. doi: 10.3390/brainsci13111578. Brain Sci. 2023. PMID: 38002538 Free PMC article.
-
Analyzing Transfer Learning of Vision Transformers for Interpreting Chest Radiography.J Digit Imaging. 2022 Dec;35(6):1445-1462. doi: 10.1007/s10278-022-00666-z. Epub 2022 Jul 11. J Digit Imaging. 2022. PMID: 35819537 Free PMC article.
-
Classification of Mobile-Based Oral Cancer Images Using the Vision Transformer and the Swin Transformer.Cancers (Basel). 2024 Feb 29;16(5):987. doi: 10.3390/cancers16050987. Cancers (Basel). 2024. PMID: 38473348 Free PMC article.
-
Brain imaging-based machine learning in autism spectrum disorder: methods and applications.J Neurosci Methods. 2021 Sep 1;361:109271. doi: 10.1016/j.jneumeth.2021.109271. Epub 2021 Jun 24. J Neurosci Methods. 2021. PMID: 34174282 Free PMC article. Review.
-
Ultrasound Image Analysis with Vision Transformers-Review.Diagnostics (Basel). 2024 Mar 4;14(5):542. doi: 10.3390/diagnostics14050542. Diagnostics (Basel). 2024. PMID: 38473014 Free PMC article. Review.
Publication types
MeSH terms
Substances
LinkOut - more resources
Full Text Sources
Medical