Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
Review
. 2020 Apr 23:2020:8279342.
doi: 10.1155/2020/8279342. eCollection 2020.

A Review of Multimodal Medical Image Fusion Techniques

Bing Huang  1 , Feng Yang  1   2 , Mengxiao Yin  1   2 , Xiaoying Mo  1 , Cheng Zhong  1   2
Affiliations
Review

A Review of Multimodal Medical Image Fusion Techniques

Bing Huang et al. Comput Math Methods Med. .

Abstract

The medical image fusion is the process of coalescing multiple images from multiple imaging modalities to obtain a fused image with a large amount of information for increasing the clinical applicability of medical images. In this paper, we attempt to give an overview of multimodal medical image fusion methods, putting emphasis on the most recent advances in the domain based on (1) the current fusion methods, including based on deep learning, (2) imaging modalities of medical image fusion, and (3) performance analysis of medical image fusion on mainly data set. Finally, the conclusion of this paper is that the current multimodal medical image fusion research results are more significant and the development trend is on the rise but with many challenges in the research field.

PubMed Disclaimer

Conflict of interest statement

The authors declare that they have no conflicts of interest.

Figures

Figure 1
Figure 1
Number of published papers with of medical image fusion.
Figure 2
Figure 2
Framework diagram based on the IHS domain fusion method.
Figure 3
Figure 3
Framework diagram based on the NSCT domain fusion method.
Figure 4
Figure 4
NSST diagram.
Figure 5
Figure 5
Block diagram based on the NSCT fusion method.
Figure 6
Figure 6
Schematic diagram based on CNN fusion algorithm.
Figure 7
Figure 7
MRI/PET fusion research trend chart.
Figure 8
Figure 8
MRI/CT fusion research trend chart.
Figure 9
Figure 9
MRI/SPECT fusion study trend chart.
Figure 10
Figure 10
Examples of MRI-CT medical image fusion, a(1) and a(2) are CT and MRI source images, respectively. a(3)~a(13) are the fused images of GFF [81], MSA [82], NSCT+SR [83], NSCT+PCNN [84], NSCT+LE [85], NSCT+RPCNN [86], NSST+PAPCNN [26], DWT [87], DWT+WA [88], U-Net [65], and CNN [57], respectively.
Figure 11
Figure 11
Examples of MRI-PET medical image fusion, b(1) and b(2) are MRI and PET source images, respectively. b(3)~b(7) are the fused images of GFF [81], MSA [82], NSCT+LE [85], NSST+PAPCNN [26], and ESF+CSF [78], respectively.
See this image and copyright information in PMC

Similar articles

See all similar articles

Cited by

See all "Cited by" articles

References

    1. Meher B., Agrawal S., Panda R., Abraham A. A survey on region based image fusion methods. Information Fusion. 2019;48:119–132. doi: 10.1016/j.inffus.2018.07.010. - DOI
    1. James A. P., Dasarathy B. V. Medical image fusion: a survey of the state of the art. Information Fusion. 2014;19:4–19. doi: 10.1016/j.inffus.2013.12.002. - DOI
    1. Venkatrao P. H., Damodar S. S. HWFusion: holoentropy and SP-whale optimisation-based fusion model for magnetic resonance imaging multimodal image fusion. IET Image Processing. 2018;12(4):572–581. doi: 10.1049/iet-ipr.2017.0573. - DOI
    1. Zhao W., Lu H. Medical image fusion and denoising with alternating sequential filter and adaptive fractional order total variation. IEEE Transactions on Instrumentation and Measurement. 2017;66(9):2283–2294. doi: 10.1109/TIM.2017.2700198. - DOI
    1. Iqbal N., Saleem S., Jehan W. S., Ahmad K. Reduction of speckle noise in medical images using stationary wavelet transform and fuzzy logic. 2017 International Symposium on Recent Advances in Electrical Engineering (RAEE); October 2017; Islamabad, Pakistan. - DOI

MeSH terms

LinkOut - more resources