Brain MRI and CT Image Fusion Using Multiscale Local Extrema and Image Statistics
Main Article Content
Abstract
In medical applications such as radiotherapy and guided-image surgery, data fusion for diagnostic imaging has emerged as a critical issue. Because the objective of medical image fusion is to improve patient diagnosis accuracy, the fused image is created by preserving the source images' prominent details and features. It has been demonstrated that the Multi-Level Local Extrema representation has numerous advantages over traditional image modeling approaches. We propose an innovative MLE-based fusion method for multimodal medical images in this paper. In the MLE schema, the proposed algorithm decomposes source images into coarse and detailed layers, then fuses the source images using weights calculated from these detail images using image statistics. We visually and quantitatively compared the efficacy of the suggested approach to that of existing methods using five different types of medical images from various sources. The experimental results showed that the proposed scheme outperforms other current typical schemes in terms of both qualitative image quality and objective evaluation.
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
This journal provides immediate open access to its content on the principle that making research freely available to the public supports a greater global exchange of knowledge.
- Creative Commons Copyright License
The journal allows readers to download and share all published articles as long as they properly cite such articles; however, they cannot change them or use them commercially. This is classified as CC BY-NC-ND for the creative commons license.
- Retention of Copyright and Publishing Rights
The journal allows the authors of the published articles to hold copyrights and publishing rights without restrictions.
References
Y Liu, X Chen, J Cheng et al. A medical image fusion method based on convolutional neural networks, International Conference on Information Fusion. IEEE, 1–7(2017)
Gaurav BhatnagarQM,Wu J, Liu Z (2013)Directive contrast based multimodal medical image fusion in NSCT domain. IEEE TransMultimedia 15(5):1014–1024
Liu X, Mei W, Du H (2017) Structure tensor and nonsubsampled shearlet transform based algorithm for CT and MRI image
fusion.Neurocomputing 235:131–139
Vijayarajan R, Muttan S (2015) Discrete wavelet transform based principal component averaging fusion for medical images. AEU-Int J Electron C 69(6):896–902
Toet A (1989) Image fusion by a ratio of low-pass pyramid. Pattern Recogn Lett 9(4):245–253
Do Minh N, Vetterli M (2005) The contourlet transform: an efficient directional multiresolution image representation. IEEE Trans Image Process 14(12):2091–2106
Da Cunha AL, Zhou J, Do MN (2006) The nonsubsampled contourlet transform: theory, design, and applications. IEEE TransImage Process 15(10):3089–3101
Zhang T, Zhou Q, Feng H et al (2007) Fusion of infrared and visible light images based on nonsubsampled shearlet transform. Int J Infrared Millimeter Waves 26(6):476–480.
Z. Zhang, S.H. Sun, F. Zheng, Image fusion based on median filters and SOFM neural networks: a three-step scheme, Signal Processing 81 (6) (2001) 1325–1330.
Z. Wang, Y. Ma, Medical image fusion using m-PCNN, Information Fusion 9 (2) (2008) 176–185.
Z. Wang, Y. Ma, J. Gu, Multi-focus image fusion using PCNN, Pattern Recognition 43 (6) (2010) 2003–2016.
Y. Chai, H.F. Li, J.F. Qu, Image fusion scheme using a novel dual-channel PCNN in lifting stationary wavelet domain, Optics Communications 283 (19) (2010) 3591–3602.
K. Subr, C. Soler, F. Durand, Edge-preserving multiscale image decomposition based on local extrema, ACM Transactions on Graphics 28 (5) (2009) 147:1–147:9.
Hossny M, Nahavandi S, Creighton D (2008) Comments on BInformation measure for performance of image fusion^. Electron Lett 44(18):1066–1067
Jin X, Nie RC, ZhouDMet al (2016) Multifocus color image fusion based on NSST and PCNN. J Sens 8359602. https://doi.org/10.1155/2016/8359602.
Wang Z, Bovik AC, Sheikh HR et al (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13(4):600–612
Vladimir P, Costas X (2004) Evaluation of image fusion performance with visible differences. 8th European Conference onComputer Vision, ECCV 2004, Lecture Notes in Computer Science, 3023: 380–391.
L. Wang, B. Li, L. Tian, Multi-modal medical image fusion using the inter-scale and intra-scale dependencies between image shift-invariant Shearlet coefficients, Information Fusion 19 (2014) 20–28.
C. Xydeas, V. Petrovic, Objective image fusion performance measure, Electronics Letters 36 (4) (2000) 308–309.
Z. Wang, A. Bovik, H. Sheikh, E. Simoncelli, Image quality assessment: from error visibility to structural similarity,IEEE Transactions on Image Processing 13 (4) (2004) 600–612.
Zhiping Xu,(2014)Medical image fusion using multi-level local extrema, Information Fusion Volume 19, September 2014, Pages 38-48.