Abstract
There will be an unprecedented increase in the number of galaxies observed as a result of the current and upcoming surveys. Consequently, data-driven approaches have become the main tools for deciphering and evaluating this massive volume of data. Computer vision combined with deep learning has proven most effective for recognizing galaxy morphology but most of the conventional deep learning models are large in terms of parameters due to which computational cost, risk of overfitting increases. In this paper, we proposed a lightweight convolutional neural network (CNN) model using separable convolution which helps to reduce trainable parameters of the model. Further, Efficient Channel Attention (ECA) mechanism is used to focus on important features. ECA focuses on features channel wise without dimensionality reduction which reduces the computational overhead. Performance of proposed model named as “DIAT-DSCNN-ECA-Net” is evaluated on two datasets such as Galaxy Zoo 2, Galaxy Zoo DECaLS, each having seven different types of galaxies, achieved an accuracy of 90.81% and 94.17% respectively at the cost of 1.8 Mega-Byte model size, 0.13 million parameters, 1.04 Floating Point Operations (FLOPs). The outcomes of the experiments demonstrate that the proposed approach can outperform the existing CNN models.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Data Availability
No datasets were generated or analysed during the current study.
References
Banerji, M., Lahav, O., Lintott, C.J., Abdalla, F.B., Schawinski, K., Bamford, S.P., Andreescu, D., Murray, P., Raddick, M.J., Slosar, A., Szalay, A., Thomas, D., Vandenberg, J.: Galaxy Zoo: reproducing galaxy morphologies via machine learning. Mon. Not. R. Astron. Soc. 406(1), 342–353 (2010). https://doi.org/10.1111/j.1365-2966.2010.16713.x
Bazell, D., Aha, D.W.: Ensembles of classifiers for morphological galaxy classification. Astrophys. J. 548(1), 219 (2001). https://doi.org/10.1086/318696
Bengio, Y., Courville, A., Vincent, P.: Representation learning: a review and new perspectives. IEEE Trans. Pattern Anal. Mach. Intell. 35(8), 1798–1828 (2013). https://doi.org/10.1109/TPAMI.2013.50
Cheng, T.Y., Conselice, C.J., Aragón-Salamanca, A., Li, N., Bluck, A.F., Hartley, W.G., Annis, J., Brooks, D., Doel, P., García-Bellido, J., et al.: Optimizing automatic morphological classification of galaxies with machine learning and deep learning using dark energy survey imaging. Mon. Not. R. Astron. Soc. 493(3), 4209–4228 (2020)
Cheng, T.Y., Conselice, C.J., Aragón-Salamanca, A., Aguena, M., Allam, S., Andrade-Oliveira, F., Annis, J., Bluck, A., Brooks, D., Burke, D.L., et al.: Galaxy morphological classification catalogue of the dark energy survey year 3 data with convolutional neural networks. Mon. Not. R. Astron. Soc. 507(3), 4425–4444 (2021)
Chollet, F.: Xception: deep learning with depthwise separable convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1251–1258 (2017)
De la Calleja, J., Fuentes, O.: Machine learning and image analysis for morphological galaxy classification. Mon. Not. R. Astron. Soc. 349(1), 87–93 (2004). https://doi.org/10.1111/j.1365-2966.2004.07442.x
Dieleman, S., Willett, K.W., Dambre, J.: Rotation-invariant convolutional neural networks for galaxy morphology prediction. Mon. Not. R. Astron. Soc. 450(2), 1441–1459 (2015). https://doi.org/10.1093/mnras/stv632. https://academic.oup.com/mnras/article-pdf/450/2/1441/3022697/stv632.pdf
Domínguez Sánchez, H., Huertas-Company, M., Bernardi, M., Tuccillo, D., Fischer, J.L.: Improving galaxy morphologies for SDSS with deep learning. Mon. Not. R. Astron. Soc. 476(3), 3661–3676 (2018). https://doi.org/10.1093/mnras/sty338. https://academic.oup.com/mnras/article-pdf/476/3/3661/33776276/sty338.pdf
Ferrari, F., de Carvalho, R.R., Trevisan, M.: Morfometryka—a new way of establishing morphological classification of galaxies. Astrophys. J. 814(1), 55 (2015). https://doi.org/10.1088/0004-637X/814/1/55
Gauci, A., Adami, K.Z., Abela, J.: Machine learning for galaxy morphology classification (2010). ArXiv preprint arXiv:1005.0390
Gupta, R., Srijith, P., Desai, S.: Galaxy morphology classification using neural ordinary differential equations. Astron. Comput. 38, 100543 (2022)
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 770–778. IEEE, Los Alamitos (2015a)
He, K., Zhang, X., Ren, S., Sun, J.: Delving deep into rectifiers: surpassing human-level performance on imagenet classification. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 1026–1034. IEEE, Los Alamitos (2015b)
Howard, A.G., Sandler, M., Chu, G., Chen, L.C., Chen, B., Tan, M., Wang, W., Zhu, Y., Pang, R., Vasudevan, V., Le, Q.V., Adam, H.: Searching for mobilenetv3. In: 2019 IEEE/CVF International Conference on Computer Vision (ICCV), pp. 1314–1324 (2019)
Hu, J., Shen, L., Albanie, S., Sun, G., Wu, E.: Squeeze-and-excitation networks. In: 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 7132–7141 (2017)
Huang, G., Liu, Z., Van Der Maaten, L., Weinberger, K.Q.: Densely connected convolutional networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4700–4708 (2017)
Hubble, E.: Astrophys. J. 64 (1926)
Huertas-Company, M., Aguerri, J., Bernardi, M., Mei, S., Sánchez Almeida, J.: Revisiting the Hubble sequence in the SDSS DR7 spectroscopic sample: a publicly available Bayesian automated classification. A&A 525, A157 (2011). https://doi.org/10.1051/0004-6361/201015735. arXiv:1010.3018 [astro-ph.CO]
Jr, T.A.: Efficient deep learning for real-time classification of astronomical transients (2023). PhD diss., UCL (University College London)
Kalvankar, S., Pandit, H., Parwate, P.: Galaxy morphology classification using efficientnet architectures (2020). ArXiv preprint arXiv:2008.13611
LeCun, Y., Bengio, Y., Hinton, G.: Deep learning. Nature 521(7553), 436 (2015)
Li, Z., Liu, F., Yang, W., Peng, S., Zhou, J.: A survey of convolutional neural networks: analysis, applications, and prospects. In: IEEE Transactions on Neural Networks and Learning Systems (2021)
Lintott, C.J., Schawinski, K., Slosar, A., Land, K., Bamford, S., Thomas, D., Raddick, M.J., Nichol, R.C., Szalay, A., Andreescu, D., Murray, P., Vandenberg, J.: Galaxy Zoo: morphologies derived from visual inspection of galaxies from the sloan digital sky survey. Mon. Not. R. Astron. Soc. 389(3), 1179–1189 (2008)
Lintott, C., Schawinski, K., Bamford, S., Slosar, A., Land, K., Thomas, D., Edmondson, E., Masters, K., Nichol, R.C., Raddick, M.J., Szalay, A., Andreescu, D., Murray, P., Vandenberg, J.: Galaxy Zoo 1: data release of morphological classifications for nearly 900,000 galaxies. Mon. Not. R. Astron. Soc. 410(1), 166–178 (2010)
Naim, A., Lahav, O., Sodre, L. Jr., Storrie-Lombardi, M.: Automated morphological classification of APM galaxies by supervised artificial neural networks. Mon. Not. R. Astron. Soc. 275(3), 567–590 (1995). https://doi.org/10.1093/mnras/275.3.567 arXiv:astro-ph/9503001 [astro-ph]
Orlov, N., Shamir, L., Macura, T., Johnston, J., Eckley, D.M., Goldberg, I.G.: Wnd-charm: multi-purpose image classification using compound image transforms. Pattern Recognit. Lett. 29(11), 1684–1693 (2008). https://doi.org/10.1016/j.patrec.2008.04.013
Owens, E.A., Griffiths, R.E., Ratnatunga, K.U.: Using oblique decision trees for the morphological classification of galaxies. Mon. Not. R. Astron. Soc. 281(1), 153–157 (1996). https://doi.org/10.1093/mnras/281.1.153
Polsterer, K., Gieseke, F., Kramer, O.: Galaxy classification without feature extraction. In: Ballester, P., Egret, D., Lorente, N. (eds.) Astronomical Data Analysis Software and Systems XXI. Astronomical Society of the Pacific Conference Series, vol. 461, p. 561 (2012)
San-Martín-Jiménez, A.E., Pichara, K., Barrientos, L.F., Rojas, F., Moya-Sierralta, C.: Depthwise convolutional neural network for multiband automatic quasars classification in ATLAS. Mon. Not. R. Astron. Soc. 524(4), 5080–5095 (2023). https://doi.org/10.1093/mnras/stad1859. https://academic.oup.com/mnras/article-pdf/524/4/5080/51017072/stad1859.pdf
Sandage, A.: Annu. Rev. Astron. Astrophys. 43, 581 (2005)
Sandler, M., Howard, A.G., Zhu, M., Zhmoginov, A., Chen, L.C.: Mobilenetv2: inverted residuals and linear bottlenecks. In: 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 4510–4520 (2018)
Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition (2014). arXiv:1409.1556. CoRR
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., Wojna, Z.: Rethinking the inception architecture for computer vision. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2818–2826 (2015)
Tan, M., Le, Q.V.: Efficientnet: Rethinking model scaling for convolutional neural networks (2019). arXiv:1905.11946
Tran, D., Bourdev, L.D., Fergus, R., Torresani, L., Paluri, M.: Learning spatiotemporal features with 3d convolutional networks. In: 2015 IEEE International Conference on Computer Vision (ICCV), pp. 4489–4497 (2014)
Vega-Ferrero, J., Domínguez Sánchez, H., Bernardi, M., Huertas-Company, M., Morgan, R., Margalef, B., Aguena, M., Allam, S., Annis, J., Avila, S., et al.: Pushing automated morphological classifications to their limits with the dark energy survey. Mon. Not. R. Astron. Soc. 506(2), 1927–1943 (2021)
Vidaurre, D., Bielza, C., Larranaga, P.: A survey of l1 regression. Int. Stat. Rev. 81(3), 361–387 (2013)
Walmsley, M., Lintott, C., Geron, T., Kruk, S., Krawczyk, C., Willett, K.W., Bamford, S., Kelvin, L.S., Fortson, L., Gal, Y., Keel, W., Masters, K.L., Mehta, V., Simmons, B.D., Smethurst, R., Smith, L., Baeten, E.M., Macmillan, C.: Galaxy Zoo DECaLS: detailed visual morphology measurements from volunteers and deep learning for 314000 galaxies. Mon. Not. R. Astron. Soc. 509(3), 3966–3988 (2021)
Wang, M., Zhang, X., Niu, X., Wang, F., Zhang, X.: Scene classification of high-resolution remotely sensed image based on resnet. J. Geovisualization Spatial Anal. 3, 1–9 (2019)
Wang, Q., Wu, B., Zhu, P., Li, P., Zuo, W., Hu, Q.: Eca-net: efficient channel attention for deep convolutional neural networks. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 11534–11542 (2020)
Wei, S., Lu, W., Dai, W., Liang, B., Hao, L., Zhang, Z., Zhang, X.: Galaxy morphological classification of the legacy surveys with deformable convolutional neural networks. Astron. J. 167(1), 29 (2023)
Willett, K.W., Lintott, C.J., Bamford, S., Masters, K.L., Simmons, B.D., Casteels, K.R.V., Edmondson, E.M., Fortson, L., Kaviraj, S., Keel, W.C., Melvin, T.R.O., Nichol, R.C., Raddick, M.J., Schawinski, K., Simpson, R.J., Skibba, R.A., Smith, A.M., D.T.U. of Minnesota, U. of Oxford, A. Planetarium, U. of Nottingham, U. of Portsmouth, SepNet, U.A. de Barcelona, U. of Hertfordshire, U. of South Alabama, J.H. University, E. Zurich, U. of California at San Diego: Galaxy Zoo 2: detailed morphological classifications for 304,122 galaxies from the sloan digital sky survey. Mon. Not. R. Astron. Soc. 435, 2835–2860 (2013)
Woo, S., Park, J., Lee, J.Y., Kweon, I.S.: Cbam: convolutional block attention module (2018). arXiv:1807.06521
Wu, D.D., Zhang, J., Li, X., Li, H.: A lightweight deep learning framework for galaxy morphology classification. Res. Astron. Astrophys. 22 (2022)
Zhu, X.P., Dai, J.M., Bian, C.J., Chen, Y., Chen, S., Hu, C.: Galaxy morphology classification with deep convolutional neural networks. Astrophys. Space Sci. 364(4), 55 (2019). https://doi.org/10.1007/s10509-019-3540-1. arXiv:1807.10406 [astro-ph.GA]
Zhu, X., Hu, H., Lin, S., Dai, J.: Deformable convnets v2: more deformable, better results. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 9308–9316 (2019)
Zou, H., Zhou, X., Fan, X., Zhang, T., Zhou, Z., Nie, J., Peng, X., McGreer, I., Jiang, L., Dey, A., et al.: Project overview of the Beijing–Arizona sky survey. Publ. Astron. Soc. Pac. 129(976), 064101 (2017)
Author information
Authors and Affiliations
Contributions
Proposed a lightweight CNN model using separable convolution with ECA attention mechanism which helps model to focus on important features channel wise, which do not perform dimensionality reduction because of that computational overhead reduces.
Corresponding author
Ethics declarations
Compliance With Ethical Standards
The research and analysis conducted by the authors are fully and accurately reflected in the paper. Nowhere is this work being considered for publication.
Competing interests
The authors declare no competing interests.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Waghumbare, A., Singh, U. & Kasera, S. DIAT-DSCNN-ECA-Net: separable convolutional neural network-based classification of galaxy morphology. Astrophys Space Sci 369, 38 (2024). https://doi.org/10.1007/s10509-024-04302-w
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10509-024-04302-w