-
Morphological Classification of Radio Galaxies with wGAN-supported Augmentation
Authors:
Lennart Rustige,
Janis Kummer,
Florian Griese,
Kerstin Borras,
Marcus Brüggen,
Patrick L. S. Connor,
Frank Gaede,
Gregor Kasieczka,
Tobias Knopp,
Peter Schleper
Abstract:
Machine learning techniques that perform morphological classification of astronomical sources often suffer from a scarcity of labelled training data. Here, we focus on the case of supervised deep learning models for the morphological classification of radio galaxies, which is particularly topical for the forthcoming large radio surveys. We demonstrate the use of generative models, specifically Was…
▽ More
Machine learning techniques that perform morphological classification of astronomical sources often suffer from a scarcity of labelled training data. Here, we focus on the case of supervised deep learning models for the morphological classification of radio galaxies, which is particularly topical for the forthcoming large radio surveys. We demonstrate the use of generative models, specifically Wasserstein GANs (wGANs), to generate data for different classes of radio galaxies. Further, we study the impact of augmenting the training data with images from our wGAN on three different classification architectures. We find that this technique makes it possible to improve models for the morphological classification of radio galaxies. A simple Fully Connected Neural Network (FCN) benefits most from including generated images into the training set, with a considerable improvement of its classification accuracy. In addition, we find it is more difficult to improve complex classifiers. The classification performance of a Convolutional Neural Network (CNN) can be improved slightly. However, this is not the case for a Vision Transformer (ViT).
△ Less
Submitted 14 June, 2023; v1 submitted 16 December, 2022;
originally announced December 2022.
-
Radio Galaxy Classification with wGAN-Supported Augmentation
Authors:
Janis Kummer,
Lennart Rustige,
Florian Griese,
Kerstin Borras,
Marcus Brüggen,
Patrick L. S. Connor,
Frank Gaede,
Gregor Kasieczka,
Peter Schleper
Abstract:
Novel techniques are indispensable to process the flood of data from the new generation of radio telescopes. In particular, the classification of astronomical sources in images is challenging. Morphological classification of radio galaxies could be automated with deep learning models that require large sets of labelled training data. Here, we demonstrate the use of generative models, specifically…
▽ More
Novel techniques are indispensable to process the flood of data from the new generation of radio telescopes. In particular, the classification of astronomical sources in images is challenging. Morphological classification of radio galaxies could be automated with deep learning models that require large sets of labelled training data. Here, we demonstrate the use of generative models, specifically Wasserstein GANs (wGAN), to generate artificial data for different classes of radio galaxies. Subsequently, we augment the training data with images from our wGAN. We find that a simple fully-connected neural network for classification can be improved significantly by including generated images into the training set.
△ Less
Submitted 7 October, 2022; v1 submitted 30 June, 2022;
originally announced June 2022.
-
Shared Data and Algorithms for Deep Learning in Fundamental Physics
Authors:
Lisa Benato,
Erik Buhmann,
Martin Erdmann,
Peter Fackeldey,
Jonas Glombitza,
Nikolai Hartmann,
Gregor Kasieczka,
William Korcari,
Thomas Kuhr,
Jan Steinheimer,
Horst Stöcker,
Tilman Plehn,
Kai Zhou
Abstract:
We introduce a Python package that provides simply and unified access to a collection of datasets from fundamental physics research - including particle physics, astroparticle physics, and hadron- and nuclear physics - for supervised machine learning studies. The datasets contain hadronic top quarks, cosmic-ray induced air showers, phase transitions in hadronic matter, and generator-level historie…
▽ More
We introduce a Python package that provides simply and unified access to a collection of datasets from fundamental physics research - including particle physics, astroparticle physics, and hadron- and nuclear physics - for supervised machine learning studies. The datasets contain hadronic top quarks, cosmic-ray induced air showers, phase transitions in hadronic matter, and generator-level histories. While public datasets from multiple fundamental physics disciplines already exist, the common interface and provided reference models simplify future work on cross-disciplinary machine learning and transfer learning in fundamental physics. We discuss the design and structure and line out how additional datasets can be submitted for inclusion.
As showcase application, we present a simple yet flexible graph-based neural network architecture that can easily be applied to a wide range of supervised learning tasks. We show that our approach reaches performance close to dedicated methods on all datasets. To simplify adaptation for various problems, we provide easy-to-follow instructions on how graph-based representations of data structures, relevant for fundamental physics, can be constructed and provide code implementations for several of them. Implementations are also provided for our proposed method and all reference algorithms.
△ Less
Submitted 24 March, 2022; v1 submitted 1 July, 2021;
originally announced July 2021.
-
Morphological classification of radio galaxies: Capsule Networks versus Convolutional Neural Networks
Authors:
V. Lukic,
M. Brüggen,
B. Mingo,
J. H. Croston,
G. Kasieczka,
P. N. Best
Abstract:
Next-generation radio surveys will yield an unprecedented amount of data, warranting analysis by use of machine learning techniques. Convolutional neural networks are the deep learning technique that has proven to be the most successful in classifying image data. Capsule networks are a more recently developed technique that use capsules comprised of groups of neurons, that describe properties of a…
▽ More
Next-generation radio surveys will yield an unprecedented amount of data, warranting analysis by use of machine learning techniques. Convolutional neural networks are the deep learning technique that has proven to be the most successful in classifying image data. Capsule networks are a more recently developed technique that use capsules comprised of groups of neurons, that describe properties of an image including the relative spatial locations of features. The current work explores the performance of different capsule network architectures against simpler convolutional neural network architectures, in reproducing the classifications into the classes of unresolved, FRI and FRII morphologies. We utilise images from a LOFAR survey which is the deepest, wide-area radio survey to date, revealing more complex radio-source structures compared to previous surveys, presenting further challenges for machine learning algorithms. The 4- and 8-layer convolutional networks attain an average precision of 93.3% and 94.3% respectively, compared to 89.7% obtained with the capsule network, when training on original and augmented images. Implementing transfer learning achieves a precision of 94.4%, that is within the confidence interval of the 8-layer convolutional network. The convolutional networks always outperform any variation of the capsule network, as they prove to be more robust to the presence of noise in images. The use of pooling appears to allow more freedom for the intra-class variability of radio galaxy morphologies, as well as reducing the impact of noise.
△ Less
Submitted 8 May, 2019;
originally announced May 2019.
