-
Input-Output Specifications of Grid-Forming Functions and Data-Driven Verification Methods
Authors:
Jennifer T. Bui,
Dominic Groß
Abstract:
This work investigates interoperability and performance specifications for converter interfaced generation (CIG) that can be verified using only input-output data. First, we develop decentralized conditions on frequency stability that account for network circuit dynamics and can be verified using CIG terminal dynamics and a few key network parameters. Next, we formalize performance specifications…
▽ More
This work investigates interoperability and performance specifications for converter interfaced generation (CIG) that can be verified using only input-output data. First, we develop decentralized conditions on frequency stability that account for network circuit dynamics and can be verified using CIG terminal dynamics and a few key network parameters. Next, we formalize performance specifications that impose requirements on the CIG disturbance response. A simple data-driven validation method is presented that enables verification of the interoperability and performance specifications for CIG using input-output data from a two-node system. Data obtained from electromagnetic transient (EMT) simulations are used to illustrate the proposed approach and the impact of key parameters such as inner control loop gains, network coupling strength, and controller bandwidth limitations.
△ Less
Submitted 24 April, 2024;
originally announced April 2024.
-
GaSpCT: Gaussian Splatting for Novel CT Projection View Synthesis
Authors:
Emmanouil Nikolakakis,
Utkarsh Gupta,
Jonathan Vengosh,
Justin Bui,
Razvan Marinescu
Abstract:
We present GaSpCT, a novel view synthesis and 3D scene representation method used to generate novel projection views for Computer Tomography (CT) scans. We adapt the Gaussian Splatting framework to enable novel view synthesis in CT based on limited sets of 2D image projections and without the need for Structure from Motion (SfM) methodologies. Therefore, we reduce the total scanning duration and t…
▽ More
We present GaSpCT, a novel view synthesis and 3D scene representation method used to generate novel projection views for Computer Tomography (CT) scans. We adapt the Gaussian Splatting framework to enable novel view synthesis in CT based on limited sets of 2D image projections and without the need for Structure from Motion (SfM) methodologies. Therefore, we reduce the total scanning duration and the amount of radiation dose the patient receives during the scan. We adapted the loss function to our use-case by encouraging a stronger background and foreground distinction using two sparsity promoting regularizers: a beta loss and a total variation (TV) loss. Finally, we initialize the Gaussian locations across the 3D space using a uniform prior distribution of where the brain's positioning would be expected to be within the field of view. We evaluate the performance of our model using brain CT scans from the Parkinson's Progression Markers Initiative (PPMI) dataset and demonstrate that the rendered novel views closely match the original projection views of the simulated scan, and have better performance than other implicit 3D scene representations methodologies. Furthermore, we empirically observe reduced training time compared to neural network based image synthesis for sparse-view CT image reconstruction. Finally, the memory requirements of the Gaussian Splatting representations are reduced by 17% compared to the equivalent voxel grid image representations.
△ Less
Submitted 3 April, 2024;
originally announced April 2024.
-
Generatively Augmented Neural Network Watchdog for Image Classification Networks
Authors:
Justin M. Bui,
Glauco A. Amigo,
Robert J. Marks II
Abstract:
The identification of out-of-distribution data is vital to the deployment of classification networks. For example, a generic neural network that has been trained to differentiate between images of dogs and cats can only classify an input as either a dog or a cat. If a picture of a car or a kumquat were to be supplied to this classifier, the result would still be either a dog or a cat. In order to…
▽ More
The identification of out-of-distribution data is vital to the deployment of classification networks. For example, a generic neural network that has been trained to differentiate between images of dogs and cats can only classify an input as either a dog or a cat. If a picture of a car or a kumquat were to be supplied to this classifier, the result would still be either a dog or a cat. In order to mitigate this, techniques such as the neural network watchdog have been developed. The compression of the image input into the latent layer of the autoencoder defines the region of in-distribution in the image space. This in-distribution set of input data has a corresponding boundary in the image space. The watchdog assesses whether inputs are in inside or outside this boundary. This paper demonstrates how to sharpen this boundary using generative network training data augmentation thereby bettering the discrimination and overall performance of the watchdog.
△ Less
Submitted 7 September, 2021;
originally announced September 2021.
-
Cascade Watchdog: A Multi-tiered Adversarial Guard for Outlier Detection
Authors:
Glauco Amigo,
Justin M. Bui,
Charles Baylis,
Robert J. Marks
Abstract:
The identification of out-of-distribution content is critical to the successful implementation of neural networks. Watchdog techniques have been developed to support the detection of these inputs, but the performance can be limited by the amount of available data. Generative adversarial networks have displayed numerous capabilities, including the ability to generate facsimiles with excellent accur…
▽ More
The identification of out-of-distribution content is critical to the successful implementation of neural networks. Watchdog techniques have been developed to support the detection of these inputs, but the performance can be limited by the amount of available data. Generative adversarial networks have displayed numerous capabilities, including the ability to generate facsimiles with excellent accuracy. This paper presents and empirically evaluates a multi-tiered watchdog, which is developed using GAN generated data, for improved out-of-distribution detection. The cascade watchdog uses adversarial training to increase the amount of available data similar to the out-of-distribution elements that are more difficult to detect. Then, a specialized second guard is added in sequential order. The results show a solid and significant improvement on the detection of the most challenging out-of-distribution inputs while preserving an extremely low false positive rate.
△ Less
Submitted 14 June, 2022; v1 submitted 20 August, 2021;
originally announced August 2021.
-
Classification of Common Waveforms Including a Watchdog for Unknown Signals
Authors:
C. Tanner Fredieu,
Justin Bui,
Anthony Martone,
Robert J. Marks II,
Charles Baylis,
R. Michael Buehrer
Abstract:
In this paper, we examine the use of a deep multi-layer perceptron model architecture to classify received signal samples as coming from one of four common waveforms, Single Carrier (SC), Single-Carrier Frequency Division Multiple Access (SC-FDMA), Orthogonal Frequency Division Multiplexing (OFDM), and Linear Frequency Modulation (LFM), used in communication and radar networks. Synchronization of…
▽ More
In this paper, we examine the use of a deep multi-layer perceptron model architecture to classify received signal samples as coming from one of four common waveforms, Single Carrier (SC), Single-Carrier Frequency Division Multiple Access (SC-FDMA), Orthogonal Frequency Division Multiplexing (OFDM), and Linear Frequency Modulation (LFM), used in communication and radar networks. Synchronization of the signals is not needed as we assume there is an unknown and uncompensated time and frequency offset. An autoencoder with a deep CNN architecture is also examined to create a new fifth classification category of an unknown waveform type. This is accomplished by calculating a minimum and maximum threshold values from the root mean square error (RMSE) of the radar and communication waveforms. The classifier and autoencoder work together to monitor a spectrum area to identify the common waveforms inside the area of operation along with detecting unknown waveforms. Results from testing showed the classifier had 100\% classification rate above 0 dB with accuracy of 83.2\% and 94.7\% at -10 dB and -5 dB, respectively, with signal impairments present. Results for the anomaly detector showed 85.3\% accuracy at 0 dB with 100\% at SNR greater than 0 dB with signal impairments present when using a high-value Fast Fourier Transform (FFT) size. Accurate detection rates decline as additional noise is introduced to the signals, with 78.1\% at -5 dB and 56.5\% at -10 dB. However, these low rates seen can be potentially mitigated by using even higher FFT sizes also shown in our results.
△ Less
Submitted 16 August, 2021;
originally announced August 2021.
-
The application of artificial intelligence in software engineering: a review challenging conventional wisdom
Authors:
Feras A. Batarseh,
Rasika Mohod,
Abhinav Kumar,
Justin Bui
Abstract:
The field of artificial intelligence (AI) is witnessing a recent upsurge in research, tools development, and deployment of applications. Multiple software companies are shifting their focus to developing intelligent systems; and many others are deploying AI paradigms to their existing processes. In parallel, the academic research community is injecting AI paradigms to provide solutions to traditio…
▽ More
The field of artificial intelligence (AI) is witnessing a recent upsurge in research, tools development, and deployment of applications. Multiple software companies are shifting their focus to developing intelligent systems; and many others are deploying AI paradigms to their existing processes. In parallel, the academic research community is injecting AI paradigms to provide solutions to traditional engineering problems. Similarly, AI has evidently been proved useful to software engineering (SE). When one observes the SE phases (requirements, design, development, testing, release, and maintenance), it becomes clear that multiple AI paradigms (such as neural networks, machine learning, knowledge-based systems, natural language processing) could be applied to improve the process and eliminate many of the major challenges that the SE field has been facing. This survey chapter is a review of the most commonplace methods of AI applied to SE. The review covers methods between years 1975-2017, for the requirements phase, 46 major AI-driven methods are found, 19 for design, 15 for development, 68 for testing, and 15 for release and maintenance. Furthermore, the purpose of this chapter is threefold; firstly, to answer the following questions: is there sufficient intelligence in the SE lifecycle? What does applying AI to SE entail? Secondly, to measure, formulize, and evaluate the overlap of SE phases and AI disciplines. Lastly, this chapter aims to provide serious questions to challenging the current conventional wisdom (i.e., status quo) of the state-of-the-art, craft a call for action, and to redefine the path forward.
△ Less
Submitted 3 August, 2021;
originally announced August 2021.
-
Symbiotic Hybrid Neural Network Watchdog For Outlier Detection
Authors:
Justin Bui,
Robert J. Marks II
Abstract:
Neural networks are largely black boxes. A neural network trained to classify fruit may classify a picture of a giraffe as a banana. A neural network watchdog's job is to identify such inputs, allowing a classifier to disregard such data. We investigate whether the watchdog should be separate from the neural network or symbiotically attached. We present empirical evidence that the symbiotic watchd…
▽ More
Neural networks are largely black boxes. A neural network trained to classify fruit may classify a picture of a giraffe as a banana. A neural network watchdog's job is to identify such inputs, allowing a classifier to disregard such data. We investigate whether the watchdog should be separate from the neural network or symbiotically attached. We present empirical evidence that the symbiotic watchdog performs better than when the neural networks are disjoint.
△ Less
Submitted 21 April, 2021; v1 submitted 28 February, 2021;
originally announced March 2021.
-
A Quick Look at the $3\,$GHz Radio Sky I. Source Statistics from the Very Large Array Sky Survey
Authors:
Yjan A. Gordon,
Michelle M. Boyce,
Christopher P. O'Dea,
Lawrence Rudnick,
Heinz Andernach,
Adrian N. Vantyghem,
Stefi A. Baum,
Jean-Paul Bui,
Mathew Dionyssiou,
Samar Safi-Harb,
Isabel Sander
Abstract:
The Very Large Array Sky Survey (VLASS) is observing the entire sky north of $-40^{\circ}$ in the S-band ($2<ν<4\,$GHz), with the highest angular resolution ($2''.5$) of any all-sky radio continuum survey to date. VLASS will cover its entire footprint over three distinct epochs, the first of which has now been observed in full. Based on Quick Look images from this first epoch, we have created a ca…
▽ More
The Very Large Array Sky Survey (VLASS) is observing the entire sky north of $-40^{\circ}$ in the S-band ($2<ν<4\,$GHz), with the highest angular resolution ($2''.5$) of any all-sky radio continuum survey to date. VLASS will cover its entire footprint over three distinct epochs, the first of which has now been observed in full. Based on Quick Look images from this first epoch, we have created a catalog of $1.9\times10^{6}$ reliably detected radio components. Due to the limitations of the Quick Look images, component flux densities are underestimated by $\sim 15\,\%$ at $S_{\text{peak}}>3\,$mJy/beam and are often unreliable for fainter components. We use this catalog to perform statistical analyses of the $ν\sim 3\,$GHz radio sky. Comparisons with the Faint Images of the Radio Sky at Twenty cm survey (FIRST) show the typical $1.4-3\,$GHz spectral index, $α$, to be $\sim-0.71$. The radio color-color distribution of point and extended components is explored by matching with FIRST and the LOFAR Two Meter Sky Survey. We present the VLASS source counts, $dN/dS$, which are found to be consistent with previous observations at $1.4$ and $3\,$GHz. Resolution improvements over FIRST result in excess power in the VLASS two-point correlation function at angular scales $\lesssim 7''$, and in $18\,\%$ of active galactic nuclei associated with a single FIRST component being split into multi-component sources by VLASS.
△ Less
Submitted 25 May, 2021; v1 submitted 23 February, 2021;
originally announced February 2021.
-
Autoencoder Watchdog Outlier Detection for Classifiers
Authors:
Justin Bui,
Robert J Marks II
Abstract:
Neural networks have often been described as black boxes. A generic neural network trained to differentiate between kittens and puppies will classify a picture of a kumquat as a kitten or a puppy. An autoencoder watch dog screens trained classifier/regression machine input candidates before processing, e.g. to first test whether the neural network input is a puppy or a kitten. Preliminary results…
▽ More
Neural networks have often been described as black boxes. A generic neural network trained to differentiate between kittens and puppies will classify a picture of a kumquat as a kitten or a puppy. An autoencoder watch dog screens trained classifier/regression machine input candidates before processing, e.g. to first test whether the neural network input is a puppy or a kitten. Preliminary results are presented using convolutional neural networks and convolutional autoencoder watchdogs using MNIST images.
△ Less
Submitted 10 February, 2021; v1 submitted 23 October, 2020;
originally announced October 2020.
-
MosAIc: Finding Artistic Connections across Culture with Conditional Image Retrieval
Authors:
Mark Hamilton,
Stephanie Fu,
Mindren Lu,
Johnny Bui,
Darius Bopp,
Zhenbang Chen,
Felix Tran,
Margaret Wang,
Marina Rogers,
Lei Zhang,
Chris Hoder,
William T. Freeman
Abstract:
We introduce MosAIc, an interactive web app that allows users to find pairs of semantically related artworks that span different cultures, media, and millennia. To create this application, we introduce Conditional Image Retrieval (CIR) which combines visual similarity search with user supplied filters or "conditions". This technique allows one to find pairs of similar images that span distinct sub…
▽ More
We introduce MosAIc, an interactive web app that allows users to find pairs of semantically related artworks that span different cultures, media, and millennia. To create this application, we introduce Conditional Image Retrieval (CIR) which combines visual similarity search with user supplied filters or "conditions". This technique allows one to find pairs of similar images that span distinct subsets of the image corpus. We provide a generic way to adapt existing image retrieval data-structures to this new domain and provide theoretical bounds on our approach's efficiency. To quantify the performance of CIR systems, we introduce new datasets for evaluating CIR methods and show that CIR performs non-parametric style transfer. Finally, we demonstrate that our CIR data-structures can identify "blind spots" in Generative Adversarial Networks (GAN) where they fail to properly model the true data distribution.
△ Less
Submitted 27 February, 2021; v1 submitted 14 July, 2020;
originally announced July 2020.
