research-article

Faster self-organizing fuzzy neural network training and a hyperparameter analysis for a brain-computer interface

Authors:

Girijesh Prasad, and

Thomas Martin McGinnityAuthors Info & Claims

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, Volume 39, Issue 6

Pages 1458 - 1471

https://doi.org/10.1109/TSMCB.2009.2018469

Published: 01 December 2009 Publication History

Abstract

This paper introduces a number of modifications to the learning algorithm of the self-organizing fuzzy neural network (SOFNN) to improve computational efficiency. It is shown that the modified SOFNN favorably compares to other evolving fuzzy systems in terms of accuracy and structural complexity. An analysis of the SOFNN's effectiveness when applied in an electroencephalogram (EEG)-based brain-computer interface (BCI) involving the neural-time-series-prediction-preprocessing (NTSPP) framework is also presented, where a sensitivity analysis (SA) of the SOFNN hyperparameters was performed using EEG data recorded from three subjects during left/right-motor-imagery-based BCI experiments. The aim of this one-time SA was to eliminate the need to choose subject- and signal-specific hyperparameters for the SOFNN and thus apply the SOFNN in the NTSPP framework as a parameterless self-organizing framework for EEG preprocessing. The results indicate that a general set of NTSPP parameters chosen via the SA provide the best results when tested in a BCI system. Therefore, with this general set of SOFNN parameters and its self-organizing structure, in conjunction with parameterless feature extraction and linear discriminant classification, a fully parameterless BCI that lends itself well to autonomous adaptation is realizable.

References

[1]

G. Leng, G. Prasad, and T. M. McGinnity, "An on-line algorithm for creating self-organizing fuzzy neural networks," Neural Netw., vol. 17, no. 10, pp. 1477-1493, Dec. 2004.

Digital Library

[2]

G. Leng, "Algorithmic developments for self-organizing fuzzy neural networks," Ph.D. dissertation, Univ. Ulster, Coleraine, U.K., Sep. 2003.

[3]

S. Wu and M. J. Er, "Dynamic fuzzy neural networks--A novel approach to function approximation," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 30, no. 2, pp. 358-364, Apr. 2000.

Digital Library

[4]

N. K. Kasabov, Evolving Connectionist Systems: Methods and Applications in Bioinformatics. Berlin, Germany: Springer-Verlag, 2003.

Digital Library

[5]

P. P. Angelov and D. Filev, "An approach to online identification of Takagi-Sugeno fuzzy models," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 34, no. 1, pp. 484-498, Feb. 2004.

Digital Library

[6]

E. Lughofer and E. P. Klement, "FLEXFIS: A variant for incremental learning of Takagi-Sugeno fuzzy systems," in Proc. FUZZ-IEEE, 2005, pp. 915-920.

[7]

N. K. Kasabov, "Evolving fuzzy neural networks for supervised/ unsupervised online knowledge-based learning," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 31, no. 6, pp. 902-918, Dec. 2001.

Digital Library

[8]

N. K. Kasabov and Q. Song, "DENFIS: Dynamic evolving neural-fuzzy inference system and its application for time-series prediction," IEEE Trans. Fuzzy Syst., vol. 10, no. 2, pp. 144-154, Apr. 2002.

Digital Library

[9]

J.-S. R. Jang, Neuro-Fuzzy & Soft Computing. Englewood Cliffs, NJ: Prentice-Hall, 1997.

[10]

G. B. Huang, P. Saratchandran, and N. Sundararajan, "An efficient sequential learning algorithm for growing and pruning RBFNs," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 34, no. 6, pp. 2284-2292, Dec. 2004.

Digital Library

[11]

G. Pfurtscheller, C. Neuper, A. Schlogl, and K. Lugger, "Separability of EEG signals recorded during right and left motor imagery using adaptive autoregressive parameters," IEEE Trans. Rehabil. Eng., vol. 6, no. 3, pp. 316-324, Sep. 1998.

[12]

J. R. Wolpaw, N. Birbaumer, D. J. McFarland, G. Pfurtscheller, and T. M. Vaughan, "Brain-computer interfaces for communication and control," Clin. Neurophysiol., vol. 113, no. 6, pp. 767-791, Jun. 2002.

[13]

J. R. Wolpaw, H. Ramouser, D. J. McFarland, and G. Pfurtscheller, "EEG-based communication: Improved accuracy by response verification," IEEE Trans. Rehabil. Eng., vol. 6, no. 3, pp. 326-333, Sep. 1998.

[14]

T. M. Vaughan, "Guest editorial brain-computer interface technology: A review of the second international meeting," IEEE Trans. Neural Syst. Rehabil. Eng., vol. 11, no. 2, pp. 94-109, Jun. 2003.

[15]

A. Schlogl, C. Keinrath, R. Scherer, and G. Pfurtscheller, "Estimating the mutual information of an EEG-based brain-computer interface," Biomed. Technik, vol. 47, no. 1/2, pp. 3-8, Jan./Feb. 2002.

[16]

B. Blankertz, G. Dornhege, M. Krauledat, K.-R. Muller, and G. Curio, "The non-invasive Berlin brain-computer interface: Fast acquisition of effective performance in untrained subjects," Neuroimage, vol. 37, no. 2, pp. 539-550, Aug. 2007. Elsevier.

[17]

S. G. Mason, A. Bashashati, M. Fatoruechi, K. F. Navarro, and G. E. Birch, "A comprehensive survey of brain interface technology designs," Ann. Biomed. Eng., vol. 35, no. 2, pp. 137-169, Feb. 2007.

[18]

A. Bashashati, M. Fatourechi, R. K. Ward, and G. E. Birch, "A survey of signal processing algorithms in brain-computer interfaces based on electrical brain signals," J. Neural Eng., vol. 4, no. 2, pp. R32-R37, Jun. 2007.

[19]

D. Coyle, "Intelligent preprocessing and feature extraction techniques for a brain computer interface," Ph.D. dissertation, Univ. Ulster, Coleraine, U.K., 2006.

[20]

D. Coyle, G. Prasad, and T. M. McGinnity, "A time-series prediction approach for feature extraction in a BCI," IEEE Trans. Neural Syst. Rehabil. Eng., vol. 13, no. 4, pp. 461-467, Dec. 2005.

[21]

D. Coyle, G. Prasad, and T. M. McGinnity, "Improving information transfer rates of a BCI by SOFNN-based multi-step-ahead time-series prediction," in Proc. 3rd IEEE Syst., Man, Cybern. Conf., Sep. 2004, pp. 230-235.

[22]

D. Coyle, G. Prasad, and T. M. McGinnity, "Improving signal separability and inter-session stability of a motor imagery-based brain-computer interface by neural-time-series-prediction-preprocessing," in Proc. 27th Int. IEEE Eng. Med. Biol. Conf., Sep. 2005, pp. 2294-2299.

[23]

T. Takagi and M. Sugeno, "Derivation of fuzzy control rules from human operator's control action," in Proc. IFAC Symp. Fuzzy Inf., Knowl. Representation Decision Anal., 1983, pp. 55-60.

[24]

B. Hassibi and D. G. Stork, "Second order derivatives for network pruning: Optimal brain surgeon," in Adv. Neural Inf. Process. Syst., 1993, vol. 4, pp. 164-171.

Digital Library

[25]

A. Rizzi, M. Panella, and F. M. F. Maxioli, "Adaptive resolution of minmax classifiers," IEEE Trans. Neural Netw., vol. 13, no. 2, pp. 402-414, Mar. 2002.

Digital Library

[26]

Graz Dataset IIIb for the BCI 2005 Data Classification Competition. {Online}. Available: http://ida.first.fhg.de/projects/bci/competition_iii/ desc_IIIb.pdf

[27]

B. J. Fisch, Fisch & Spellmann's EEG Primer: Basic Principles of Digital and Analog EEG. Amsterdam, The Netherlands: Elsevier, 1999.

[28]

G. P. Williams, Chaos Theory Tamed. New York: Taylor & Francis, 1997.

[29]

B. Hjorth, "EEG analysis based on time-domain properties," Electroencephalogr. Clin. Neurophysiol., vol. 29, no. 3, pp. 306-310, Sep. 1970.

[30]

C. Guger, "Real-time data processing under windows for an EEG-based brain-computer interface," Ph.D. dissertation, Tech. Univ. Graz, Graz, Austria, Sep. 1999.

[31]

I. I. Goncharova and J. S. Barlow, "Changes in EEG mean frequency and spectral purity during spontaneous alpha blocking," Electroencephalogr. Clin. Neurophysiol., vol. 76, no. 3, pp. 197-204, Sep. 1990.

[32]

B. S. Everitt and G. Dunn, Applied Multivariate Data Analysis. London, U.K.: Arnold, 1991.

[33]

The Mathworks Website. {Online}. Available: http://www. mathworks.com

[34]

M. Birattari, G. Bontempi, and H. Bersini, "Lazy learning meets the recursive least-squares algorithm," in Advances in Neural Information Processing Systems, vol. 11, M. S. Kearns, S. A. Solla, and D. A. Cohn, Eds. Cambridge, MA: MIT Press, 1999.

Digital Library

[35]

D. Coyle, A. Satti, G. Prasad, and T. M. McGinnity, "Neural times-series prediction preprocessing meets common spatial patterns in a brain-computer interface," in Proc. 30th Int. IEEE Eng. Med. Biol. Conf., 2008, pp. 2626-2629.

[36]

D. Coyle, T. M. McGinnity, and G. Prasad, "A multi-class brain-computer interface with SOFNN-based prediction preprocessing," in IEEE World Congr. Comput. Intell., Jun. 2008, pp. 3695-3702.

[37]

BCI Competition IV, 2008. {Online}. Available: http://ida.first.fhg.de/ projects/bci/competition_iv/results/index.html

Cited By

Hassoon NAli MJaber MAbd SAbosinnee AKareem ZKhan MDhiman GVE S(2023)Prediction and analysis of chronic epilepsy using electroencephalographic signals on medical internet of things platformIntelligent Data Analysis10.3233/IDA-23743427:S1(65-82)Online publication date: 3-Nov-2023
https://dl.acm.org/doi/10.3233/IDA-237434
Bablani AEdla DTripathi DCheruku R(2019)Survey on Brain-Computer InterfaceACM Computing Surveys10.1145/329771352:1(1-32)Online publication date: 13-Feb-2019
https://dl.acm.org/doi/10.1145/3297713
Komijani HParsaei MKhajeh EGolkar MZarrabi H(2019)EEG classification using recurrent adaptive neuro-fuzzy network based on time-series predictionNeural Computing and Applications10.1007/s00521-017-3213-331:7(2551-2562)Online publication date: 1-Jul-2019
https://dl.acm.org/doi/10.1007/s00521-017-3213-3
Show More Cited By

Index Terms

Faster self-organizing fuzzy neural network training and a hyperparameter analysis for a brain-computer interface
1. Computing methodologies
  1. Machine learning
    1. Machine learning approaches
      1. Neural networks

Index terms have been assigned to the content through auto-classification.

Recommendations

Modified CC-LR algorithm with three diverse feature sets for motor imagery tasks classification in EEG based brain-computer interface

Motor imagery (MI) tasks classification provides an important basis for designing brain-computer interface (BCI) systems. If the MI tasks are reliably distinguished through identifying typical patterns in electroencephalography (EEG) data, a motor ...
Read More
Convolutional Neural Networks for P300 Detection with Application to Brain-Computer Interfaces

A Brain-Computer Interface (BCI) is a specific type of human-computer interface that enables the direct communication between human and computers by analyzing brain measurements. Oddball paradigms are used in BCI to generate event-related potentials (...
Read More
Towards ambulatory brain-computer interfaces: a pilot study with P300 signals
ACE '09: Proceedings of the International Conference on Advances in Computer Entertainment Technology

Brain-Computer Interfaces (BCI) are communication systems that enable users to interact with computers using only brain activity. This activity is generally measured by ElectroEncephaloGraphy (EEG). A major limitation of BCI is the electrical ...
Read More

Comments

Information & Contributors

Information

Published In

cover image IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics Volume 39, Issue 6

December 2009

319 pages

ISSN:1083-4419

Issue’s Table of Contents

Copyright © 2009.

Publisher

IEEE Press

Publication History

Published: 01 December 2009

Revised: 23 December 2008

Received: 01 July 2008

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

17
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Other Metrics

View Author Metrics

Citations

Cited By

Hassoon NAli MJaber MAbd SAbosinnee AKareem ZKhan MDhiman GVE S(2023)Prediction and analysis of chronic epilepsy using electroencephalographic signals on medical internet of things platformIntelligent Data Analysis10.3233/IDA-23743427:S1(65-82)Online publication date: 3-Nov-2023
https://dl.acm.org/doi/10.3233/IDA-237434
Bablani AEdla DTripathi DCheruku R(2019)Survey on Brain-Computer InterfaceACM Computing Surveys10.1145/329771352:1(1-32)Online publication date: 13-Feb-2019
https://dl.acm.org/doi/10.1145/3297713
Komijani HParsaei MKhajeh EGolkar MZarrabi H(2019)EEG classification using recurrent adaptive neuro-fuzzy network based on time-series predictionNeural Computing and Applications10.1007/s00521-017-3213-331:7(2551-2562)Online publication date: 1-Jul-2019
https://dl.acm.org/doi/10.1007/s00521-017-3213-3
Kuo CChen HChou HChen PKuo Y(2018)Wireless Stimulus-on-Device Design for Novel P300 Hybrid Brain-Computer Interface ApplicationsComputational Intelligence and Neuroscience10.1155/2018/23018042018Online publication date: 1-Jan-2018
https://dl.acm.org/doi/10.1155/2018/2301804
Wu DLawhern VGordon SLance BLin C(2017)Driver Drowsiness Estimation From EEG Signals Using Online Weighted Adaptation Regularization for Regression (OwARR)IEEE Transactions on Fuzzy Systems10.1109/TFUZZ.2016.263337925:6(1522-1535)Online publication date: 1-Dec-2017
https://dl.acm.org/doi/10.1109/TFUZZ.2016.2633379
Mohammadzadeh AGhaemi S(2016)A modified sliding mode approach for synchronization of fractional-order chaotic/hyperchaotic systems by using new self-structuring hierarchical type-2 fuzzy neural networkNeurocomputing10.1016/j.neucom.2015.12.098191:C(200-213)Online publication date: 26-May-2016
https://dl.acm.org/doi/10.1016/j.neucom.2015.12.098
Raza HCecotti HLi YPrasad G(2016)Adaptive learning with covariate shift-detection for motor imagery-based brain---computer interfaceSoft Computing - A Fusion of Foundations, Methodologies and Applications10.1007/s00500-015-1937-520:8(3085-3096)Online publication date: 1-Aug-2016
https://dl.acm.org/doi/10.1007/s00500-015-1937-5
Huang J(2015)Research on optimisation and application of improved fuzzy neural network control algorithmInternational Journal of Security and Networks10.1504/IJSN.2015.07244210:4(255-260)Online publication date: 1-Oct-2015
https://dl.acm.org/doi/10.1504/IJSN.2015.072442
Dahal KAlmejalli KHossain MChen W(2015)GA-based learning for rule identification in fuzzy neural networksApplied Soft Computing10.1016/j.asoc.2015.06.04635:C(605-617)Online publication date: 1-Oct-2015
https://dl.acm.org/doi/10.1016/j.asoc.2015.06.046
Seera MLim C(2014)A hybrid intelligent system for medical data classificationExpert Systems with Applications: An International Journal10.1016/j.eswa.2013.09.02241:5(2239-2249)Online publication date: 1-Apr-2014
https://dl.acm.org/doi/10.1016/j.eswa.2013.09.022
Show More Cited By

View Options

View options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents