Open Access
Research Article
Switching regression analysis for data with outlier using ANFIS trained by GA and PSO
*Aynur YonarCorresponding authoraynursahin@selcuk.edu.trDepartment of Statistics Selçuk University Faculty of ScienceKonya, Turkey0000-0003-1681-9398View full profile →
* Corresponding author · click or hover a name for details
- Received:
- 11 Apr 2023
- Published Online:
- 02 Feb 2026
- Article type:
- Research Article
- Language:
- EN
- Article no.:
- JIOS-1571
- Pages:
- 487–506
Abstract
Classical regression analysis assumes that the data belong to a single class. However, in many application studies, data are typically gathered from various mixed classes without prior knowledge of each class’s membership. Switching regression analysis, which creates suitable sub-models for each different class, is used to model such data. As the quantity of independent variables and classes within the data increases, the number of sub-models to be generated simultaneously in switching regression also increases. In such scenarios, it is recommended to utilize the Adaptive Network-based Fuzzy Inference System (ANFIS), which proves to be an effective tool for addressing mixed problems and systems. Achieving successful training is essential for obtaining effective results with ANFIS. This can be achieved by determining its structure’s premise and consequence parameters with practical optimization algorithms. This study focuses on training ANFIS with Genetic Algorithm (GA) and Particle Swarm Optimization (PSO). The effectiveness of the GA-trained ANFIS and PSO-trained ANFIS are tested with a numerical example where the dependent variable has an outlier. The results show that the proposed methods, especially PSO-trained ANFIS, provide accurate predictions and are not affected by the outlier in the dependent variable.
Keywords
Subject Classifications
62J9968T0568T2062A86
References
[1] C.-B. Cheng and E. S. Lee, “Switching regression analysis by fuzzy adaptive network,” European Journal of Operational Research, vol. 128, no. 3, pp. 647-663 (2001).[2] M. Menard, “Fuzzy clustering and switching regression models using ambiguity and distance rejects,” Fuzzy Sets and Systems, vol. 122, no. 3, pp. 363-399 (2001).[3] R. J. Hathaway and J. C. Bezdek, “Switching regression models and fuzzy clustering,” IEEE Transactions on Fuzzy Systems, vol. 1, no. 3, pp. 195-204 (1993).[4] R. E. Quandt, “A new approach to estimating switching regressions,” Journal of the American Statistical Association, vol. 67, no. 338, pp. 306-310 (1972).[5] R. E. Quandt and J. B. Ramsey, “Estimating mixtures of normal distributions and switching regressions,” Journal of the American Statistical Association, vol. 73, no. 364, pp. 730-738 (1978).[6] L.-F. Lee and R. H. Porter, “Switching Regression Models with Imperfect Sample Separation Information—With an Application on Cartel Stability,” Econometrica: Journal of the Econometric Society, pp. 391-418 (1984).[7] T. E. Dalkılıç, K. Ş. Kula, and A. Apaydın, “Parameter estimation by ANFIS where dependent variable has outlier,” Hacettepe Journal of Mathematics and Statistics, vol. 43, no. 2, pp. 309-322 (2014).[8] T. E. Dalkılıç and A. Apaydın, “A fuzzy adaptive network approach to parameter estimation in cases where independent variables come from an exponential distribution,” Journal of Computational and Applied Mathematics, vol. 233, no. 1, pp. 36-45 (2009).[9] L. A. Zadeh, “Fuzzy sets,” Information and Control, vol. 8, no. 3, pp. 338-353, 1965.[10] J.-S. Jang, “ANFIS: adaptive-network-based fuzzy inference system,” IEEE Transactions on Systems, Man, and Cybernetics, vol. 23, no. 3, pp. 665-685 (1993).[11] D. Karaboga and E. Kaya, “Adaptive network based fuzzy inference system (ANFIS) training approaches: a comprehensive survey,” Artificial Intelligence Review, vol. 52, no. 4, pp. 2263-2293 (2019).[12] I. K. Omurlu, F. Cantas, M. Ture, and H. Ozturk, “An empirical study on performances of multilayer perceptron, logistic regression, ANFIS, KNN and bagging CART,” Journal of Statistics Management Systems, vol. 23, no. 4, pp. 827-841 (2020).[13] C.-B. Cheng and E. S. Lee, “Applying fuzzy adaptive network to fuzzy regression analysis,” Computers Mathematics with Applications, vol. 38, no. 2, pp. 123-140 (1999). [14] S. Danesh, R. Farnoosh, and T. Razzaghnia, “Fuzzy nonparametric regression based on an adaptive neuro-fuzzy inference system,” Neurocomputing, vol. 173, pp. 1450-1460 (2016).[15] S. Danesh, “Fuzzy parameters estimation via hybrid methods,” Hacettepe Journal of Mathematics Statistics, vol. 10 (2018).[16] T. Razzaghnia, “Regression parameters prediction in data set with outliers using neural network,” Hacettepe Journal of Mathematics Statistics, vol. 48, no. 4, pp. 1170-1184 (2019).[17] D. Karaboga and E. Kaya, “Estimation of number of foreign visitors with ANFIS by using ABC algorithm,” Soft Computing, vol. 1-13 (2019).[18] D. Karaboga and E. Kaya, “Training ANFIS by using an adaptive and hybrid artificial bee colony algorithm (aABC) for the identification of nonlinear static systems,” Arabian Journal for Science Engineering, vol. 44, no. 4, pp. 3531-3547 (2019).[19] D. Karaboga and E. Kaya, “Training ANFIS using artificial bee colony algorithm for nonlinear dynamic systems identification,” in 22nd Signal Processing and Communications Applications Conference (SIU), IEEE (2014).[20] W.-T. Pan, “Forecasting classification of operating performance of enterprises by ZSCORE combining ANFIS and genetic algorithm,” Neural Computing Applications, vol. 18, no. 8, p. 1005 (2009).[21] H. Yang, M. Hasanipanah, M. Tahir, and D. T. Bui, “Intelligent prediction of blasting-induced ground vibration using ANFIS optimized by GA and PSO,” Natural Resources Research, vol. 1-12 (2019).[22] A. Khosravi, S. Nahavandi, and D. Creighton, “Prediction interval construction and optimization for adaptive neurofuzzy inference systems,” IEEE Transactions on Fuzzy Systems, vol. 19, no. 5, pp. 983-988 (2011).[23] S. F. Sheniha, S. S. Priyadharsini, and S. E. Rajan, “Removal of artifact from EEG signal using differential evolution algorithm,” in 2013 International Conference on Communication and Signal Processing, IEEE (2013).[24] T. Takagi and M. Sugeno, “Fuzzy identification of systems and its applications to modeling and control,” IEEE Transactions on Systems, Man, and Cybernetics, no. 1, pp. 116-132 (1985).[25] J. Holland, Adaptation in natural and artificial systems: an introductory analysis with application to biology, Control Artificial Intelligence Review (1975).[26] D. E. Goldberg and J. H. Holland, Genetic algorithms and machine learning, Kluwer Academic Publisher (1988).[27] E.-G. Talbi, Metaheuristics: from design to implementation, vol. 74, John Wiley & Sons (2009).[28] X.-S. Yang, Nature-inspired metaheuristic algorithms, Luniver Press (2010).[29] J. Kennedy and R. Eberhart, “Particle swarm optimization,” in Proceedings of ICNN’95—International Conference on Neural Networks, IEEE (1995).[30] R. Eberhart and J. Kennedy, “A new optimizer using particle swarm theory,” in MHS’95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science, IEEE (1995).
Views: 102Downloads: 8Citations: 0
