×

Relation-based neurofuzzy networks with evolutionary data granulation. (English) Zbl 1067.92006

Summary: We introduce a concept of self-organizing neurofuzzy networks (SONFN), a hybrid modeling architecture combining relation-based neurofuzzy networks (NFN) and self-organizing polynomial neural networks (PNN). For such networks we develop a comprehensive design methodology and carry out a series of numerical experiments using data coming from the area of software engineering. The construction of SONFNs exploits fundamental technologies of computational intelligence (CI), namely fuzzy sets, neural networks, and genetic algorithms. The architecture of the SONFN results from a synergistic usage of NFN and PNN. NFN contributes to the formation of the premise part of the rule-based structure of the SONFN. The consequence part of the SONFN is designed using PNNs.
We discuss two types of SONFN architectures with the taxonomy based on the NFN scheme being applied to the premise part of SONFN and propose a comprehensive learning algorithm. It is shown that this network exhibits a dynamic structure as the number of its layers as well as the number of nodes in each layer of the SONFN are not predetermined (as this is usually the case for a popular topology of a multilayer perceptron). The experimental results deal with well-known software data such as the NASA dataset concerning software cost estimation and the one describing software modules of the medical imaging system (MIS). In comparison with the previously discussed approaches, the self-organizing networks are more accurate and exhibit superb generalization capabilities.

MSC:

92B20 Neural networks for/in biological studies, artificial life and related topics
68T05 Learning and adaptive systems in artificial intelligence
94D05 Fuzzy sets and logic (in connection with information, communication, or circuits theory)
PDFBibTeX XMLCite
Full Text: DOI

References:

[1] Pedrycz, W., Computational Intelligence: An Introduction (1998), CRC Press: CRC Press Florida
[2] Peters, J. F.; Pedrycz, W., Computational intelligence, (Webster, J. G., Encyclopedia of Electrical and Electronic Engineering, Volume 22 (1999), John Wiley & Sons: John Wiley & Sons Florida) · Zbl 0956.68120
[3] (Pedrycz, W.; Peters, J. F., Computational Intelligence in Software Engineering (1998), World Scientific: World Scientific New York) · Zbl 0956.68120
[4] Takagi, H.; Hayashi, I., NN-driven fuzzy reasoning, Int. J. of Approximate Reasoning, 5, 3, 191-212 (1991) · Zbl 0733.68074
[5] Horikawa, S.; Furuhashi, T.; Uchigawa, Y., On fuzzy modeling using fuzzy neural networks with the back propagation algorithm, IEEE Trans. Neural Networks, 3, 5, 801-806 (1992)
[6] Oh, S.-K.; Alm, T.-C.; Pedrycz, W., A study on the self-organizing polynomial neural networks, (Joint 9th IFSA World Congress (2001)), 1690-1695
[7] Oh, S.-K.; Kim, D.-W.; Park, B.-J., Transactions on Control, Automation and Systems Engineering, Vol. 3 (2001)
[8] Kim, D.-W.; Oh, S.-K.; Kim, H.-K., A Study on the self-organizing fuzzy polynomial neural networks, KIEE International Transactions on Systems and Control, 12D, 1, 12-16 (2002)
[9] Oh, S.-K.; Kim, D.-W.; Pedrycz, W., Hybrid fuzzy polynomial neural networks, International Journal of Uncertainty Fuzziness and Knowledge-Based Systems, 10, 3, 257-280 (2002) · Zbl 1075.93020
[10] Box, G. E.P.; Hunter, W. G.; Hunter, J. S., Statistics for Experimenters (1978), John Wiley & Sons: John Wiley & Sons Singapore · Zbl 0394.62003
[11] Ivahnenko, A. G., The group method of data handling: A rival of method of stochastic approximation, Soviet Automatic Control, 13, 3, 43-55 (1968)
[12] Shin, M.; Goel, A. L., Empirical data modeling in software engineering using radial basis functions, IEEE Trans on Software Engineering, 26, 6, 567-579 (June 2000)
[13] (Lyu, M. R., Handbook of Software Reliability Engineering (1995), McGraw-Hill), 510-514
[14] Yamakawa, T., A new effective learning algorithm for a neo fuzzy neuron model, \((5^{th}\) IFSA World Conference (1993)), 1017-1020
[15] Goldberg, D. E., Genetic Algorithms in Search, Optimization & Machine Learning (1989), Addison-Wesley · Zbl 0721.68056
[16] Bishop, C. M., Neural Networks for Pattern Recognition (1995), Oxford University
[17] Kearns, M.; Ron, D., Algorithmic Stability and Sanity-Check Bounds for Leave-One-Out Cross-Validation, (Proc. \(10^{th}\) Ann. Conf. Computational Learning Theory (1997)), 152-162
[18] Kemerer, C. F., An empirical validation of software cost estimation models, Comm. ACM, 30, 5, 416-429 (May 1987)
[19] Oh, S.-K.; Pedrycz, W.; Park, B.-J.; Ahn, T.-C., A hybrid modeling architecture for software engineering, (Proceedings of the \(6^{th}\) IASTED International Conference ASC (July 2002)), 309-314
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.