Disease Prediction Using Ensemble Learning Models: A Comprehensive Approach

Year : 2025 | Volume : 15 | Issue : 03 | Page : 26 33
    By

    Altaf O. Mulani,

  • Swapnil R. Takale,

  1. Professor, Department of Electronics & Telecommunication Engineering, SKN Sinhgad College of Engineering, Pandharpur, Maharashtra, India
  2. Assistant Professor, Department of Electronics & Telecommunication Engineering, SKN Sinhgad College of Engineering, Pandharpur, Maharashtra, India

Abstract

In recent years, ensemble learning techniques have become pivotal in advancing predictive analytics within healthcare, particularly for early disease detection. The inherent variability and complexity of medical data, often characterized by high dimensionality, class imbalance, and noise, make it challenging for standalone classifiers to maintain high predictive accuracy. Ensemble learning, by integrating multiple models through bagging, boosting, or stacking, offers a more robust and generalizable approach. This study explores the practical application of ensemble learning algorithms to predict diseases such as diabetes, cancer, and cardiovascular conditions using diverse, publicly available datasets. We employed data preprocessing techniques including normalization, imputation, and encoding to prepare clinical datasets. Recursive Feature Elimination (RFE) was applied to identify the most significant features and improve the quality of model inputs. Three ensemble learning methods: Random Forest, Gradient Boosting, and a meta-model-based Stacking Ensemble, were then trained and evaluated. Their performance was evaluated using metrics such as accuracy, precision, recall, and F1-score through multi-fold cross-validation. The results demonstrate that ensemble methods surpass individual models, with the stacking ensemble achieving 90% accuracy and delivering strong results across all evaluation criteria. Furthermore, we discuss deployment challenges such as model interpretability, training time, and integration with clinical decision support systems. In conclusion, ensemble learning models offer a scalable and effective pathway for building intelligent, data-driven diagnostic systems, capable of assisting healthcare professionals in making early and reliable disease predictions.

Keywords: Ensemble learning, disease prediction, machine learning, medical diagnosis, classification models

[This article belongs to Journal of Communication Engineering & Systems ]

How to cite this article:
Altaf O. Mulani, Swapnil R. Takale. Disease Prediction Using Ensemble Learning Models: A Comprehensive Approach. Journal of Communication Engineering & Systems. 2025; 15(03):26-33.
How to cite this URL:
Altaf O. Mulani, Swapnil R. Takale. Disease Prediction Using Ensemble Learning Models: A Comprehensive Approach. Journal of Communication Engineering & Systems. 2025; 15(03):26-33. Available from: https://journals.stmjournals.com/joces/article=2025/view=228102


References

  1. Sharma A, Sharma N, Kaushik I, Kumar S, Khatoon N. Predictive analysis of type 2 diabetes using hybrid ML model and IoT. In: IoT security paradigms and applications. CRC Press; 2020 Oct 7; 303–320.
  2. El Hamdaoui H, Boujraf S, El Houda Chaoui N, Alami B, Maaroufi M. Improving Heart Disease Prediction Using Random Forest and AdaBoost Algorithms. Int J Online Biomed Eng. 2021 Nov 1; 17(11): 60–75.
  3. Yurttakal AH, Erbay H, İkizceli T, Karaçavuş S, Biçer C. Diagnosing breast cancer tumors using stacked ensemble model. J Intell Fuzzy Syst. 2021 Dec 31; 42(1): 77–85.
  4. Khan M, Zaman A, Khan SS, Arshad M. A hybrid approach for automatic segmentation and classification to detect tuberculosis. Digit Health. 2024 Aug; 10: 20552076241271869.
  5. Makka S, Reddy VN, Gnaneshwar R, Kumar MA. AI-Powered Alzheimer’s Prediction System using Deep Learning for Early Diagnosis. In 2024 IEEE 4th International Conference on Advancement in Electronics & Communication Engineering (AECE). 2024 Nov 22; 1169–1173.
  6. Tiwari A, Gupta AK, Gupta T. A robust approach to shear strength prediction of reinforced concrete deep beams using ensemble learning with SHAP interpretability. Soft Comput. 2024 Apr; 28(7): 6343–65.
  7. Zhou ZH. Ensemble methods: foundations and algorithms. CRC press; 2025 Feb 15.
  8. Dietterich TG. Ensemble methods in machine learning. In International workshop on multiple classifier systems. Berlin, Heidelberg: Springer Berlin Heidelberg; 2000 Jun 21; 1–15.
  9. Breiman L. Random forests. Mach Learn. 2001 Oct; 45(1): 5–32.
  10. Friedman JH. Greedy function approximation: a gradient boosting machine. Ann Statist. 2001 Oct 1; 29(5): 1189–232.
  11. Godase MV, Mulani A, Ghodak R, Birajadar G, Takale S, Kolte M. A MapReduce and Kalman filter based secure IIoT environment in Hadoop. Sanshodhak. 2024 Jun; 25: 38–47.
  12. Gadade B, Mulani AO, Harale AD. IoT Based Smart School Bus and Student Tracking System. Sanshodhak. 2024 Jun; 19.
  13. Dhanawadel A, Mulani AO, Pise AC. IOT based Smart farming using Agri BOT. Sanshodhak. 2024 Jun; 26: 117–125.
  14. Mulani A, Mane PB. DWT based robust invisible watermarking. Scholars’ Press; 2016.
  15. Tiple AH, Wadhel VB, Sawant HS, Sawant TT, Sawant SS. Design of surveillance-based quadcopter using Arduino. SSRG Int J Electr Electron Eng. 2019; 6(3): 1–4.
  16. Champaty B, Nayak SK, Thakur G, Mohapatra B, Tibarewala DN, Pal K. Development of Bluetooth, Xbee, and Wi-Fi-Based wireless control systems for controlling electric-powered robotic vehicle wheelchair prototype. In: Classification and Clustering in Biomedical Signal Processing. IGI Global Scientific Publishing; 2016; 356–387.
  17. Swami SS, Mulani AO. An efficient FPGA implementation of discrete wavelet transform for image compression. In 2017 IEEE International Conference on Energy, Communication, Data Analytics and Soft Computing (ICECDS). 2017 Aug 1; 3385–3389.
  18. Mane PB, Mulani AO. High speed area efficient FPGA implementation of AES algorithm. Int J Reconfigurable Embed Syst. 2018 Nov; 7(3): 157–65.
  19. Mulani AO, Mane PB. Area efficient high speed FPGA based invisible watermarking for image authentication. Indian J Sci Technol. 2016 Oct; 9(39): 1–6.
  20. Kashid MM, Karande KJ, Mulani AO. IoT-based environmental parameter monitoring using machine learning approach. In Proceedings of the International Conference on Cognitive and Intelligent Computing: ICCIC 2021, Vol. 1. Singapore: Springer Nature Singapore; 2022 Nov 1; 43–51.
  21. Nagane UP, Mulani AO. Moving object detection and tracking using Matlab. Journal of Science and Technology (JST). 2021; 6(1): 63–66.
  22. Kulkarni PR, Mulani AO, Mane PB. Robust invisible watermarking for image authentication. In Emerging Trends in Electrical, Communications and Information Technologies: Proceedings of ICECIT-2015. Singapore: Springer Singapore; 2016 Nov 15; 193–200.
  23. Ghodake MR, Mulani MA. Sensor based automatic drip irrigation system. Journal for Research. 2016 Apr; 2(02): 53–56.
  24. Mandwale AJ, Mulani AO. Different approaches for implementation of viterbi decoder on reconfigurable platform. In 2015 IEEE International Conference on Pervasive Computing (ICPC). 2015 Jan 8; 1–4.
  25. Shinde G, Mulani A. A robust digital image watermarking using DWT-PCA. Int J Innov Eng Res Technol. 2019 Apr; 6(4): 1–7.
  26. Mulani AO, Mane PB. Area optimization of cryptographic algorithm on less dense reconfigurable platform. In 2014 IEEE International Conference on Smart Structures and Systems (ICSSS). 2014 Oct 9; 86–89.
  27. Jadhav HM, Mulani A, Jadhav MM. Design and development of chatbot based on reinforcement learning. IEEE Machine Learning Algorithms for Signal and Image Processing. 2022 Dec 13; 219–29.
  28. Mulani AO, Mane P. Secure and area efficient implementation of digital image watermarking on reconfigurable platform. Int J Innov Technol Explor Eng. 2018 Dec; 8(2): 56–61.
  29. Kalyankar PA, Mulani AO, Thigale SP, Chavhan PG, Jadhav MM. Scalable face image retrieval using AESC technique. J Algebr Stat. 2022 Jul 2; 13(3): 173–6.
  30. Karande KJ, Talbar SN. Face recognition under variation of pose and illumination using independent component analysis. ICGST-GVIP. 2008 Dec; 8(4): 1–6.
  31. Bokefode Jayant D, Ubale Swapnaja A, Pingale Subhash V, Karande Kailash J, Apate Sulabha S. Developing secure cloud storage system by applying AES and RSA cryptography algorithms with role based access control model. Int J Comput Appl. 2015 May; 118(12): 46–52.
  32. Kawathekar PP, Karande KJ. Severity analysis of Osteoarthritis of knee joint from X-ray images: A Literature review. In 2014 IEEE International Conference on Signal propagation and computer technology (ICSPCT 2014). 2014 Jul 12; 648–652.
  33. Daithankar MV, Karande KJ, Harale AD. Analysis of skin color models for face detection. In 2014 IEEE International Conference on Communication and Signal Processing. 2014 Apr 3; 533–537.
  34. Gangonda SS, Patavardhan PP, Karande KJ. VGHN: variations aware geometric moments and histogram features normalization for robust uncontrolled face recognition. Int J Inf Technol. 2022 Jun; 14(4): 1823–34.
  35. Jadhav GR, Karande KJ. Automatic vehicle number plate recognition for vehicle parking management system. Computer Engineering and Intelligent Systems (CEIS). 2014 Apr; 5(11): 25–29. ISSN: 2222-1719.
  36. Karande KJ. Multiscale wavelet based edge detection and Independent Component Analysis (ICA) for Face Recognition. In 2012 IEEE International Conference on Communication, Information & Computing Technology (ICCICT). 2012 Oct 19; 1–5.
  37. Ingole AL, Karande KJ. Automatic age estimation from face images using facial features. In 2018 IEEE Global Conference on Wireless Computing and Networking (GCWCN). 2018 Nov 23; 104–108.
Regular Issue Subscription Review Article
Volume 15
Issue 03
Received 11/07/2025
Accepted 04/09/2025
Published 22/09/2025
Publication Time 73 Days
156

Login


My IP

PlumX Metrics