Comparison and Analysis of Facial Emotion Detection Using Various Deep Learning Neural Networks

Year : 2025 | Volume : 12 | Issue : 02 | Page : 37 42
    By

    V. Anusuya,

  • S. Sakkaravarthi,

  • M. Rethinakumari,

  • Sridhar S.,

  1. Associate Professor, Department of Information Technology, Ramco institute of Technology, Rajapalayam, Tamil Nadu, India
  2. Associate Professor, Department of Information Technology, Ramco institute of Technology, Rajapalayam, Tamil Nadu, India
  3. Associate Professor, Department of Information Technology, Ramco institute of Technology, Rajapalayam, Tamil Nadu, India
  4. Student, Department of Information Technology, Ramco institute of Technology, Rajapalayam, Tamil Nadu, India

Abstract

Facial emotion recognition employs Convolutional Neural Networks (CNNs), Residual Networks (ResNet), Long Short-Term Memory (LSTM) networks, and Deep Neural Networks (DNNs) to automatically identify various emotions, including disgust, anger, fear, happiness, sadness, surprise, and neutrality. This study utilizes transfer learning along with data preprocessing techniques such as rotation, flipping, brightness adjustment, and enhancement methods. Traditional machine learning models achieve an accuracy range of 45 to 50%. In contrast, our proposed CNN and DNN models show improved accuracy, reaching 65 and 62%, respectively. Additionally, we introduce a hybrid model combining ResNet and LSTM architecture, which achieves an accuracy of 72%. Following this, we conduct a comparative analysis of the accuracy and loss for each model. Our findings indicate that while CNNs initially demonstrated higher accuracy than the hybrid ResNet-LSTM model, the hybrid model ultimately surpassed all others in total classification accuracy. The performance metrics used in this analysis include recall and precision.

Keywords: Facial emotion recognition (FER), neural networks, convolutional neural networks (CNNs), residual networks (ResNet), long short-term memory (LSTM)

[This article belongs to Journal of Image Processing & Pattern Recognition Progress ]

How to cite this article:
V. Anusuya, S. Sakkaravarthi, M. Rethinakumari, Sridhar S.. Comparison and Analysis of Facial Emotion Detection Using Various Deep Learning Neural Networks. Journal of Image Processing & Pattern Recognition Progress. 2025; 12(02):37-42.
How to cite this URL:
V. Anusuya, S. Sakkaravarthi, M. Rethinakumari, Sridhar S.. Comparison and Analysis of Facial Emotion Detection Using Various Deep Learning Neural Networks. Journal of Image Processing & Pattern Recognition Progress. 2025; 12(02):37-42. Available from: https://journals.stmjournals.com/joipprp/article=2025/view=208926


References

  1. Yaddaden Y. An efficient facial expression recognition system with appearance-based fused descriptors. Intell Syst Appl. 2023 Feb 1; 17: 200166.
  2. Gupta S, Kumar P, Tekchandani RK. Facial emotion recognition based real-time learner engagement detection system in online learning context using deep learning models. Multimed Tools Appl. 2023 Mar; 82(8): 11365–94.
  3. Dias W, Andalo F, Padilha R, Bertocco G, Almeida W, Costa P, Rocha A. Cross-dataset emotion recognition from facial expressions through convolutional neural networks. J Vis Commun Image Represent. 2022 Jan 1; 82: 103395.
  4. Sajjad M, Ullah FU, Ullah M, Christodoulou G, Cheikh FA, Hijji M, Muhammad K, Rodrigues JJ. A comprehensive survey on deep facial expression recognition: challenges, applications, and future guidelines. Alex Eng J. 2023 Apr 1; 68: 817–40.
  5. Meena G, Mohbey KK, Indian A. Categorizing sentiment polarities in social networks data using convolutional neural network. SN Comput Sci. 2022 Mar; 3(2): 116.
  6. Castellano G, De Carolis B, Macchiarulo N. Automatic facial emotion recognition at the COVID-19 pandemic time. Multimed Tools Appl. 2023 Apr; 82(9): 12751–69.
  7. Elsheikh RA, Mohamed MA, Abou-Taleb AM, Ata MM. Improved facial emotion recognition model based on a novel deep convolutional structure. Sci Rep. 2024 Nov 23; 14(1): 29050.
  8. Kim JC, Kim MH, Suh HE, Naseem MT, Lee CS. Hybrid approach for facial expression recognition using convolutional neural networks and SVM. Appl Sci. 2022 May 28; 12(11): 5493.
  9. Li B, Lima D. Facial expression recognition via ResNet-50. International Journal of Cognitive Computing in Engineering (IJCCE). 2021 Jun 1; 2: 57–64.
  10. Shehu HA, Sharif MH, Uyaver S. Facial expression recognition using deep learning. In AIP Conf Proc. 2021 Mar 2; 2334(1): 070003. AIP Publishing.

Regular Issue Subscription Original Research
Volume 12
Issue 02
Received 06/03/2025
Accepted 06/04/2025
Published 28/04/2025
Publication Time 53 Days


Login


My IP

PlumX Metrics