Detection and Classification Expression of Visual Information Based on Artificial Intelligent Review Work
DOI:
https://doi.org/10.58564/IJSER.3.4.2024.277Keywords:
Emotion Expression, Face Detection, Human Emotion Analysis, CNN Algorithm, Static and Dynamic expressionAbstract
Human Emotion Expression is difficult to define and categorize, making it a difficult research topic. Teaching machines to decipher facial expressions is difficult. Dynamic facial expressions include modest muscular movements that shape their appearance. Advanced algorithms and methods are needed to capture and analyze these minute differences. Deep learning's popularity has expanded emotion recognition applications. The ability to recognize facial expressions has several practical uses. In the medical field, it can help doctors better understand their patients' mental health issues and formulate effective treatment plans. Emotion recognition may be used in the field of customer service to get a feel for how satisfied customers are and adjust strategies accordingly. User experiences may be improved through human-computer interaction when emotion detection allows for more natural and individualized interactions with technology. Gaming and entertainment could employ emotional reaction recognition to tailor and engage players based on their moods. Emotion detection can also improve situational awareness and identify high-stress situations in law enforcement and security. Recognition of pupils' facial expressions can assist teachers in improving classroom instruction and comprehending their emotions. Deep learning models provide an advantage over prior emotion-recognition systems, but they need additional research for high-robust expression detection.
References
E. Goceri, "Deep learning based classification of facial dermatological disorders," Comput Biol Med, vol. 128, 2021, doi: 10.1016/j.compbiomed.2020.104118.
K. Chlasta, K. Wołk, and I. Krejtz, "Automated speech-based screening of depression using deep convolutional neural networks," Procedia Computer Science, vol. 164, pp. 618–628, 2019, doi: 10.1016/j.procs.2019.12.228.
W. H. Abdulsalam, R. S. Alhamdani, and M. N. Abdullah, "Facial emotion recognition from videos using deep convolutional neural networks," Int J Mach Learn Comput, vol. 9, no. 1, pp. 14–19, 2019, doi: 10.18178/ijmlc.2019.9.1.759.
D. A. S. Devi, C. Satyanarayana, and D. S. Rekha, "Facial Emotion Recognition Using Hybrid Approach for DCT and DBACNN," in Lecture Notes in Electrical Engineering, Springer Science and Business Media Deutschland GmbH, 2022, pp. 411–423. doi: 10.1007/978-981-16-9885-9_34.
N. C. Ristea, L. C. Dutu, and A. Radoi, "Emotion recognition system from speech and visual information based on convolutional neural networks," in 2019 10th International Conference on Speech Technology and Human-Computer Dialogue, SpeD 2019, Institute of Electrical and Electronics Engineers Inc., Oct. 2019. doi: 10.1109/SPED.2019.8906538.
E. Ryumina and A. Karpov, "Facial expression recognition using distance importance scores between facial landmarks," in CEUR Workshop Proceedings, CEUR-WS, 2020. doi: 10.51130/graphicon-2020-2-3-32.
Z. Wang et al., "Automated Rest EEG-Based Diagnosis of Depression and Schizophrenia Using a Deep Convolutional Neural Network," IEEE Access, vol. 10, 2022, doi: 10.1109/ACCESS.2022.3197645.
B. Victor, K. Bowyer, and S. Sarkar, "An evaluation of face and ear biometrics," Proceedings - International Conference on Pattern Recognition, vol. 16, no. 1, 2002, doi: 10.1109/icpr.2002.1044746.
Y. Ma, Z. Huang, X. Wang, and K. Huang, "An Overview of Multimodal Biometrics Using the Face and Ear," Mathematical Problems in Engineering, vol. 2020. 2020. doi: 10.1155/2020/6802905.
A. Savran, N. Alyüz, H. Dibeklioğlu, O. Çeliktutan, B. Gökberk, B. Sankur, and L. Akarun, "Bosphorus database for 3D face analysis," in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2008. doi: 10.1007/978-3-540-89991-4_6.
J. Sujanaa, S. Palanivel, and M. Balasubramanian, "Emotion recognition using support vector machine and one-dimensional convolutional neural network," Multimed Tools Appl, vol. 80, no. 18, pp. 27171–27185, Jul. 2021, doi: 10.1007/s11042-021-11041-5.
F. Zamani and R. Wulansari, "Emotion Classification using 1D-CNN and RNN based On DEAP Dataset," Academy and Industry Research Collaboration Center (AIRCC), Dec. 2021, pp. 363–378. doi: 10.5121/csit.2021.112328.
P. V. V. S. Srinivas and P. Mishra, "Human Emotion Recognition by Integrating Facial and Speech Features: An Implementation of Multimodal Framework using CNN," International Journal of Advanced Computer Science and Applications, vol. 13, no. 1, 2022, doi: 10.14569/ijacsa.2022.0130172.
K. Kumar, R. K. Mishra, and D. Nandan, "Efficient Hardware of RGB to Gray Conversion Realized on FPGA and ASIC," in Procedia Computer Science, 2020. doi: 10.1016/j.procs.2020.04.215.
H. Mutahira, B. Ahmad, M. S. Muhammad, and D. R. Shin, "Focus Measurement in Color Space for Shape from Focus Systems," IEEE Access, vol. 9, 2021, doi: 10.1109/ACCESS.2021.3098753.
S. Sood, H. Singh, and M. Malarvel, "Image quality enhancement for Wheat rust diseased images using Histogram equalization technique," 2021 5th International Conference on Computing Methodologies and Communication (ICCMC), Apr. 2021, doi: 10.1109/iccmc51019.2021.9418023.
H. Kh. Omar and N. E. Tawfiq, “Face Recognition Based on Histogram Equalization and LBP Algorithm,” Academic Journal of Nawroz University, vol. 8, no. 3, p. 33, Aug. 2019, doi: 10.25007/ajnu.v8n3a394.
S. H. Gangolli, A. Johnson Luke Fonseca, and R. Sonkusare, "Image Enhancement using Various Histogram Equalization Techniques," 2019 Global Conference for Advancement in Technology (GCAT), Oct. 2019, doi: 10.1109/gcat47503.2019.8978413.
D. D. Olatinwo, A. Abu-Mahfouz, G. Hancke, and H. Myburgh, "IoT-Enabled WBAN and Machine Learning for Speech Emotion Recognition in Patients," Sensors, vol. 23, no. 6, p. 2948, Mar. 2023, doi: 10.3390/s23062948.
A. S. A. Hans and S. Rao, "A CNN-LSTM based deep neural networks for facial emotion detection in videos," International Journal of Advances in Signal And Image Sciences, vol. 7, no. 1, pp. 11–20, Mar. 2021, doi: 10.29284/ijasis.7.1.2021.11-20.
Christy, A., Vaithyasubramanian, S., Jesudoss, A., & Praveena, M. A. (2020). "Multimodal speech emotion recognition and classification using convolutional neural network techniques". International Journal of Speech Technology, 23(2), 381-388.
V. John and Y. Kawanishi, "Audio and Video-based Emotion Recognition using Multimodal Transformers," in Proceedings - International Conference on Pattern Recognition, Institute of Electrical and Electronics Engineers Inc., 2022, pp. 2582–2588. doi: 10.1109/ICPR56361.2022.9956730.
Z. Dahirou, M. Zheng, and M. Yuxin, "Face Detection with Viola Jones Algorithm," 2020 7th International Conference on Information Science and Control Engineering (ICISCE), Dec. 2020, doi: 10.1109/icisce50968.2020.00130.
P. Xayachack and J. Zhang, "Robust Face detection based on Viola-jones Algorithms," IOP Conference Series: Materials Science and Engineering, vol. 768, no. 6, p. 062079, Mar. 2020, d899x/768/6/062079.oi: 10.1088/1757.
J. Huang, Y. Shang, and H. Chen, "Improved Viola-Jones face detection algorithm based on HoloLens," EURASIP J Image Video Process, vol. 2019, no. 1, 2019, doi: 10.1186/s13640-019-0435-6.
"Comparative of Viola-Jones and YOLO v3 for Face Detection in Real time," Iraqi Journal of Computer, Communication, Control and System Engineering, 2022, doi: 10.33103/uot.ijccce.22.2.6.
A. Jadhav, S. Lone, S. Matey, T. Madamwar, and S. Jakhete, "Survey on Face Detection Algorithms," Int J Innov Sci Res Technol, vol. 6, no. 2, 2021.
V. Upadhyay and D. Kotak, "A Review on Different Facial Feature Extraction Methods for Face Emotions Recognition System," 2020 Fourth International Conference on Inventive Systems and Control (ICISC), Jan. 2020, doi: 10.1109/icisc47916.2020.9171172.
M. Moe Htay, "Feature extraction and classification methods of facial expression: a survey," Computer Science and Information Technologies, vol. 2, no. 1, pp. 26–32, Mar. 2021, doi: 10.11591/csit.v2i1.p26-32.
P. N. Maraskolhe and A. S. Bhalchandra, "Analysis of Facial Expression Recognition using Histogram of Oriented Gradient (HOG)," 2019 3rd International conference on Electronics, Communication and Aerospace Technology (ICECA), Jun. 2019, doi: 10.1109/iceca.2019.8821814.
R. C. Ng, K. M. Lim, C. P. Lee, and S. F. A. Razak, "Surveillance system with motion and face detection using histograms of oriented gradients," Indonesian Journal of Electrical Engineering and Computer Science, vol. 14, no. 2, 2019, doi: 10.11591/ijeecs.v14.i2.pp869-876.
M. Shatnawi, N. Almenhali, M. Alhammadi, and K. Alhanaee, "Deep Learning Approach for Masked Face Identification," International Journal of Advanced Computer Science and Applications, vol. 13, no. 6, 2022, doi: 10.14569/ijacsa.2022.0130637.
F. J. Díaz-Pernas, M. Martínez-Zarzuela, D. González-Ortega, and M. Antón-Rodríguez, "A deep learning approach for brain tumor classification and segmentation using a multiscale convolutional neural network," Healthcare (Switzerland), vol. 9, no. 2, Feb. 2021, doi: 10.3390/healthcare9020153.
S. Montaha, S. Azam, A. K. M. R. H. Rafid, M. Z. Hasan, A. Karim, and A. Islam, "TimeDistributed-CNN-LSTM: A Hybrid Approach Combining CNN and LSTM to Classify Brain Tumor on 3D MRI Scans Performing Ablation Study," IEEE Access, vol. 10, 2022, doi: 10.1109/ACCESS.2022.3179577.
Downloads
Published
Issue
Section
License
Copyright (c) 2024 Nashwan J. Hussein, Amar A. Mahawish, Ibrahim Sami Attar
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
