Literature Review of Face Recognition for Degraded Images
DOI:
https://doi.org/10.58564/IJSER.3.3.2024.233Keywords:
Active Appearance Models (AAMs), Convolutional Neural Networks (CNNs), Face recognition, Noise, Viola-Jones algorithmAbstract
Face recognition technology is a biometric method used to identify or verify individuals by their facial characteristics. It is widely used in commercial and law enforcement applications, such as surveillance systems, passport verification, security systems, and human-machine interaction. However, face recognition challenges such as noise, image deterioration, corruption, and external elements. To improve face recognition accuracy in noisy environments, noise reduction techniques, and robust representation learning methods are needed. This study attempts to clarify on Active Appearance Models, Viola-Jones, and Convolutional Neural Networks algorithms which have been used in literature studies, as well, provide the issues by organizing the abundance of articles and information in this field to highlight current research trends, and provides an outline of their advantages and disadvantages.
References
S. M. Bah and F. Ming, “An improved face recognition algorithm and its application in attendance management system,” Array, vol. 5, no. 100014, p. 100014, Mar. 2020, https://doi.org/10.1016/j.array.2019.100014.
M. AImran, M. S U Miah, H. Rahman, A. Bhowmik, and D. Karmaker, “Face Recognition using Eigenfaces,” International Journal of Computer Applications, vol. 118, no. 5, pp. 12–16, May 2015, https://doi.org/10.5120/20740-3119.
D. Kuzum, S. Yu, and H-S. Philip Wong, “Synaptic electronics: materials, devices and applications,” Nanotechnology, vol. 24, no. 38, p. 382001, Sep. 2013, https://doi.org/10.1088/0957-4484/24/38/382001.
N. Mishra, H. Karthikeyan, and T. Jayantix, “Face Recognition System for Real Life Applications using Augmentation Techniques,” Journal of Innovative Image Processing, vol. 5, no. 1, pp. 47–58, Mar. 2023, https://doi.org/10.36548/jiip.2023.1.004.
L. Wang. “Protection of personal information in the application environment of face recognition technology,” The Frontiers of Society Science and Technology, vol. 5, no. 15, Jan. 2023, https://doi.org/10.25236/fsst.2023.051512.
Global Facial Recognition Market Size, Report Id: KBV-22206, 2024, https://www.kbvresearch.com/facial-recognition-market/.
H. Ali, M. Hariharan, Abdul Hamid Adom, Siti Khadijah Zaaba, M. Elshaikh, and Sazali Yaacob, “Facial emotion recognition under noisy environment using empirical mode decomposition,” Aug. 2016, https://doi.org/10.1109/iced.2016.7804691.
None Waleed Ayad, None Siraj Qays, and None Ali Al-Naji, “Generating and Improving a Dataset of Masked Faces Using Data Augmentation,” Journal of techniques, vol. 5, no. 2, pp. 46–51, Jun. 2023, https://doi.org/10.51173/jt.v5i2.1140.
B. Ma, G. Song, B. Liu, and Y. Liu, “Rethinking Robust Representation Learning Under Fine-grained Noisy Faces,” arXiv (Cornell University), Aug. 2022, https://doi.org/10.48550/arxiv.2208.04352.
Lukas Lamminger, H. Hofbauer, and A. Uhl, “First Learning Steps to Recognize Faces in the Noise,” Jun. 2023, https://doi.org/10.1145/3577163.3595105.
B. Fella, Hedli Riadh, and Kara-Mohamed Chafia, “Adaptive Diffusion Based Restoration for Noisy Facial Image Recognition,” May 2022, https://doi.org/10.1109/setit54465.2022.9875579.
M. De Marsico, M. Nappi, D. Riccio, and H. Wechsler, “Robust Face Recognition for Uncontrolled Pose and Illumination Changes,” IEEE Transactions on Systems, Man, and Cybernetics: Systems, vol. 43, no. 1, pp. 149–163, Jan. 2013, https://doi.org/10.1109/tsmca.2012.2192427.
W. Zhang, X. Zhao, J.-M. Morvan, and L. Chen, “Improving Shadow Suppression for Illumination Robust Face Recognition,” vol. 41, no. 3, pp. 611–624, Mar. 2019 https://doi.org/10.1109/tpami.2018.2803179.
R. Patel, N. Rathod, and A. Shah, “Comparative Analysis of Face Recognition Approaches: A Survey,” International Journal of Computer Applications, vol. 57, no. 17, pp. 50–69, Nov. 2012, https://doi.org/10.5120/9210-3756.
S. Ohlyan, Sunita Sangwan, and T. Ahuja, “A Survey On Various Problems & Challenges in Face Recognition,” International journal of engineering research and technology, vol. 2, no. 6, Jun. 2013.
P. Li, L. Prieto, D. Mery, and P. Flynn, “Face Recognition in Low Quality Images: A Survey,” arXiv.org, Mar. 28, 2019, https://arxiv.org/abs/1805.11519.
Nada Jasmin Habib, “Performance Enhancement of Face Recognition under High-Density Noise Using PCA and De-Noising Technique,” Ibn Al-Haitham Journal for Pure and Applied Science, vol. 33, no. 4, pp. 148–148, Oct. 2020, https://doi.org/10.30526/33.4.2527.
Rusul Basheer Khazal and Nada Jasim Habeeb, “Enhancement Infrared-Visible Image Fusion Using the Integration of Stationary Wavelet Transform and Fuzzy Histogram Equalization,” Journal of Techniques, vol. 4, no. 4, pp. 119–127, Dec. 2022, https://doi.org/10.51173/jt.v4i4.700.
R. M. Ismael and W. A. Araheemah “Compare Some Classification Methods for COVID-19 Identification with Application”, Journal of Techniques, Vol. 4, No. 4, pp.228-236, Dec.2022, https://doi.org/10.51173/jt.v4i4.614.
Muhammad Aurangzeb Khan, Costas Xydeas, and H. Ahmed, “On the application of AAM-based systems in face recognition,” pp. 2445–2449, Nov. 2014, https://doi.org/10.5281/zenodo.44192.
M. Iqtait, F. S. Mohamad, and M. Mamat, “Feature extraction for face recognition via Active Shape Model (ASM) and Active Appearance Model (AAM),” IOP Conference Series: Materials Science and Engineering, vol. 332, p. 012032, Mar. 2018, https://doi.org/10.1088/1757-899x/332/1/012032.
N. Zeng, H. Zhang, B. Song, W. Liu, Y. Li, and A. M. Dobaie, “Facial expression recognition via learning deep sparse autoencoders,” Neurocomputing, vol. 273, pp. 643–649, Jan. 2018, https://doi.org/10.1016/j.neucom.2017.08.043.
Y. Peng and H. Yin, “Facial expression analysis and expression-invariant face recognition by manifold-based synthesis,” Machine Vision and Applications, vol. 29, no. 2, pp. 263–284, Dec. 2017, https://doi.org/10.1007/s00138-017-0895-6.
Y. Rao, J. Lu, and J. Zhou, “Learning Discriminative Aggregation Network for Video-Based Face Recognition and Person Re-identification,” International Journal of Computer Vision, vol. 127, no. 6–7, pp. 701–718, Jun. 2019, https://doi.org/10.1007/s11263-018-1135-x.
D. Algarni, G. El Banby, S. Ismail, W. El-Shafai, F. E. A. El-Samie, and N. F. Soliman, “Discrete Transforms and Matrix Rotation Based Cancelable Face and Fingerprint Recognition for Biometric Security Applications,” Entropy, vol. 22, no. 12, p. 1361, Dec. 2020, https://doi.org/10.3390/e22121361.
X. Tu et al., “Joint Face Image Restoration and Frontalization for Recognition,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 32, no. 3, pp. 1285–1298, Mar. 2022, https://doi.org/10.1109/tcsvt.2021.3078517.
P. Shanthi and S. Nickolas, “An efficient automatic facial expression recognition using local neighborhood feature fusion,” Multimedia Tools and Applications, Nov. 2020, https://doi.org/10.1007/s11042-020-10105-2.
J. Kommineni, S. Mandala, M. S. Sunar, and P. M. Chakravarthy, “Accurate computing of facial expression recognition using a hybrid feature extraction technique,” The Journal of Supercomputing, vol. 77, no. 5, pp. 5019–5044, Oct. 2020, https://doi.org/10.1007/s11227-020-03468-8.
Y. Mi et al., “DuetFace: Collaborative Privacy-Preserving Face Recognition via Channel Splitting in the Frequency Domain,” Proceedings of the 30th ACM International Conference on Multimedia, Oct. 2022, https://doi.org/10.1145/3503161.3548303.
T. Shreekumar et al. “Blur and Noise Removal from the Degraded Face Images for Identifying the Faces Using Deep Learning Networks”, In international Conference on Artificial Intelligence and Sustainable Engineering, Lecture Notes in Electrical Engineering, vol 837, Springer, Singapore,2022, pp.325-341, https://doi.org/10.1007/978-981-16-8546-0_27.
P. Viola and M. Jones, “Rapid object detection using a boosted cascade of simple features,” Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001, vol. 1, 2001, https://doi.org/10.1109/cvpr.2001.990517.
D. M. Abdulhussien and L. J. Saud, “evaluation study of face detection by Viola-Jones algorithm,” International journal of health sciences, pp. 4174–4182, Sep. 2022, https://doi.org/10.53730/ijhs.v6ns8.13127.
Hadhami Aouani and Yassine Ben Ayed, “Facial expression detection using Viola-Jones algorithm in the learning environment,” Research Square (Research Square), Apr. 2023, https://doi.org/10.21203/rs.3.rs-2822747/v1.
R. D. Praia etal, “Attendance Automation System with Facial Authorization and Body Temperature Using Cloud Based Viola-Jones Face Recognition Algorithm “, In conf. hybrid Intelligent Systems, HIS 2022, Lecture Notes in Networks and Systems, vol 647. Springer, Cham,2022, pp.991-1001, https://doi.org/10.1007/978-3-031-27409-1_91.
P. Irgens, C. Bader, T. Lé, D. Saxena, and C. Ababei, “An efficient and cost effective FPGA based ola-Jones. face detection algorithm,” HardwareX, vol. 1, pp. 68–75, Apr. 2017, https://doi.org/10.1016/j.ohx.2017.03.002
N. H. Barnouti, M. H. N. Al-Mayyahi, and S. S. M. Al-Dabbagh, “Real-Time Face Tracking and Recognition System Using Kanade-Lucas-Tomasi and Two-Dimensional Principal Component Analysis,” IEEE Xplore, Oct. 01, 2018. https://ieeexplore.ieee.org/document/8548818 (accessed May 11, 2023), https://doi.org/10.1109/ICOASE.2018.8548818.
Fakhri, A. Shahrizan, Muhammad Aizzat Zakaria, A. Majeed, and Ahmad Najmuddin Ibrahim, “Automated Face Detection Using Skin Color Segmentation and Viola-Jones Algorithm,” vol. 1, no. 1, pp. 58–63, Jan. 2019.
R. I. Bendjillali, M. Beladgham, K. Merit, and A. Taleb-Ahmed, “Illumination-robust face recognition based on deep convolutional neural networks architectures,” Indonesian Journal of Electrical Engineering and Computer Science, vol. 18, no. 2, p. 1015, May 2020, https://doi.org/10.11591/ijeecs.v18.i2.pp1015-1027.
Y. Xiao, D. Cao, and L. Gao, “Face detection based on occlusion area detection and recovery,” Multimedia Tools and Applications, vol. 79, no. 23–24, pp. 16531–16546, May 2019, https://doi.org/10.1007/s11042-019-7661-x.
M. Fakhrul Hirzi, Syahril Efendi, and Rahmat Widia Sembiring, “Literature Study of Face Recognition using The Viola-Jones Algorithm,” Apr. 2021, https://doi.org/10.1109/aims52415.2021.9466010.
L. Yadav, Raj Kumar Yadav, and V. Kumar, “An Efficient Approach towards Face Recognition using Deep Reinforcement Learning, Viola Jones and K-nearest neighbor,” Sep. 2021, https://doi.org/10.1109/access51619.2021.9563326.
Y. S and N. Purnachand, “Convolutional neural network-based face recognition using non-subsampled shearlet transform and histogram of local feature descriptors,” IAES International Journal of Artificial Intelligence (IJ-AI), vol. 10, no. 4, p. 1079, Dec. 2021, https://doi.org/10.11591/ijai.v10.i4.pp1079-1090.
S. Ashor and H. M. Ahmed “Applying Gamma and Histogram Equalization Algorithms for Improving System-performance of Face Recognition-based CNN”, Iraqi Journal of Computer, Communication, Control and System Engineering, pp. 108–117, Mar. 2022, https://doi.org/10.33103/uot.ijccce.22.1.11.
S. Sunardi, A. Yudhana, and S. A. Wijaya, “Face Detection Analysis of Digital Photos Using Mean Filtering Method,” International Journal of Artificial Intelligence Research, vol. 6, no. 2, Jul. 2022, https://doi.org/10.29099/ijair.v6i2.307.
Verry Noval Kristanto, Imam Riadi, and Yudi Prayudi, “Forensic Analysis of Faces on Low-Quality Images using Detection and Recognition Methods,” Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi), vol. 7, no. 2, pp. 218–225, Mar. 2023, https://doi.org/10.29207/resti.v7i2.4630.
None Julham, S. S. T. Hutagalung, K. C. Simalango, and S. Lumbantobing, “The Effectiveness of Opens Based Face Detection In Low-Light Environments,” JITE (Journal of Informatics and Telecommunication Engineering), vol. 7, no. 1, pp. 209–220, Jul. 2023, https://doi.org/10.31289/jite.v7i1.9851.
Z. Song and Y. Yu, “A study of convolutional neural networks in face recognition,” International Conference on Computer Graphics, Artificial Intelligence, and Data Processing (ICCAID 2021), Mar. 2022, https://doi.org/10.1117/12.2631168.
None Hasanain A. Ajjah, A. H. H. Alboabidallah, M. U. Mohammed, and A. Hussain, “Modelling and Estimation of Interior Orientation of Non-Metric Cameras using Artificial Intelligence,” Journal of techniques, vol. 5, no. 2, pp. 39–45, Jun. 2023, https://doi.org/10.51173/jt.v5i2.950.
Y.-X. Yang, C. Wen, K. Xie, F.-Q. Wen, G.-Q. Sheng, and X.-G. Tang, “Face Recognition Using the SR-CNN Model,” Sensors, vol. 18, no. 12, p. 4237, Dec. 2018, https://doi.org/10.3390/s18124237.
J. Li, T. Qiu, C. Wen, K. Xie, and F.-Q. Wen, “Robust Face Recognition Using the Deep C2D-CNN Model Based on Decision-Level Fusion,” Sensors, vol. 18, no. 7, p. 2080, Jun. 2018, https://doi.org/10.3390/s18072080.
R. Dian, S. Li, and X. Kang, “Regularizing Hyperspectral and Multispectral Image Fusion by CNN Denoiser,” IEEE transactions on neural networks and learning systems, vol. 32, no. 3, pp. 1124–1135, Mar. 2021, https://doi.org/10.1109/tnnls.2020.2980398.
R. Silwal, A. Alsadoon, P. W. C. Prasad, O. H. Alsadoon, and A. Al-Qaraghuli, “A novel deep learning system for facial feature extraction by fusing CNN and MB-LBP and using enhanced loss function,” Multimedia Tools and Applications, vol. 79, no. 41–42, pp. 31027–31047, Aug. 2020, https://doi.org/10.1007/s11042-020-09559-1.
Y. Zhang et al., “Global-Local GCN: Large-Scale Label Noise Cleansing for Face Recognition,” Jun. 2020, https://doi.org/10.1109/cvpr42600.2020.00775.
N. K. Mishra, M. Dutta, and S. K. Singh, “Multiscale parallel deep CNN (mpdCNN) architecture for the real low-resolution face recognition for surveillance,” Image and Vision Computing, vol. 115, p. 104290, Nov. 2021, https://doi.org/10.1016/j.imavis.2021.104290.
N. K. Mishra, M. Dutta, and S. K. Singh, “Multiscale parallel deep CNN (mpdCNN) architecture for the real low-resolution face recognition for surveillance,” Image and Vision Computing, vol. 115, p. 104290, Nov. 2021, https://doi.org/10.1016/j.imavis.2021.104290.
Y. Quan, Y. Chen, Y. Shao, H. Teng, Y. Xu, and H. Ji, “Image denoising using complex-valued deep CNN,” Pattern Recognition, vol. 111, p. 107639, Mar. 2021, https://doi.org/10.1016/j.patcog.2020.107639.
S. Xie, J. Song, Y. Hu, C. Zhang, and S. Zhang, “Using CNN with Multi-Level Information Fusion for Image Denoising,” Electronics, vol. 12, no. 9, pp. 2146–2146, May 2023, https://doi.org/10.3390/electronics12092146.
I. Jabbooree, L. M. Khanli, P. Salehpour, and S. Pourbahrami, “A novel facial expression recognition algorithm using geometry β –skeleton in fusion based on deep CNN,” Image and Vision Computing, vol. 134, p. 104677, Jun. 2023, https://doi.org/10.1016/j.imavis.2023.104677.
R. Kumar, S. N, M. Priyadharshini, D. G. E, and K. R. M, “Face recognition using CNN and siamese network,” Measurement: Sensors, vol. 27, p. 100800, Jun. 2023, https://doi.org/10.1016/j.measen.2023.100800.
R. Xu et al., “Depth Map Denoising Network and Lightweight Fusion Network for Enhanced 3D Face Recognition,” Pattern Recognition, vol. 145, pp. 109936–109936, Jan. 2024, https://doi.org/10.1016/j.patcog.2023.109936.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Muthanna Qahtan Ismael , Nada Jasim Habeeb , Alla Hussein Ansaf
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.