Smart Attendance System based on improved Facial Recognition

Thai-Viet Dang

Abstract


Nowadays, the fourth industrial revolution has achieved significant advancement in high technology, in which artificial intelligence has had vigorous development. In practice, facial recognition is one most essential tasks in the field of computer vision with various potential applications from security and attendance system to intelligent services. In this paper, we propose an efficient deep learning approach to facial recognition. The paper utilizes the architecture of improved FaceNet model based on MobileNetV2 backbone with SSD subsection.  The improved architecture uses depth-wise separable convolution to reduce the model size and computational volume and achieve high accuracy and processing speed. To solve the problem of identifying a person entering and exiting an area and integrating on advanced mobile devices limits to (such as limited memory and on-device storage) highly mobile resources. Especially, our approach yields better results in practical application with more than 95% accuracy on a small dataset of the original face images. Obtained frame rate (25 FPS) is very favorable compared to the field of facial recognition using neural network. Besides, the deep learning based on solution could be applicable in many low-capacity hardware or optimize system’s resource. Finally, the smart automated attendance systems is successfully designed basing on the improved efficient facial recognition.

Keywords


Artificial intelligence; Attendance system; Facial recognition; Internet of Thing (IoT), MobileNets.

Full Text:

PDF

References


G. Hua, M. H. Yang, E. L. Miller, T. M. Ma, D. J. Kriegman, and T. S. Huang, “Introduction to the special section on real world face recognition,” IEEE Trans. Pat. Anal. Mach. Intell., vol. 33, pp. 1921-1924, 2011.

F. P. Filippidou, and G. A. Papakostas, “Single Sample Face Recognition Using Convolutional Neural Networks for Automated Attendance Systems,” 2020 Fourth Int. Conf. Intell. Comput. Data Sci. (ICDS), 2020.

M. G. M. Johar, and M. H. Alkawaz, "Student's activity management system using QR code and C4. 5 algorithm,” Int. J. Med. Toxicology & Legal Med., vol. 21, pp. 105-107, 2018.

F. Masalha, and N. Hirzallah, “A students attendance system using QR code,” Int. J. Adv. Comput. Sci. Appl., vol. 5, pp. 75-79, 2014.

O. Arulogun, A. Olatunbosun, O. Fakolujo, and O. Olaniyi, “RFID based students attendance management system,” Int. J. Sci. & Eng. Res., vol. 4, pp. 1-9, 2013.

F. Silva, V. Filipe, and A. Pereira, “Automatic control of students' attendance in classrooms using RFID,” ICSNC 08. 3rd Int. Conf. Syst. Netw., pp. 384-389, 2008.

M. Karunakar, C. A. Sai, K. Chandra, and K. A. Kumar, “Smart Attendance Monitoring System (SAMS): A Face Recognition Based Attendance System for Classroom Environment,” Int. J. Recent Develop. Sci. Technol., vol. 4, no. 5, pp. 194-201, 2020.

S. Wenhui, and J. Mingyan, “Face Recognition Based on Multi-view - Ensemble Learning,” Chin. Conf. Pat. Recognit. Comput. Vision (PRCV), pp. 127-136, 2018.

A. S. Al-Waisy, R. Qahwaji, S. Ipson, and S. Al-Fahdawi, “A Robust Face Recognition System Based on Curvelet and Fractal Dimension Transforms,” IEEE Int. Conf. Comp. Inf. Technol., pp. 548-555, 2015.

A. Fassio et al., “Prioritizing Virtual Screening with Interpretable Interaction Fingerprints,” J. Chem. Inf. Model., vol. 62, no. 18, pp. 1-53, 2022.

Y. Jiang, “Space Debris Fingerprint Definition and Identification,” The Journal of Brief Ideas, 2022.

A. B. V. Wyzykowski, M. P.Segundo, and R. D. P. Lemes “Multiresolution synthetic fingerprint generation,” IET Biometrics, vol. 11, no. 1, 2022.

W. Chunming, and Z. Ying, “MTCNN and FaceNet Based Access Control System for Face Detection and Recognition,” Autom. Control Comput. Sci., vol. 55, pp. 102-112, 2021.

A. Bochkovskiy, C.Y. Wang, and H. Liao, “YOLOv4: Optimal Speed and Accuracy of Object Detection,” arXiv preprint arXiv:2004.10934., 2020.

S. Pawar, V. Kithani, S. Ahuja, and S. Sahu, “Local Binary Patterns and Its Application to Facial Image Analysis,” 2011 Int. Conf. Recent Trends Inf. Technol. (ICRTIT), pp. 782-786, 2011.

Q. A. Shebani, “A Hybrid Feature Extraction Technique for Face Recognition,” Int. Proc. Comput. Sci. Inf. Technol., vol 3, no. 2, 2012.

A. Sharma and S. Chhabra, “A Hybrid Feature Extraction Technique for Face Recognition,” Int. J. Adv. Res. Comput. Sci. Softw. Eng., vol. 7, no. 5, pp. 341-350, 2017.

M. Mia, R. Islam, M. F. Wahid, and S. Biswas, “Image Reconstruction Using Pixel Wise Support Vector Machine SVM Classification,” Comput. Sci. Math. Int. J. Sci. Technol. Res., vol. 4, no. 2, pp. 232-235, 2015.

U. Maulik and D. Chakraborty, “Remote Sensing Image Classification: A survey of support-vector-machine-based advanced techniques,” IEEE Geosci. Remote Sens. Mag., vol. 5, no. 1, pp. 33-52, 2017.

T. V. Dang, “Smart home Management System with Face Recognition based on ArcFace model in Deep Convolutional Neural Network,” J. Robot. Control, 2022.

T. V. Dang et at., “Design of a Face Recognition Technique based MTCNN and ArcFace,” MMMS 2022, LNME, 2022.

Z. Haitao, L. Zhihui, L. Henry and Z. Xianyi, “Linear Discriminant Analysis,” Feature Learn. Understanding, pp 71-85, 2020.

F. Zuo, and P. H. N. de With, “Real-time Face Recognition for Smart Home Applications,” 2005 Digest of Tech. Papers, Int. Conf. Consum. Electron., pp. 35-36, 2005.

S. Pawar, V. Kithani, S. Ahuja, and S. Sahu, “Smart Home Security using IoT and Face Recognition,” 2018 Fourth Int. Conf. Comput. Commun. Control and Automat. (ICCUBEA), vol. 176, no. 13, pp. 45-47, 2018.

F. P. Filippidou, and G. A. Papakostas, “Single Sample Face Recognition Using Convolutional Neural Networks for Automated Attendance Systems,” 2020 Fourth Int. Conf. Intell. Comput. Data Sci. (ICDS), 2020.

A. G. Howard, M. Zhu, Bo Chen, D. Kalenichenko, W. Wang, T. Weyand, M. Andreetto, and H. Adam, "MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications," Comput. Vision Pat. Recognit., 2017.

A. Wirdiani, P. Hridayami, and A. Widiari, “Face Identification Based on K-Nearest Neighbor,” Sci. J. Inform., vol. 6, no. 2, pp. 150-159, 2019.

T. V. Dang, and D. K. Nguyen, “Research and Design the Intelligent Mechatronics system applying with face recognition and deep learning in student’s diligencet,” 7th Nat. Conf. Sci. Eng. Meas., pp. 239-246, 2020.

A. Süzen, B. Duman, and B. Sen, “Benchmark Analysis of Jetson TX2, Jetson Nano and Raspberry PI using Deep-CNN,” 2020 Int. Congr. Human-Comput. Interact. Optim. Robot. Appl. (HORA), pp. 1-5, 2020.

S. Kurzadkar, “Hotel management system using Python Tkinler GUI,” Int. J. Comput. Sci. Mobile Comput., vol. 11, no. 1, pp. 204-208, 2022.

V. Sati, S.M. Sánchez, N. Shoeibi, A. Arora, and J.M. Corchado, “Face Detection and Recognition, Face Emotion Recognition Through NVIDIA Jetson Nano,” 11th Int. Symp. Ambient Intell., pp. 177-185, 2020.

M. H. Widianto, A. Sinaga, and M. A. Ginting, “A Systematic Review of LPWAN and Short-Range Network using AI to Enhance Internet of Things,” J. Robot. Control (JRC), vol. 3, no. 2, pp. 505-518, 2022.

G. P. N. Hakim, D. Septiyana, and I. Suwarno, “Survey Paper Artificial and Computational Intelligence in the Internet of Things and Wireless Sensor Network,” J. Robot. Control (JRC), vol. 3, no. 4, pp. 439-454, 2022.

A. A. Sahrab and H. M. Marhoon, “Design and Fabrication of a Low-Cost System for Smart Home Applications,” J. Robot. Control (JRC), vol. 3, no. 4, pp 409-414, 2022.

M. H. Widianto, A. Sinaga, and M. A. Ginting, “A Systematic Review of LPWAN and Short-Range Network using AI to Enhance Internet of Things,” J. Robot. Control (JRC), vol. 3, no. 4, pp. 505-518, 2022.

N. S. Irjanto and N. Surantha, “Home Security System with Face Recognition based on Convolutional Neural Network,” Int. J. Adv. Comput. Sci. Appl., vol. 11, no. 11, pp. 408-412, 2020.

A. Verma and M. K. Srivastava, “Real-time Face mask Detection Using Deep Learning and MobileNet V2,” VLSI, Microwave and Wireless Technologies, Lecture Notes in Electrical Engineering, vol. 877, pp. 297-305, 2022.

M. Sandler, A. Howard, M. Zhu, Andrey Zhmoginov, and L. C. Chen. “MobileNetV2: Inverted Residuals and Linear Bottlenecks,” The IEEE Conf. Comput. Vision Pattern Recognit. (CVPR), pp. 4510-4520, 2018.

V. Patel and D.Patel, “Face Mask Recognition Using MobileNetV2,” Int. J. Sci. Res. Comp. Sci. Eng. Inf. Technol, vol. 7, no. 5, pp. 35-42, 2021.

H. Sun, S. Zhang, R. Ren, and L. Su “Maturity Classification of “Hupingzao” Jujubes with an Imbalanced Dataset Based on Improved MobileNet V2,” Agriculture, vol. 12, no. 9, pp. 1-17, 2022.

G. Edel and V. Kapustin, “Exploring of the MobileNet V1 and MobileNet V2 models on NVIDIA Jetson Nano microcomputer,” J. Phys. Conf. Series, vol. 2291, no. 1, pp.1-7, 2022.

C. L. Amar et al., “Enhanced Real-time Detection of Face Mask with Alarm System using MobileNetV2,” Inter. J. Sci. Eng., vol.7, no. 7, pp. 1-12, 2022.

M. Sandler, A. Howard, M. Zhu, Andrey Zhmoginov, and L. C. Chen. “MobileNetV2: Inverted Residuals and Linear Bottlenecks,” The IEEE Conf. Comput. Vision Pattern Recognit. (CVPR), pp. 4510-4520, 2018.

Y. Nan, J. Ju, Q. Hua, H. Zhang, and B. Wang, “A-MobileNet: An approach of facial expression recognition,” Alexandria Eng. J., vol. 61, no. 6, pp. 4435-4444, 2021.

A. Srivastava1, A. Dalvi, C. Britto, H. Rai, and K. Shelke, “Explicit Content Detection using Faster R-CNN and SSD MobileNet v2,” Int. Res. J. Eng. Technol. (IRJET), vol. 7, no. 3, pp. 5572-5577, 2020.

J. Jeong, H. Park, and N. Kwak, “Enhancement of SSD by concatenating feature maps for object detection,” arXiv preprint arXiv:1705.09587, 2017.

R. Redondo and J. Gilbert, “Extended Labeled Faces in-the-Wild (ELFW): Augmenting Classes for Face Segmentation,” Comput. Sci., 2020.

J. Deng, J. Guo, E. Ververas, I. Kotsia, and S. Zafeiriou, “RetinaFace: Single-shot Multi-level Face Localisation in the Wild,” 2020 IEEE/CVF Conf. Comput. Vision and Pattern Recognit. (CVPR), pp. 5203-5212, 2020.

A. Wirdiani, P. Hridayami, and A. Widiari, “Face Identification Based on K-Nearest Neighbor,” Sci. J. Inform., vol. 6, no. 2, pp. 150-159, 2019.

R. S. Peres, X. Jia, J. Lee, K. Sun, A. W. Colombo, and J. Barata, “Industrial Artificial Intelligence in Industry 4.0 - Systematic Review, Challenges and Outlook,” IEEE Access, vol. 8, pp. 220121-220139, 2020.

P. Vrushali, and M. SanJay, “Autonomous Vehicle using Computer Vision and LiDAR,” I-manager’s J. Embedded Syst., vol. 9, pp. 7-14, 2021.

W. Liu, Y. Wen, Z. Yu, M. Li, B. Raj and L. Song, “SphereFace: Deep Hypersphere Embedding for Face Recognition,” 2017 IEEE Conf. Comput. Vision and Pattern Recognit. (CVPR), pp. 6738-6746, 2017.

S. Qureshi et. al. “Face Recognition (Image Processing) based Door Lock using OpenCV, Python and Arduino,” Int. J. Res. Appl. Sci. & Eng. Technol., vol. 8, no. 6, pp. 1208-1214, 2020

N. Saxena, and D. Varshney, “Smart Home Security Solutions using Facial Authentication and Speaker Recognition through Artificial Neural Networks,” Int. J. Cognitive Comput. Eng., vol. 2, no. 2, pp. 154-164, 2021.

M. H. Khairuddin, S. Shahbudin, and M. Kasssim, “A smart building security system with intelligent face detection and recognition,” IOP Conf. Series: Mater. Sci. Eng., no. 1176, 2021.

M. R. Dhobale, R. Y. Biradar, R. R. Pawar, and S. A. Awatade, “Smart Home Security System using Iot, Face Recognition and Raspberry Pi,” Int. J. Comput. Appl., vol. 176, no. 13, pp. 45-47, 2020.

T. Bagchi et. al., “Intelligent security system based on face recognition and IoT,” Materials Today: Proc., vol. 62, pp. 2133-2137, 2022.

P. Kaur, H. Kumar, and S. Kaushal “Effective state and learning environment based analysis of students’ performance in online assessment,” Int. J. Cognitive Comput. Eng., vol. 2, pp. 12-20, 2021.

N. A. Othman, and I. Aydin, “A face recognition method in the Internet of Things for security applications in smart homes and cities,” 2018 6th Int. Istanbul Smart Grids and Cities Congr. Fair (ICSG), pp. 20-24, 2018.

T. V. Dang, “Design the encoder inspection system based on the voltage 7 wave form using finite impulse response (FIR) filter,” Int. J. Modern Phys. B, vol. 34, p. 2040146, 2020.

T. V. Dang and N. T. Bui, “Design the abnormal object detection system using template matching and subtract background algorithm,” MMMS 2022, LNME, 2022.

T. V. Dang and N. T. Bui, “Research and Design Obstacle Avoidance Strategy for Indoor Autonomous Mobile Robot using Monocular Camera,” J. Adv. Transp., 2022.

T. V. Dang and N. T. Bui, “Multi-scale Fully Convolutional Network-based Semantic Segmentation for Mobile Robot Navigation,” Electron., vol. 12, no. 3, p. 533, 2022.

T. V. Dang and Dinh-Son Nguyen, “Optimal Navigation based on Improved A* Algorithm for Mobile Robot,” Int. Conf. Intell. Syst. Netw., 2023.




DOI: https://doi.org/10.18196/jrc.v4i1.16808

Refbacks

  • There are currently no refbacks.


Copyright (c) 2023 Thai-Viet Dang

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

 

Journal of Robotics and Control (JRC)

P-ISSN: 2715-5056 || E-ISSN: 2715-5072
Organized by Peneliti Teknologi Teknik Indonesia
Published by Universitas Muhammadiyah Yogyakarta in collaboration with Peneliti Teknologi Teknik Indonesia, Indonesia and the Department of Electrical Engineering
Website: http://journal.umy.ac.id/index.php/jrc
Email: jrcofumy@gmail.com

Kuliah Teknik Elektro Terbaik