Smart home Management System with Face Recognition Based on ArcFace Model in Deep Convolutional Neural Network

Thai-Viet Dang

Abstract


In recent years, artificial intelligence has proved its potential in many fields, especially in computer vision. Facial recognition is one of the most essential tasks in the field of computer vision with various prospective applications from academic research to intelligence service. In this paper, we propose an efficient deep learning approach to facial recognition. Our approach utilizes the architecture of ArcFace model based on the backbone MobileNet V2, in deep convolutional neural network (DCNN). Assistive techniques to increase highly distinguishing features in facial recognition. With the supports of the facial authentication combines with hand gestures recognition, users will be able to monitor and control his home through his mobile phone/tablet/PC. Moreover, they communicate with data and connect to smart devices easily through IoT technology. The overall proposed model is 97% of accuracy and a processing speed of 25 FPS. The interface of the smart home demonstrates the successful functions of real-time operations.

Keywords


Artificial intelligence; Computer vision; Facial recognition; Home security system; Internet of Thing (IoT).

Full Text:

PDF

References


R. S. Peres, X. Jia, J. Lee, K. Sun, A. W. Colombo, and J. Barata, “Industrial Artificial Intelligence in Industry 4.0 - Systematic Review, Challenges and Outlook,” IEEE Access, vol. 8, pp. 220121-220139, 2020.

V Pagire, S Mate, “Autonomous Vehicle using Computer Vision and LiDAR,” I-manager’s J. Embedded Syst., vol. 9, pp. 7-14, 2021.

J. Huang, J. Chai, and S. Cho, “Deep learning in finance and banking: A literature review and classification,” Frontiers of Business Res. China, vol. 14, pp. 1-24, 2020.

R. Gautam, A. Gedam, and A. A. Mahawadiwar, “Review on Development of Industrial Robotic Arm,” Int. Res. J. Eng. Technol., vol. 4, no. 3, March, 2017.

M. Souded, “People detection, tracking and re-identification through a video camera network,” Université Nice Sophia Antipolis, 2013.

N. Zhang, J. Luo, and W. Gao, "Research on Face Detection Technology Based on MTCNN," 2020 Int. Conf. Comput. Netw., Electron. and Automat. (ICCNEA), pp. 154-158, 2020.

S. Pawar, V. Kithani, S. Ahuja, and S. Sahu, “Local Binary Patterns and Its Application to Facial Image Analysis,” 2011 Int. Conf. Recent Trends Inf. Technol. (ICRTIT), pp. 782-786, 2011.

H. S. Dadi, G. Krishna, and M. Pillutla, “Improved Face Recognition Rate Using HOG Features and SVM Classifier,” IOSR J. Electron. Commun. Eng. (IOSR-JECE), vol 11, no. 4, pp. 33-44, 2016.

F. Schroff, D. Kalenichenko, and J. Philbin, “FaceNet: A Unified Embedding for Face Recognition and Clustering,” 2015 IEEE Conf. Comput. Vision Pattern Recognit. (CVPR), pp. 815-823, 2015.

A. Wirdiani, P. Hridayami, and A. Widiari, “Face Identification Based on K-Nearest Neighbor,” Scientist J. Inform., vol. 6, no. 2, pp. 150-159, 2019.

A. Süzen, B. Duman, and B. Sen, “Benchmark Analysis of Jetson TX2, Jetson Nano and Raspberry PI using Deep-CNN,” 2020 Int. Congr. Human-Comput. Interact. Optim. Robot. Appl. (HORA), pp. 1-5, 2020.

S. Kurzadkar, “Hotel management system using Python Tkinler GUI,” Int. J. Comput. Sci. Mobile Comput., vol. 11, no. 1, pp. 204-208, 2022.

Y. Nan, J. Ju, Q. Hua, H. Zhang, and B. Wang, “A-MobileNet: An approach of facial expression recognition,” Alexandria Eng. J., vol. 61, no. 6, pp. 4435-4444, 2021.

Y. Jimin and Z. Wei, “Face Mask Wearing Detection Algorithm Based on Improved YOLO-v4,” Comput. Sci., Sensor, vol. 3263, pp. 21, 2021.

A. Bochkovskiy, C. Y. Wang, and H. Liao, “YOLOv4: Optimal Speed and Accuracy of Object Detection,” arXiv 2020, arXiv:2004.10934.

J. Jeong, H. Park, and N. Kwak, “Enhancement of SSD by concatenating feature maps for object detection,” arXiv 2017, arXiv:1705.09587.

Z. Hong et. al., “Local Binary Pattern-Based Adaptive Differential Evolution for Multimodal Optimization Problems,” IEEE Trans. Cyber., vol. 50, no. 7, pp. 3343-3357, 2020.

J. Wang, C. Zheng, X. Yang, and L. Yang, “Enhance Face: Adaptive Weighted SoftMax Loss for Deep Face Recognition,” IEEE Signal Process. Lett., vol. 29, pp. 65-69, 2022.

X. Li, D. Chang, T. Tian, and J. Cao, “Large-Margin Regularized Softmax Cross-Entropy Loss,” IEEE Access, vol. 7, pp. 19572-19578, 2019.

S. Moschoglou, A. Papaioannou, C. Sagonas, J. Deng, I. Kotsia, and S. Z. Agedb, “The first manually collected in-the-wild age database,” CVPR Workshop, 2017.

W. Liu, Y. Wen, Z. Yu, and M. Yang, “Large-Margin Softmax Loss for Convolutional Neural Networks,” Proc. 33rd Inter. Conf. Mach. Learn., vol. 48, 2016.

H. Wang et. al., “Cosface: Large margin cosine loss for deep face recognition,” 2018 IEEE/CVF Conf. Comput. Vision and Pattern Recognit., pp. 5265-5274, 2018.

W. Liu, Y. Wen, Z. Yu, M. Li, B. Raj and L. Song, “SphereFace: Deep Hypersphere Embedding for Face Recognition,” 2017 IEEE Conf. Comput. Vision and Pattern Recognit. (CVPR), pp. 6738-6746, 2017.

V. Sati, S.M. Sánchez, N. Shoeibi, A. Arora, and J.M. Corchado, “Face Detection and Recognition, Face Emotion Recognition Through NVIDIA Jetson Nano,” 11th Int. Symp. Ambient Intell., pp. 177-185, 2020.

S. Qureshi et. al. “Face Recognition (Image Processing) based Door Lock using OpenCV, Python and Arduino,” Int. J. Res. Appl. Sci. & Eng. Technol., vol. 8, no. 6, pp. 1208-1214, 2020

N. Saxena, and D. Varshney, “Smart Home Security Solutions using Facial Authentication and Speaker Recognition through Artificial Neural Networks,” Int. J. Cognitive Comput. Eng., no. 2, pp. 154-164, 2021.

M. H. Khairuddin, S. Shahbudin, and M. Kasssim, “A smart building security system with intelligent face detection and recognition,” IOP Conf. Series: Mater. Sci. Eng., no. 1176, 2021.

M. R. Dhobale, R. Y. Biradar, R. R. Pawar, and S. A. Awatade, “Smart Home Security System using Iot, Face Recognition and Raspberry Pi,” Int. J. Comput. Appl., vol. 176, no. 13, pp. 45-47, 2020.

T. Bagchi et. al., “Intelligent security system based on face recognition and IoT,” Materials Today: Proc., vol.62, pp. 2133-2137, 2022.

P. Kaur, H. Kumar, and S. Kaushal “Effective state and learning environment based analysis of students’ performance in online assessment,” Int. J. Cognitive Comput. Eng., vol. 2, pp. 12-20, 2021.

S. Pawar, V. Kithani, S. Ahuja, and S. Sahu, “Smart Home Security Using IoT and Face Recognition,” 2018 Fourth Int. Conf. Comput. Commun. Control Automat. (ICCUBEA), 2018.

N. A. Othman, and I. Aydin, “A face recognition method in the Internet of Things for security applications in smart homes and cities,” 2018 6th Int. Istanbul Smart Grids and Cities Congr. Fair (ICSG), 2018.

A. Kumar, P. S. Kumar, and R. Agarwal “A Face Recognition Method in the IoT for Security Appliances in Smart Homes, offices and Cities,” 3rd Int. Conf. Comput. Methodologies and Commun. (ICCMC), 2019.

T. Kamyab, A. Delrish, H. Daealhaq, A. M Ghahfarokhi, F. Beheshtinejad, “Comparison and Review of Face Recognition Methods Based on Gabor and Boosting Algorithms,” Int. J. Robot. Control Syst., vol. 2, no. 4, pp 610-617, 2021.

M. H. Widianto, A. Sinaga, and M. A. Ginting, “A Systematic Review of LPWAN and Short-Range Network using AI to Enhance Internet of Things,” J. Robot. Control (JRC), vol. 3, no. 2, pp. 505-518, 2022.

A. A. Sahrab and H. M. Marhoon, “Design and Fabrication of a Low-Cost System for Smart Home Applications,” J. Robot. Control (JRC), vol. 3, no. 4, pp 409-414, 2022.

G. P. N. Hakim, D. Septiyana, and Iswanto Suwarno, “Survey Paper Artificial and Computational Intelligence in the Internet of Things and Wireless Sensor Network,” J. Robot. Control (JRC), vol. 3, no. 4, pp. 439-454, 2022.

M. H. Widianto, A. Sinaga, and M. A. Ginting, “A Systematic Review of LPWAN and Short-Range Network using AI to Enhance Internet of Things,” J. Robot. Control, vol. 3, no. 4, pp. 505-518, 2022.

N. S. Irjanto and N. Surantha, “Home Security System with Face Recognition based on Convolutional Neural Network,” Int. J. Adv. Comput. Sci. Appl., vol. 11, no. 11, pp. 408-412, 2020.

M. Sandler, A. Howard, M. Zhu, Andrey Zhmoginov, and L. C. Chen. “MobileNetV2: Inverted Residuals and Linear Bottlenecks,” The IEEE Conf. Comput. Vision Pattern Recognit. (CVPR), pp. 4510-4520, 2018.

V. Patel and D. Patel, “Face Mask Recognition Using MobileNetV2,” Int. J. Sci. Res. Comp. Sci. Eng. Inf. Technol, vol. 7, no. 5, pp. 35-42, 2021.

C. L. Amar et al., “Enhanced Real-time Detection of Face Mask with Alarm System using MobileNetV2,” Inter. J. Sci. Eng., vol.7, no. 7, pp. 1-12, 2022.

G. Zhili, “Embedded Computer System in Hospital and Atomized Intelligent Monitoring of Children's Respiratory Diseases,” Microprocessors and Microsystems, vol. 82, p. 103930, 2021.

J. Ji and F. Lieng, “Influence of Embedded Microprocessor Wireless Communication and Computer Vision in Wushu Competition Referees’ Decision Support,” Wireless Communications and Mobile Computing, vol. 1, pp. 1-13, 2022.

R. Chang, B. Li, and B, Zheng, “Research on visualization of container layout based on embedded computer and microservice environment,” Journal of Physics Conference Series, vol. 1744, no. 3, p. 032210, 2021.

W. Han, X. Bai, and J. Xie, “Assessment Model of the Architecture of the Aerospace Embedded Computer,” Procedia Eng., vol. 99, pp. 991-998, 2015.

A. Subbotin, N. Zhukova, and M. Tianxing, “Architecture of the intelligent video surveillance systems for fog environments based on embedded computers,” 2021 10th Mediterranean Conf. Embedded Comput. (MECO), 2021.

K. Belattar, A. Mehadjbia, A. Bala, and A. Kechida “An embedded system-based hand-gesture recognition for human-drone interaction,” Int. J. Embedded Syst., vol. 15, no. 4, pp. 333-343, 2022.

R. Li, “Computer embedded automatic test system based on VxWorks,” Int. J. Embedded Syst., vol. 15, no.3, pp.183-192, 2022.

O. G. Bedoya and J, V. Ferreira, “An embedded software architecture for the development of a cooperative autonomous vehicle,” Int. J. Embedded Syst., vol.15, no. 2, pp. 83-92, 2022.

H. Gao et. al., “Tool Wear Monitoring Algorithm Based on SWT-DCNN and SST-DCNN,” Sci. Program., vol. 1, pp.1-11, 2022.

A. Tariq, T. Zia, and M. Ghafoor, “Towards counterfactual and contrastive explainability and transparency of DCNN image classifiers,” Knowl. Syst., vol. 257, no.10, 109901, 2022.

A. B. W. Putra, A. F. O. Gaffar, M. T. Sumadi, and L. Setiawati, “Intra-frame Based Video Compression Using Deep Convolutional Neural Network (DCNN),” Int. J. Inform. Vis., vol. 6, no. 3, pp. 650-659, 2022.

I. Kalita, G. P. Singh, and M. Roy, “Crop classification using aerial images by analyzing an ensemble of DCNNs under multi-filter & multi-scale framework,” Multimedia Tools Appl., 2022.

A. Saffari, M. Khishe, M. Mohammadi, A. Hussein Mohammed, and S. Rashidi, “DCNN-FuzzyWOA: Artificial Intelligence Solution for Automatic Detection of COVID-19 Using X-Ray Images,” Comput. Intell. Neuroscience, vol. 11, pp. 1-11, 2022.

S. Subbiah and R. Dheeraj, “Twitter Sentimentality Examination Using Convolutional Neural Setups and Compare with DCNN Based on Accuracy,” ECS Trans., vol. 107, no. 1, pp. 14037-14050, 2022.

H. Liu, J. Du, Y. Zhang, and H Zhang, “Performance analysis of different DCNN models in remote sensing image object detection,” EURASIP J. Imag. and Video Process., vol. 1, pp. 1-18, 2022.

R. Wang, T. Liu, J. Lu, and Y. Zhou, “Interpretable Optimization Training Strategy-Based DCNN and Its Application on CT Image Recognition,” Math. Problems in Eng., vol. 3, pp. 1-13, 2022.

Y. Le, Y. A. Nanehkaran, D. S. Mwakapesa, R. Zhang, J. Yi, and Y. Mao, “FP-DCNN: a parallel optimization algorithm for deep convolutional neural network,” J. Supercomput., vol. 78, no. 3, 2022

D. Hussain, M. Ismail, I. Hussain, R. Alroobaea, S. Hussain, and S. S. Ullah, “Face Mask Detection Using Deep Convolutional Neural Network (DCNN) and MobileNetV2 Based Transfer Learning,” Wireless Commun. Mobile Comput., vol. 1, 2022.

T. H. Nguyen and M. C. Nguyen, “Oscillation Measurement of the Magnetic Compass Needle Employing Deep Learning Technique,” The AUN/SEED-Net Joint Regional Conf. Trans. Energy Mech. Manuf. Eng., pp. 220-229, June 2022.

T. H. Nguyen, N. P. Doan, and T. T. Nguyen, “Battery Sorting Algorithm Employing a Deep Learning Technique for Recycling,” International Conference on Advanced Mechanical Engineering, Automation and Sustainable Development, pp. 846-853, 2022.

H. H. Hoang, T. H. Nguyen, V. H. Tran, T. H. Bui, and D. M. Nguyen: “Machine Vision System for Automated Nuts Classification and Inspection,” International Conference on Material, Machines and Methods for Sustainable Development, pp. 755-759, 2020.

T. V. Dang, “Design the encoder inspection system based on the voltage 7 wave form using finite impulse response (FIR) filter,” Int. J. Modern Phys. B, pp. 1-6, 2020.




DOI: https://doi.org/10.18196/jrc.v3i6.15978

Refbacks

  • There are currently no refbacks.


Copyright (c) 2022 Thai-Viet Dang

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

 

Journal of Robotics and Control (JRC)

P-ISSN: 2715-5056 || E-ISSN: 2715-5072
Organized by Peneliti Teknologi Teknik Indonesia
Published by Universitas Muhammadiyah Yogyakarta in collaboration with Peneliti Teknologi Teknik Indonesia, Indonesia and the Department of Electrical Engineering
Website: http://journal.umy.ac.id/index.php/jrc
Email: jrcofumy@gmail.com

Kuliah Teknik Elektro Terbaik