Skip to main content
Article | Green Intelligent Systems and Applications | Volume 2 - Issue 2 - 2022 | 71-83 | https://doi.org/10.53623/gisa.v2i2.109
© 2022 by the author(s), and is licensed under the Creative Commons Attribution 4.0 International (CC BY 4.0) License Creative Commons Attribution 4.0 International (CC BY 4.0) License

Attendance System with Face Recognition, Body Temperature, and Use of Mask using Multi-Task Cascaded Convolutional Neural Network (MTCNN) Method

Author(s): Noor Cholis Basjaruddin 1 , Edi Rakhman 1 , Yana Sudarsa 1 , Moch Bilal Zaenal Asyikin 2 , Septia Permana 3
Author(s) information:
1 Department of Electrical Engineering, Politeknik Negeri Bandung, Indonesia.
2 Department of Refrigeration, Air Conditioning, and Energy Engineering, National Chin-Yi University of Technology, Taiwan.
3 Depatment Digital and Next Business , PT. Telkom Indonesia Tbk, Indonesia.

Corresponding author

Green Intelligent Systems and Applications

Volume 2 - Issue 2 - 2022

 About the journal
Submit your article
The application of health protocols in educational, office, or industrial environments can be made by changing old habits that can spread COVID-19. One of them is the habit of recording attendance, which still requires direct physical contact. In this research, an attendance system based on facial recognition, body temperature checks, and mask use using the multi-task cascaded convolutional neural network (MTCNN) has been developed. This research aims to integrate a facial recognition system, a mask detection system, and body temperature reading into an attendance recording system without the need for direct physical contact. The attendance system offered in this study can minimize the spread of COVID-19. So, it has enormous potential for use in educational, office, and industrial environments. The focus of this research is to create an attendance system by integrating the application of face recognition, body temperature, and the use of masks using a pre-trained model. Based on the research results, an attendance system was successfully developed where the results of face recognition, mask detection, and body temperature were displayed on the machine screen and attendance platform. Facial recognition testing on the original LFW dataset has an accuracy of 66.45%. The accuracy of the dataset reaches 92-100%. In addition, the intelligent attendance platform has been successfully developed with user management, machine service, and attendance service features. The results of the attendance record are successfully displayed on the platform or through the download feature.
Read Full-Text
Previous article
Next article

WHO Coronavirus Disease (COVID-19) Dashboard. (accessed on 11 February 2021). Available online: https://covid19.who.int/.

World Health Organization. (accessed on 11 February 2021). Available online: https://covid19.who.int/table.

How COVID spreads. Centers for Disease Control and Prevention. (accessed on 11 February 2021). Available online https://www.cdc.gov/coronavirus/2019-ncov/prevent-getting-sick/how-covid-spreads.html.

COVID-19 developments in Indonesia, AHK Indonesien, (accessed on 24 December 2021) Available online: https://indonesien.ahk.de/en/infocenter/news/news-details/covid-19-developments-in-indonesia.

No one was listening: How did Indonesia’s COVID-19 crisis get this bad?, ABC News, (accessed on 22 July 2022). Available online: https://www.abc.net.au/news/2021-07-23/indonesia-covid-19-coronavirus-epicentre-lockdown-delta-variant/100310858.

Indonesia to ramp up testing, tracing ahead of reopening. (accessed on 22 July 2022). Available online: https://www.thejakartapost.com/news/2021/07/22/government-to-ramp-up-testing-tracing-ahead-of-reopening.html.

Patra, D.; Agrawal, A.; Srivastav, A.; Kathirvelan, J. (2021). Contactless attendance cum temperature detection system with real-time alerts. 2021 Innovations in Power and Advanced Computing Technologies (i-PACT). https://doi.org/10.1109/i-PACT52855.2021.9696594.

Geng, S.; Li, G.; Liu, W. (2012). Design and implement of Attendance Management System based on contactless smart IC Card. 2012 Proceedings of International Conference on Computer Science and Electronics Engineering. https://doi.org/10.1109/ICCSEE.2012.196.

Farman, H.; Khan, T.; Khan, Z.; Habib, S.; Islam, M.; Ammar, A. (2022). Real-time face mask detection to ensure COVID-19 precautionary measures in the developing countries. Applied Sciences, 12, 3879. https://doi.org/10.3390/app12083879.

Manley, K.D.; Chan, J.C.; Wells, G.L. (2022). Improving face identification of mask-wearing individuals. Cognitive Research: Principles and Implications, 7, 27. https://doi.org/10.1186/s41235-022-00369-7.

Zhang, K.; Zhang, Z.; Li, Z.; Qiao, Y. (2016). Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Networks. IEEE Signal Processing Letters, 23 (10), 1499-1503, https://doi.org/10.1109/LSP.2016.2603342.

Khan, S.; Rahmani, H.; Shah, S.A.A.; Bennamoun, M. (2018). A Guide to Convolutional Neural Networks for Computer Vision. Synthesis Lectures on Computer Vision, 8, 1-207. http:// doi.org/10.2200/S00822ED1V01Y201712COV015.

Shijie, J.; Ping, W.; Peiyi, J.; Siping, H. (2017). Research on data augmentation for image classification based on convolution neural networks. 2017 Chinese Automation Congress (CAC). https://doi.org/10.1109/CAC.2017.8243510.

Parkhi, O. M.; Vedaldi, A.; Zisserman, A. (2015). Deep Face Recognition. Proceedings of the British Machine Vision Conference, 41, 1-12. https://doi.org/10.5244/C.29.41.

Schroff, F.; Kalenichenko, K.; Philbin, J. (2015). FaceNet: A unified embedding for face recognition and clustering. 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 815-823. https://doi.org/10.1109/CVPR.2015.7298682.

Harvey, A.; LaPlace, J. (2019). Origins, Ethics, and Privacy Implications of Publicly Available Face Recognition Image Datasets, Available online:megapixels.cc.

Szegedy, C.; Wei, L.; Yangqing, J.; Pierre, S.; Scoot, R.; Dragomir, A.; Dumitri, E.; Vincent, V.; Andrew, R. (2015). Going deeper with convolutions. 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 1-9. https://doi.org/10.1109/CVPR.2015.7298594.

Huang, G. B., Ramesh, M., Berg, T., and Learned-Miller, E. (2007). Labeled Faces in the Wild: A Database for Studying Face Recognition in Unconstrained Environments. Workshop on Faces in 'Real-Life' Images: Detection, Alignment, and Recognition, Erik Learned-Miller and Andras Ferencz and Frédéric Jurie, Oct 2008, Marseille, France.

Xiao, J.; Weiwei, G. (2019). Face recognition algorithm based on Prewitt and convolutional neural network. 2019 3rd International Conference on Electronic Information Technology and Computer Engineering (EITCE), 2007–2009. https://doi.org/10.1109/EITCE47263.2019.9095075.

Jose, E.; Greeshma, M.; Haridas, M.T.P.; Supriya, M.H. (2019). Face Recognition based Surveillance System Using FaceNet and MTCNN on Jetson TX2. 2019 5th International Conference on Advanced Computing & Communication Systems (ICACCS). https://doi.org/10.1109/ICACCS.2019.8728466.

Read Full-Text
About this article

SUBMITTED: 19 August 2022
ACCEPTED: 01 October 2022
PUBLISHED: 9 October 2022
SUBMITTED to ACCEPTED: 43 days
DOI: https://doi.org/10.53623/gisa.v2i2.109

Cite this article
Basjaruddin, N. C. ., Rakhman, E. ., Sudarsa, Y. ., Asyikin, M. B. Z. ., & Permana, S. . (2022). Attendance System with Face Recognition, Body Temperature, and Use of Mask using Multi-Task Cascaded Convolutional Neural Network (MTCNN) Method. Green Intelligent Systems and Applications, 2(2), 71–83. https://doi.org/10.53623/gisa.v2i2.109
Keywords
covid-19, attendance system, facial recognition, mask detection, body temperature, MTCNN
Accessed
1083
Citations
0
Share this article