Skip to main content

Transcribing Handwritten Medical Prescription using Convolutional Neural Network AlexNet Architecture and Canny Edge Detection

Author(s): Ralph Andrei A. Benitez 1 , Donata D. Acula 1 , 2 , , Anton Oliver M. Bondoc 1 , Angelo Louis L. Hizon 1 , Aaron Joseph D. Santos 1
Author(s) information:
1 Department of Computer Science, College of Information and Computing Sciences, University of Santo Tomas, Manila, Philippines
2 Research Center for Natural and Applied Sciences, University of Santo Tomas, Manila, Philippines

Corresponding author

Misinterpreted medical prescriptions had led to casualties due to the illegible cursive handwriting of medical practitioners. Many studies focused on this problem. However, the accuracy was unsatisfactory and needed improvement. The study evaluated the performance of the Canny edge detection with other preprocessing methods, including RGB to Grayscale Conversion, Binarization, and Inversion, which was used to process the images of cursive handwritten medical prescriptions using Alexnet Convolutional Recurrent Neural Network (ACoRNN). The CRNN model developed by previous researchers was used as the basis for comparison, and the researchers created a faster and more accurate model. The best combination of preprocessing methods for ACoRNN was with RGB to Grayscale Conversion, Binarization, Canny edge detection, and Inversion. The researchers’ model had faster preprocessing and testing time and achieved 90.76% average accuracy through five trials.

Previous article

Cerio, A.A.P.; Mallare, N.A.L.B.; Tolentino, R.M.S. (2015). Assessment of the Legibility of the Handwriting in Medical Prescriptions of Doctors from Public and Private Hospitals in Quezon City, Philippines. Procedia Manufacturing, 3, 90–97. https://doi.org/10.1016/j.promfg.2015.07.112.

Factors that Contribute to Medication Errors in the Philippine Heart Center. (accessed on 25 May 2023) Available online: https://www.phc.gov.ph/Images/articles/Factors%20that%20Contribute%20to%20Medication%20Errors.pdf.

1 in 3 misdiagnoses results in serious injury or death: study. Fierce Healthcare. (accessed on 25 May 2023) Available online: https://www.fiercehealthcare.com/hospitals-health-systems/jhu-1-3-misdiagnoses-results-serious-injury-or-death#:~:text=An%20estimated%2040%2C000%20to%2080%2C000.

Pasco, P.M.D.; Caro, R.M.; Cruz, C.L.; Dando, N.M.; Isip-Tan, I.T.C.; Panganiban, L.R.; Pascua, L.P.; Ricalde, R.R.; Sison, A.C. (2017). Prevalence of Medication Errors in Admitted Patients at the Philippine General Hospital. Acta Medica Philippina, 51, 2. https://doi.org/10.47895/amp.v51i2.577.

Fajardo, L.J.; Sorillo, N.J.; Garlit, J.; Tomines, C.D.; Abisado, M.B.; Imperial, J.M.R.; Rodriguez, R.L.; Fabito, B.S. (2019). Doctor’s Cursive Handwriting Recognition System Using Deep Learning. 2019 IEEE 11th International Conference on Humanoid, Nanotechnology, Information Technology, Communication and Control, Environment, and Management (HNICE). https://doi.org/10.1109/hnicem48295.2019.9073521.

Thavayee, A.; Vijayakumar, T. (2024). Analyzing Medical Manuscripts through Neural Networks and Handwriting Recognition Algorithms. International Journal of Emerging Technologies and Innovative Research, 11, f52-f57.

Sadaf, F.; Raju, S.M.T.U.; Muntakim, A. (2021). Offline Bangla Handwritten Text Recognition: A Comprehensive Study of Various Deep Learning Approaches. IEEE Xplore, 153–156. https://doi.org/10.1109/ICEEE54059.2021.9718890.

Hassan, S.; Irfan, A.; Mirza, A.; Siddiqi, I. (2019). Cursive Handwritten Text Recognition using Bi-Directional LSTMs: A Case Study on Urdu Handwriting. IEEE Xplore, 67–72. https://doi.org/10.1109/Deep-ML.2019.00021.

Mirza, A.; Siddiqi, I. (2020). Recognition of cursive video text using a deep learning framework. IET Image Processing, 14, 3444–3455. https://doi.org/10.1049/iet-ipr.2019.1070.

Srivastava, S.; Priyadarshini, J.; Gopal, S.; Gupta, S.; Dayal, H.S. (2018). Optical Character Recognition on Bank Cheques Using 2D Convolution Neural Network. Advances in Intelligent Systems and Computing, 589–596. https://doi.org/10.1007/978-981-13-1822-1_55.

Krizhevsky, A.; Sutskever, I.; Hinton, G.E. (2012). ImageNet classification with deep convolutional neural networks. Communications of the ACM, 60, 84–90. https://doi.org/10.1145/3065386.

AlexNet: The Architecture that Challenged CNNs. Medium. (accessed on 25 May 2023) Available online: https://towardsdatascience.com/alexnet-the-architecture-that-challenged-cnns-e406d5297951.

CNN Architectures: LeNet, AlexNet, VGG, GoogLeNet, ResNet and more. Medium. (accessed on 25 May 2023) Available online: https://medium.com/analytics-vidhya/cnns-architectures-lenet-alexnet-vgg-googlenet-resnet-and-more-666091488df5.

Hassan, S.; Irfan, A.; Mirza, A.; Siddiqi, I. (2019). Cursive Handwritten Text Recognition using Bi-Directional LSTMs: A Case Study on Urdu Handwriting. IEEE Xplore, 67–72. https://doi.org/10.1109/Deep-ML.2019.00021.

Chandio, A.A.; Asikuzzaman, M.D; Pickering, M.R.; Leghari, M. (2022). Cursive Text Recognition in Natural Scene Images Using Deep Convolutional Recurrent Neural Network. IEEE Access, 10, 10062–10078. https://doi.org/10.1109/access.2022.3144844.

Islam, M.H.; Tara, K.; Rahman, H.U.; Sarkar, A.K. (2021). An Approach to Assess ACh and NE Secretion inside Heart’s Myocardial Cell during R-peak Formation. 2021 3rd International Conference on Electrical & Electronic Engineering (ICEEE), pp. 57-60. https://doi.org/10.1109/ICEEE54059.2021.9718857.

About this article

SUBMITTED: 01 March 2024
ACCEPTED: 28 May 2024
PUBLISHED: 22 June 2024
SUBMITTED to ACCEPTED: 89 days
DOI: https://doi.org/10.53623/gisa.v4i1.417

Cite this article
Benitez, R. A. A., Acula, D. D., Bondoc, A. O. M., Hizon, A. L. L., & Santos, A. J. D. (2024). Transcribing Handwritten Medical Prescription using Convolutional Neural Network AlexNet Architecture and Canny Edge Detection. Green Intelligent Systems and Applications, 4(1), 41–53. https://doi.org/10.53623/gisa.v4i1.417
Keywords
Accessed
244
Citations
0
Share this article