Effectiveness of CNN Architectures and SMOTE to Overcome Imbalanced X-Ray Data in Childhood Pneumonia Detection

Yuri Pamungkas, Muhammad Rifqi Nur Ramadani, Edwin Nugroho Njoto

Abstract


Pneumonia is a disease that causes high mortality worldwide in children and adults. Pneumonia is caused by swelling of the lungs, and to ensure that the lungs are swollen, a chest X-ray can be done. The doctor will then analyze the X-ray results. However, doctors sometimes have difficulty confirming pneumonia from the results of chest X-ray observations. Therefore, we propose the combination of SMOTE and several CNN architectures be implemented in a chest X-ray image-based pneumonia detection system to help the process of diagnosing pneumonia quickly and accurately. The chest X-ray data used in this study were obtained from the Kermany dataset (5216 images). Several stages of pre-processing (grayscaling and normalization) and data augmentation (shifting, zooming, and adjusting the brightness) are carried out before deep learning is carried out. It ensures that the input data for deep learning is not mixed with noise and is according to needs. Then, the output data from the augmentation results are used as input for several CNN deep learning architectures. The augmented data will also utilize SMOTE to overcome data class disparities before entering the CNN algorithm. Based on the test results, the VGG16 architecture shows the best level of performance compared to other architectures. In system testing using SMOTE+CNN Architectures (VGG16, VGG19, Xception, Inception-ResNet v2, and DenseNet 201), the optimum accuracy level reached 93.75%, 89.10%, 91.67%, 86.54% and 91.99% respectively. SMOTE provides a performance increase of up to 4% for all CNN architectures used in predicting pneumonia.

Keywords


Pneumonia; X-Ray Images; SMOTE; CNN Architectures.

Full Text:

PDF

References


K. G. Rögnvaldsson, A. Bjarnason, I. S. Ólafsdóttir, K. O. Helgason, A. Guðmundsson, and M. G. Prof, “Adults with symptoms of pneumonia: a prospective comparison of patients with and without infiltrates on chest radiography,” Clinical Microbiology and Infection, vol. 29, no. 1, p. 108, 2022.

S. Quispe, I. Torres, and P. Shiguihara, “A Survey of Deep Learning Techniques Based on Computed Tomography Images for Detection of Pneumonia,” Engineering Proceedings, vol. 42, no. 1, p. 5, 2023.

V. Hespanhol and C. Bárbara, “Pneumonia mortality, comorbidities matter?,” Pulmonology, vol. 26, no. 3, pp. 123–129, May 2020.

F. M. de Benedictis, E. Kerem, A. B. Chang, A. A. Colin, H. J. Zar, and A. Bush, “Complicated pneumonia in children,” The Lancet, vol. 396, no. 10253, pp. 786–798, Sep. 2020.

D. Marangu and H. J. Zarb, “Childhood pneumonia in low-and-middle-income countries: An update,” Paediatric Respiratory Reviews, vol. 32, pp. 3–9, Nov. 2019.

M. C. B. Godoy, H. R. Ferreira Dalla Pria, M. T. Truong, G. S. Shroff, and E. M. Marom, “Invasive Fungal Pneumonia in Immunocompromised Patients,” Radiologic Clinics of North America, vol. 60, no. 3, pp. 497–506, May 2022.

C. W. Lanks, A. I. Musani, and D. W. Hsia, “Community-acquired Pneumonia and Hospital-acquired Pneumonia,” Medical Clinics of North America, vol. 103, no. 3, pp. 487–501, May 2019.

A. Zizza et al., “Factors Associated with Pneumonia in Patients Hospitalized with COVID-19 and the Role of Vaccination,” Vaccines, vol. 11, no. 8, pp. 1342–1342, Aug. 2023.

Y.-N. Liu et al., “Infection and co-infection patterns of community-acquired pneumonia in patients of different ages in China from 2009 to 2020: a national surveillance study,” The Lancet Microbe, vol. 4, no. 5, pp. e330–e339, May 2023.

J. Fachrel, A. A. Pravitasari, I. N. Yulita, M. N. Ardhisasmita, and F. Indrayatna, “Enhancing an Imbalanced Lung Disease X-ray Image Classification with the CNN-LSTM Model,” Applied sciences, vol. 13, no. 14, pp. 8227–8227, Jul. 2023.

N. Miyashita, “Atypical pneumonia: Pathophysiology, diagnosis, and treatment,” Respiratory Investigation, vol. 60, no. 1, Nov. 2021.

G. B. Nair and M. S. Niederman, “Updates on community acquired pneumonia management in the ICU,” Pharmacology & Therapeutics, vol. 217, p. 107663, Jan. 2021.

Z. V. Rueda et al., “Etiology and the challenge of diagnostic testing of community-acquired pneumonia in children and adolescents,” BMC Pediatrics, vol. 22, no. 1, Mar. 2022.

H. Guo et al., “Differentiate Clinical Characteristics Between Viral Pneumonia and Mycoplasma pneumoniae and Nomograms for Predicting Mycoplasma pneumoniae: A Retrospective Study in Primary Hospitals,” PubMed, vol. 42, no. 12, pp. 1035–1040, Oct. 2023.

E. S. Tanzarella et al., “An Observational Study to Develop a Predictive Model for Bacterial Pneumonia Diagnosis in Severe COVID-19 Patients—C19-PNEUMOSCORE,” Journal of Clinical Medicine, vol. 12, no. 14, pp. 4688–4688, Jul. 2023.

N. Jiang, Q. Long, Y. Zheng, and Z. C. Gao, “Advances in epidemiology, etiology, and treatment of community-acquired pneumonia,” PubMed, vol. 57, no. 1, pp. 91–99, Jan. 2023.

S. Bharati, P. Podder, and M. R. H. Mondal, “Hybrid deep learning for detecting lung diseases from X-ray images,” Informatics in Medicine Unlocked, vol. 20, p. 100391, 2020.

R. Jain, P. Nagrath, G. Kataria, V. Sirish Kaushik, and D. Jude Hemanth, “Pneumonia detection in chest X-ray images using convolutional neural networks and transfer learning,” Measurement, vol. 165, p. 108046, Dec. 2020.

E. Ayan and H. M. Ünver, “Diagnosis of Pneumonia from Chest X-Ray Images Using Deep Learning,” 2019 Scientific Meeting on Electrical-Electronics & Biomedical Engineering and Computer Science (EBBT), pp. 1-5, 2019.

D. Kermany, K. Zhang, and M. Goldbaum, “Labeled Optical Coherence Tomography (OCT) and Chest X-Ray Images for Classification,” Mendeley data, vol. 2, no. 2, p. 651, 2018.

A. Singhal, R. Shukla, P. K. Kankar, S. Dubey, S. Singh, and R. B. Pachori, “Comparing the capabilities of transfer learning models to detect skin lesion in humans,” Proceedings of the Institution of Mechanical Engineers, Part H: Journal of Engineering in Medicine, vol. 234, no. 10, pp. 1083–1093, Jul. 2020.

E. Hsu, I. Malagaris, Y.-F. Kuo, R. Sultana, and K. Roberts, “Deep learning-based NLP data pipeline for EHR-scanned document information extraction,” JAMIA Open, vol. 5, no. 2, Apr. 2022.

A. D. Wibawa, Y. Pamungkas, M. I. Perdana, and R. Rachmatika, “Iris Grid Image Classification using Naive Bayes for Human Biometric System,” 2022 1st International Conference on Information System & Information Technology (ICISIT), pp. 55-60, 2022.

A. Giełczyk, A. Marciniak, M. Tarczewska, and Z. Lutowski, “Pre-processing methods in chest X-ray image classification,” PloS one, vol. 17, no. 4, p. e0265949, Jan. 2022.

T. Tsuji et al., “Classification of chest X-ray images by incorporation of medical domain knowledge into operation branch networks,” BMC Medical Imaging, vol. 23, no. 1, May 2023.

M. Chetoui, M. A. Akhloufi, El Mostafa Bouattane, J. Abdulnour, S. Roux, and C. Bernard, “Explainable COVID-19 Detection Based on Chest X-rays Using an End-to-End RegNet Architecture,” Viruses, vol. 15, no. 6, pp. 1327–1327, Jun. 2023.

S. Liu, T. Cai, X. Tang, Y. Zhang, and C. Wang, “COVID-19 diagnosis via chest X-ray image classification based on multiscale class residual attention,” Computers in Biology and Medicine, vol. 149, p. 106065, Oct. 2022.

F. Li, X. Lu, and J. Yuan, “MHA-CoroCapsule: Multi-Head Attention Routing-based Capsule Network for COVID-19 chest X-ray image classification,” IEEE Transactions on Medical Imaging, pp. 1–1, 2021.

D. Ji, Z. Zhang, Y. Zhao, and Q. Zhao, “Research on Classification of COVID-19 Chest X-Ray Image Modal Feature Fusion Based on Deep Learning,” Journal of Healthcare Engineering, vol. 2021, p. e6799202, Aug. 2021.

I. M. Baltruschat, H. Nickisch, M. Grass, T. Knopp, and A. Saalbach, “Comparison of Deep Learning Approaches for Multi-Label Chest X-Ray Classification,” Scientific Reports, vol. 9, no. 1, Apr. 2019.

P. C. Motta, P. C. Cortez, B. R. S. Silva, G. Yang, and V. H. C. d. Albuquerque, “Automatic COVID-19 and Common-Acquired Pneumonia Diagnosis Using Chest CT Scans,” Bioengineering, vol. 10, no. 5, p. 529, Apr. 2023.

X. Qi, L. G. Brown, D. J. Foran, J. Nosher, and I. Hacihaliloglu, “Chest X-ray image phase features for improved diagnosis of COVID-19 using convolutional neural network,” Int. J. Comput. Assisted Radiol. Surgery, vol. 16, no. 2, pp. 197–206, Jan. 2021.

H. Louati, A. Louati, S. Bechikh, F. Masmoudi, A. Aldaej, and E. Kariri, “Topology optimization search of deep convolution neural networks for CT and X-ray image classification,” BMC Med. Imag., vol. 22, no. 1, Jul. 2022.

B. Chen, J. Li, G. Lu, H. Yu, and D. Zhang, “Label Co-Occurrence Learning with Graph Convolutional Networks for Multi-Label Chest X-Ray Image Classification,” IEEE J. Biomed. Health Inform., vol. 24, no. 8, pp. 2292–2302, Aug. 2020.

N.-A.-A. Alam, M. Ahsan, M. A. Based, J. Haider, and M. Kowalski, “COVID-19 Detection from Chest X-ray Images Using Feature Fusion and Deep Learning,” Sensors, vol. 21, no. 4, p. 1480, Feb. 2021.

W. Bakasa and S. Viriri, “VGG16 Feature Extractor with Extreme Gradient Boost Classifier for Pancreas Cancer Prediction,” J. Imag., vol. 9, no. 7, p. 138, Jul. 2023.

A. Huang, L. Jiang, J. Zhang, and Q. Wang, “Attention-VGG16-UNet: a novel deep learning approach for automatic segmentation of the median nerve in ultrasound images,” Quantitative Imag. Medicine Surgery, vol. 12, no. 6, p. 3138, 2021.

A. Alshammari, “Construction of VGG16 Convolution Neural Network (VGG16 CNN) Classifier with NestNet-Based Segmentation Paradigm for Brain Metastasis Classification,” Sensors, vol. 22, no. 20, p. 8076, Oct. 2022.

W. Pora, N. Kasamsumran, K. Tharawatcharasart, R. Ampol, P. Siriyasatien, and N. Jariyapan, “Enhancement of VGG16 model with multi-view and spatial dropout for classification of mosquito vectors,” PLOS ONE, vol. 18, no. 7, Jul. 2023.

D. Pandiar, S. Choudhari, and R. Poothakulath Krishnan, “Application of InceptionV3, SqueezeNet, and VGG16 Convoluted Neural Networks in the Image Classification of Oral Squamous Cell Carcinoma: A Cross-Sectional Study,” Cureus, vol. 15, no. 11, 2023.

S. Tena, R. Hartanto, and I. Ardiyanto, “Content-Based Image Retrieval for Traditional Indonesian Woven Fabric Images Using a Modified Convolutional Neural Network Method,” J. Imag., vol. 9, no. 8, p. 165, Aug. 2023.

M. Subramanian, N. P. Lv, and V. E. Sathishkumar, “Hyperparameter Optimization for Transfer Learning of VGG16 for Disease Identification in Corn Leaves Using Bayesian Optimization,” Big Data, vol. 10, no. 3, pp. 215-229, 2021.

G. Suganeshwari, R. Balakumar, K. Karuppanan, S. B. Prathiba, S. Anbalagan, and G. Raja, “DTBV: A Deep Transfer-Based Bone Cancer Diagnosis System Using VGG16 Feature Extraction,” Diagnostics, vol. 13, no. 4, p. 757, Feb. 2023.

K. Srinivas, R. Gagana Sri, K. Pravallika, K. Nishitha, and S. R. Polamuri, “COVID-19 prediction based on hybrid Inception V3 with VGG16 using chest X-ray images,” Multimedia Tools Appl., pp. 1-18, 2023.

S. Montaha et al., “BreastNet18: A High Accuracy Fine-Tuned VGG16 Model Evaluated Using Ablation Study for Diagnosing Breast Cancer from Enhanced Mammography Images,” Biology, vol. 10, no. 12, p. 1347, Dec. 2021.

R. Mohan, K. Ganapathy, and A.R, “Brain tumour classification of Magnetic resonance images using a novel CNN based Medical Image Analysis and Detection network in comparison with VGG16,” J. Population Therapeutics Clin. Pharmacol., vol. 28, no. 2, Jan. 2022.

L.-Y. Ye, X.-Y. Miao, W.-S. Cai, and W.-J. Xu, “Medical image diagnosis of prostate tumor based on PSP-Net+VGG16 deep learning network,” Computer Methods and Programs in Biomedicine, p. 106770, Mar. 2022.

S. Srinivasan et al., “A Framework of Faster CRNN and VGG16-Enhanced Region Proposal Network for Detection and Grade Classification of Knee RA,” Diagnostics, vol. 13, no. 8, pp. 1385–1385, Apr. 2023.

Z. Omiotek and A. Kotyra, “Flame Image Processing and Classification Using a Pre-Trained VGG16 Model in Combustion Diagnosis,” Sensors, vol. 21, no. 2, p. 500, Jan. 2021.

Y. Zhang and L. Meng, “Study on Identification Method of Pulmonary Nodules: Improved Random Walk Pulmonary Parenchyma Segmentation and Fusion Multi-Feature VGG16 Nodule Classification,” Frontiers in Oncology, vol. 12, Mar. 2022.

Y. Wu, Y. He, and Y. Wang, “Multi-Class Weed Recognition Using Hybrid CNN-SVM Classifier,” Sensors, vol. 23, no. 16, pp. 7153–7153, Aug. 2023.

L. Kong and J. Cheng, “Classification and detection of COVID-19 X-Ray images based on DenseNet and VGG16 feature fusion,” Biomedical Signal Processing and Control, vol. 77, p. 103772, Aug. 2022.

S. Altun, A. Alkan, and İ. Altun, “LSS-VGG16: Diagnosis of Lumbar Spinal Stenosis With Deep Learning,” Clinical Spine Surgery, vol. 36, no. 5, pp. E180-E190, 2023.

M. S. Khan et al., “VGG19 Network Assisted Joint Segmentation and Classification of Lung Nodules in CT Images,” Diagnostics, vol. 11, no. 12, pp. 2208–2208, Nov. 2021.

L. Li, Z. Yang, X. Yang, J. Li, and Q. Zhou, “PV resource evaluation based on Xception and VGG19 two-layer network algorithm,” Heliyon, vol. 9, no. 11, pp. e21450–e21450, Nov. 2023.

M. Bansal, M. Kumar, M. Sachdeva, and A. Mittal, “Transfer learning for image classification using VGG19: Caltech-101 image data set,” Journal of Ambient Intelligence and Humanized Computing, pp. 1-12, 2021.

A. Karacı, “VGGCOV19-NET: automatic detection of COVID-19 cases from X-ray images using modified VGG19 CNN architecture and YOLO algorithm,” Neural Computing and Applications, vol. 34, no. 10, pp. 8253-8274, 2022.

N. Madusanka, P. Jayalath, D. Fernando, L. Yasakethu, and B.-I. Lee, “Impact of H&E Stain Normalization on Deep Learning Models in Cancer Image Classification: Performance, Complexity, and Trade-Offs,” Cancers, vol. 15, no. 16, pp. 4144–4144, Aug. 2023.

K. Shaheed, Q. Abbas, A. Hussain, and I. Qureshi, “Optimized Xception Learning Model and XgBoost Classifier for Detection of Multiclass Chest Disease from X-ray Images,” Diagnostics, vol. 13, no. 15, pp. 2583–2583, Aug. 2023.

D. Li, S. Yuan, and G. Yao, “Classification of lung nodules based on the DCA-Xception network,” Journal of X-ray Science and Technology, vol. 30, no. 5, pp. 993–1008, Sep. 2022.

B. Gülmez, “A novel deep neural network model based Xception and genetic algorithm for detection of COVID-19 from X-ray images,” Annals of Operations Research, vol. 328, no. 1, pp. 617-641, 2022.

K. Shaheed, Q. Abbas, A. Hussain, and I. Qureshi, “Optimized Xception Learning Model and XgBoost Classifier for Detection of Multiclass Chest Disease from X-ray Images,” Diagnostics, vol. 13, no. 15, pp. 2583–2583, Aug. 2023.

M. Rahimzadeh and A. Attar, “A modified deep convolutional neural network for detecting COVID-19 and pneumonia from chest X-ray images based on the concatenation of Xception and ResNet50V2,” Informatics in Medicine Unlocked, vol. 19, p. 100360, 2020.

I. Lahsaini, M. E. H. Daho, and M. A. Chikh, “Deep transfer learning-based classification model for covid-19 using chest CT-scans,” Pattern Recognition Letters, vol. 152, pp. 122–128, Dec. 2021.

M. S. A. Reshan et al., “Detection of Pneumonia from Chest X-ray Images Utilizing MobileNet Model,” Healthcare, vol. 11, no. 11, p. 1561, May 2023.

P. Podder et al., “LDDNet: A Deep Learning Framework for the Diagnosis of Infectious Lung Diseases,” Sensors, vol. 23, no. 1, p. 480, Jan. 2023.

C. Song et al., “Maize seed appearance quality assessment based on improved Inception-ResNet,” Frontiers in Plant Science, vol. 14, Aug. 2023.

Y. Chen et al., “Classification of Lungs Infected COVID-19 Images based on Inception-ResNet,” Computer Methods and Programs in Biomedicine, p. 107053, Jul. 2022.

C. Lin et al., “CIR-Net: Automatic Classification of Human Chromosome based on Inception-ResNet Architecture,” IEEE/ACM Trans. Comput. Biol. Bioinf., vol. 19, no. 3, pp. 1285-1293, 2020.

H. M. Emara et al., “Simultaneous Super-Resolution and Classification of Lung Disease Scans,” Diagnostics, vol. 13, no. 7, pp. 1319–1319, Apr. 2023.

S. Dash, P. K. Sethy, and S. K. Behera, “Cervical Transformation Zone Segmentation and Classification based on Improved Inception-ResNet-V2 Using Colposcopy Images,” Cancer Informatics, vol. 22, p. 11769351231161477, Mar. 2023.

H. Zhang et al., “Recurrence Plot-Based Approach for Cardiac Arrhythmia Classification Using Inception-ResNet-v2,” Frontiers in Physiology, vol. 12, May 2021.

K. Pawar, Z. Chen, N. J. Shah, and G. F. Egan, “Suppressing motion artefacts in MRI using an Inception‐ResNet network with motion simulation augmentation,” NMR in Biomedicine, vol. 35, no. 4, 2019.

X. Wan, J. Luo, Y. Liu, Y. Chen, X. Peng, and X. Wang, “An image classification method for arrhythmias based on Gramian angular summation field and improved Inception-ResNet-v2,” Journal of Biomedical Engineering, vol. 40, no. 3, pp. 465–473, Jun. 2023.

Nillmani et al., “Segmentation-Based Classification Deep Learning Model Embedded with Explainable AI for COVID-19 Detection in Chest X-ray Scans,” Diagnostics, vol. 12, no. 9, p. 2132, Sep. 2022.

H. A. Sanghvi, R. H. Patel, A. Agarwal, S. Gupta, V. Sawhney, and A. S. Pandya, “A deep learning approach for classification of COVID and pneumonia using DenseNet ‐201,” International Journal of Imaging Systems and Technology, Sep. 2022.

P. Podder, F. B. Alam, M. R. H. Mondal, M. J. Hasan, A. Rohan, and S. Bharati, “Rethinking Densely Connected Convolutional Networks for Diagnosing Infectious Diseases,” Computers, vol. 12, no. 5, p. 95, May 2023.

Z. Tao, H. Bingqiang, L. Huiling, Y. Zaoli, and S. Hongbin, “NSCR-Based DenseNet for Lung Tumor Recognition Using Chest CT Image,” BioMed Research International, vol. 2020, pp. 1–9, Dec. 2020.

A. M. Abdelmula, O. Mirzaei, E. Güler, and K. Süer, “Assessment of Deep Learning Models for Cutaneous Leishmania Parasite Diagnosis Using Microscopic Images,” Diagnostics, vol. 14, no. 1, pp. 12–12, Dec. 2023.

Y.-D. Zhang, S. C. Satapathy, X. Zhang, and S.-H. Wang, “COVID-19 Diagnosis via DenseNet and Optimization of Transfer Learning Setting,” Cognitive Computation, pp. 1-17, 2021.

X. Xue et al., “Design and Analysis of a Deep Learning Ensemble Framework Model for the Detection of COVID-19 and Pneumonia Using Large-Scale CT Scan and X-ray Image Datasets,” Bioengineering, vol. 10, no. 3, pp. 363–363, Mar. 2023.

I. Kanjanasurat, K. Tenghongsakul, B. Purahong, and A. Lasakul, “CNN–RNN Network Integration for the Diagnosis of COVID-19 Using Chest X-ray and CT Images,” Sensors, vol. 23, no. 3, p. 1356, Jan. 2023.

H. Malik, A. Naeem, R. A. Naqvi, and W.-K. Loh, “DMFL_Net: A Federated Learning-Based Framework for the Classification of COVID-19 from Multiple Chest Diseases Using X-rays,” Sensors, vol. 23, no. 2, p. 743, Jan. 2023.

C. Bada et al., “Inter-observer Agreement in Interpreting Chest X-rays on Children with Acute Lower Respiratory Tract Infections and Concurrent Wheezing,” Sao Paulo Medical Journal, vol. 125, pp. 150-154, May 2007.

V. P. Shah, M. G. Tunik, and J. W. Tsung, “Prospective Evaluation of Point-Of-Care Ultrasonography for The Diagnosis of Pneumonia in Children and Young Adults,” JAMA pediatrics, vol. 167, pp. 119-125, 2013.

V. A Caiulo et al., “Lung Ultrasound Characteristics of Community‐acquired Pneumonia in Hospitalized Children,” Pediatric Pulmonology, vol. 48, pp. 280-287, 2012.

M. F. Hashmi et al., “Efficient Pneumonia Detection In Chest Xray Images Using Deep Transfer Learning,” Diagnostics, vol. 10, p. 417, 2020.

A. Hosny et al., “Artificial Intelligence In Radiology,” Nature Reviews Cancer, vol. 18, pp. 500-510, 2018.

S. Sharma and K. Guleria, “A Deep Learning based model for the Detection of Pneumonia from Chest X-Ray Images using VGG-16 and Neural Networks,” Procedia Computer Science, vol. 218, pp. 357–366, 2023.

M. Rahimzadeh and A. Attar, “A modified deep convolutional neural network for detecting COVID-19 and pneumonia from chest X-ray images based on the concatenation of Xception and ResNet50V2,” Informatics in Medicine Unlocked, vol. 19, p. 100360, 2020.

C. Ieracitano et al., “A fuzzy-enhanced deep learning approach for early detection of Covid-19 pneumonia from portable chest X-ray images,” Neurocomputing, vol. 481, pp. 202–215, Apr. 2022.

R. Kundu, R. Das, Z. W. Geem, G.-T. Han, and R. Sarkar, “Pneumonia detection in chest X-ray images using an ensemble of deep learning models,” PLoS ONE, vol. 16, no. 9, p. e0256630, Sep. 2021.




DOI: https://doi.org/10.18196/jrc.v5i3.21494

Refbacks

  • There are currently no refbacks.


Copyright (c) 2024 Yuri Pamungkas, Muhammad Rifqi Nur Ramadani, Edwin Nugroho Njoto

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

 


Journal of Robotics and Control (JRC)

P-ISSN: 2715-5056 || E-ISSN: 2715-5072
Organized by Peneliti Teknologi Teknik Indonesia
Published by Universitas Muhammadiyah Yogyakarta in collaboration with Peneliti Teknologi Teknik Indonesia, Indonesia and the Department of Electrical Engineering
Website: http://journal.umy.ac.id/index.php/jrc
Email: jrcofumy@gmail.com


Kuliah Teknik Elektro Terbaik