AI-based Bubbles Detection in the Conformal Coating for Enhanced Quality Control in Electronics Manufacturing
Abstract
This research pioneers the application of artificial intelligence (AI) methodologies—machine learning, deep learning, hybrid models, transfer learning, and edge AI deployment—in enhancing bubble detection within conformal coatings, a critical as- pect of electronics manufacturing quality control. By addressing the limitations of traditional detection methods, our work offers a novel approach that significantly improves automation, accuracy, and speed, thereby ensuring the reliability of electronic assemblies and contributing to economic and safety benefits. We navigate through the challenges of creating diverse datasets, system robustness, and the imperative for industry-wide standardization, proposing strategies for overcoming these obstacles. Our findings highlight the transformative impact of AI on quality control processes, demonstrating substantial advancements in detection capabilities. Furthermore, we advocate for future research, development, and collaboration to extend these AI-driven improvements across the manufacturing spectrum. This study underscores the potential of AI to revolutionize electronics manufacturing, emphasizing the need for continued innovation and standardization to realize safer, more efficient, and cost-effective production methodologies.
Keywords
Full Text:
PDFReferences
P. Ciszewski, M. Sochacki, W. St˛eplewski, M. Ko´scielski, A. Ara´zna, and K. Janeczek, “A comparative analysis of printed circuit drying methods for the reliability of assembly process,” Microelectronics Reliability, vol. 129, p. 114478, 2022.
J. Wiklund, A. Karakoc, T. Palko, H. Yi˘gitler, K. Ruttik, R. Jantti, and J. Paltakari, “A review on printed electronics: Fabrication methods, inks, substrates, applications and environmental impacts,” Journal of Manufacturing and Materials Processing, vol. 5, no. 3, p. 89, 2021.
D. N. Vieira, A. Lima, D. Santos, N. Rodrigues, V. Carvalho, H. Puga, S. F. Teixeira, and J. C. Teixeira, “Prediction of solder joint reliability with applied acrylic conformal coating,” Journal of Electronic Materials, vol. 51, pp. 273–283, 2022.
S. Han, M. Osterman, S. Meschter, and M. Pecht, “Evaluation of effectiveness of conformal coatings as tin whisker mitigation,” Journal of electronic materials, vol. 41, pp. 2508–2518, 2012.
A.-A. F. Abbas, C. M. Greene, K. Srihari, D. Santos, and G. Pandiarajan, “Impact of conformal coating material on the long-term reliability of ball grid array solder joints,” Procedia Manufacturing, vol. 38, pp. 1138–1142, 2019.
C. Montemayor, “Effect of silicone conformal coating on surface insulation resistance (sir) for printed circuit board assemblies.” APEX EXPO IPC, San Diego, CA, 2012.
M. Rodošek, L. S. Perše, M. Mihelˇciˇc, M. Koželj, B. Orel, B. Beng˝u, O. Sunetci, P. Pori, and A. Š. Vuk, “Raman spectroscopy of fluoropolymer conformal coatings on electronic boards,” Electronic Materials Letters, vol. 10, pp. 935–941, 2014.
Association Connecting Electronics Industries, “Acceptability of Electronic Assemblies,” Ipc-a-610D, no. July, p. 392, 2004.
F. Dong, S. J. Meschter, S. Nozaki, T. Ohshima, T. Makino, and J. Cho, “Effect of coating adhesion and degradation on tin whisker mitigation of polyurethane-based conformal coatings,” Polymer Degradation and Stability, vol. 166, pp. 219–229, 2019.
F. Mayoussi, A. Usama, N. Nekoonam, I. Knauer, D. Bocherer, B. E. Rapp, and D. Helmer, “Influence of parylene f coatings on the wetting properties of soft polydimethylsiloxane (pdms),” Materials, vol. 16, no. 5, p. 1938, 2023.
H. Zhao, Y. Lv, J. Sha, R. Peng, Z. Chen, and G. Wang, “Research on detection method of coating defects based on machine vision,” in 2021 IEEE International Conference on Artificial Intelligence and Computer Applications (ICAICA). IEEE, 2021, pp. 519–524.
X. Hong, Q. Zhuo, X. Cao, D. Maslyk, N. Ekstrom, J. Sanchez, S. Hernandez, and J. Choi, “Compartmental emi shielding with jetdispensed material technology,” in 2019 IEEE 69th Electronic Components and Technology Conference (ECTC). IEEE, 2019, pp. 753–757.
N. Zouhri, A. El Mourabit, and A. I. Z. El Abidine, “Faster r-cnn assessment for air bubbles detection in the conformal coating application,” in 2021 International Conference on Microelectronics (ICM). IEEE, 2021, pp. 276–279.
K. Knop, E. Olejarz, and R. Ulewicz, “Evaluating and improving the effectiveness of visual inspection of products from the automotive industry,” in Advances in Manufacturing II: Volume 3-Quality Engineering and Management. Springer, 2019, pp. 231–243.
A. Kujawi´nska and M. Diering, “The impact of the organization of the visual inspection process on its effectiveness,” The International Journal of Advanced Manufacturing Technology, vol. 112, no. 5-6, pp. 1295–1306, 2021.
K. Haricha, A. Khiat, Y. Issaoui, A. Bahnasse, and H. Ouajji, “Recent technological progress to empower smart manufacturing: Review and potential guidelines,” IEEE Access, 2023.
N. H. M. Zaidin, M. N. M. Diah, and S. Sorooshian, “Quality management in industry 4.0 era,” Journal of Management and Science, vol. 8, no. 2, pp. 182–191, 2018.
T. Haas, C. Schubert, M. Eickhoff, and H. Pfeifer, “Bubcnn: Bubble detection using faster rcnn and shape regression network,” Chemical Engineering Science, vol. 216, p. 115467, 2020.
R. F. Cerqueira and E. E. Paladino, “Development of a deep learning-based image processing technique for bubble pattern recognition and shape reconstruction in dense bubbly flows,” Chemical Engineering Science, vol. 230, p. 116163, 2021. [Online]. Available: https: //www.sciencedirect.com/science/article/pii/S0009250920306953
H. Hessenkemper, S. Starke, Y. Atassi, T. Ziegenhein, and D. Lucas, “Bubble identification from images with machine learning methods,” International Journal of Multiphase Flow, vol. 155, p. 104169, 2022.
V. A. Adibhatla, H.-C. Chih, C.-C. Hsu, J. Cheng, M. F. Abbod, and J.-S. Shieh, “Defect detection in printed circuit boards using you-only-look-once convolutional neural networks,” Electronics, vol. 9, no. 9, p. 1547, 2020.
A. P. S. Chauhan and S. C. Bhardwaj, “Detection of bare pcb defects by image subtraction method using machine vision,” in Proceedings of the world congress on engineering, vol. 2, 2011, pp. 6–8.
N. K. Khalid and Z. Ibrahim, “An image processing approach towards classification of defects on printed circuit board,” Ph.D. dissertation, Universiti Teknologi Malaysia, 2007.
Y. Takada, T. Shiina, H. Usami, Y. Iwahori, and M. Bhuyan, “Defect detection and classification of electronic circuit boards using keypoint extraction and cnn features,” in Ninth International Conferences On Pervasive Patterns And Applications (Patterns 2017), 2017, pp. 113–116.
W. Ce et al., “Pcb defect detection using opencv with image subtraction method,” in 2017 International Conference on Information Management and Technology (ICIMTech). IEEE, 2017, pp. 204–209.
J. Soibam, V. Scheiff, I. Aslanidou, K. Kyprianidis, and R. B. Fdhila, “Application of deep learning for segmentation of bubble dynamics in subcooled boiling,” International Journal of Multiphase Flow, vol. 169, p. 104589, 2023.
R. F. Cerqueira and E. E. Paladino, “Development of a deep learningbased image processing technique for bubble pattern recognition and shape reconstruction in dense bubbly flows,” Chemical Engineering Science, vol. 230, p. 116163, 2021.
L. Liu, H. Yan, and G. Zhao, “Experimental studies on the shape and motion of air bubbles in viscous liquids,” Experimental Thermal and Fluid Science, vol. 62, pp. 109–121, 2015.
M. Gumulya, J. B. Joshi, R. P. Utikar, G. M. Evans, and V. Pareek, “Bubbles in viscous liquids: Time dependent behaviour and wake characteristics,” Chemical Engineering Science, vol. 144, pp. 298–309, 2016.
S. L. Kiambi, A.-M. Duquenne, J.-B. Dupont, C. Colin, F. Risso, and H. Delmas, “Measurements of bubble characteristics: comparison between double optical probe and imaging,” The Canadian Journal of Chemical Engineering, vol. 81, no. 3-4, pp. 764–770, 2003.
A. Verduzco, J. R. Villalobos, and B. Vega, “Information-based inspection allocation for real-time inspection systems,” Journal of Manufacturing Systems, vol. 20, no. 1, pp. 13–22, 2001.
S. Digiesi, F. Facchini, G. Mossa, and M. Vitti, “A model to evaluate the human error probability in inspection tasks of a production system,” Procedia Computer Science, vol. 217, pp. 1775–1783, 2023.
B. Cheng, Y. Wei, R. Feris, J. Xiong, W.-m. Hwu, T. Huang, and H. Shi, “Decoupled classification refinement: Hard false positive suppression for object detection,” arXiv preprint arXiv:1810.04002, 2018.
R. Hu, X. Luo, and S. Liu, “Study on the optical properties of conformal coating light-emitting diode by monte carlo simulation,” IEEE Photonics Technology Letters, vol. 23, no. 22, pp. 1673–1675, 2011.
J. Shin, Y. J. Kim, S. Jung, and C. Kim, “Product and service innovation: Comparison between performance and efficiency,” Journal of Innovation & Knowledge, vol. 7, no. 3, p. 100191, 2022.
M. N. Baily, H. Gersbach, F. M. Scherer, and F. R. Lichtenberg, “Efficiency in manufacturing and the need for global competition,” Brookings Papers on Economic Activity. Microeconomics, vol. 1995, pp. 307–358, 1995.
P. Martinez and R. Ahmad, “Quantifying the impact of inspection processes on production lines through stochastic discrete-event simulation modeling,” Modelling, vol. 2, no. 4, pp. 406–424, 2021.
A. Catalano, R. Trani, C. Scognamillo, V. d’Alessandro, and A. Castellazzi, “Optimization of thermal vias design in pcb-based power circuits,” in 2020 21st International conference on thermal, mechanical and Multiphysics simulation and experiments in microelectronics and microsystems (EuroSimE). IEEE, 2020, pp. 1–5.
M. Abd Al Rahman and A. Mousavi, “A review and analysis of automatic optical inspection and quality monitoring methods in electronics industry,” Ieee Access, vol. 8, pp. 183 192–183 271, 2020.
A. Salari, A. Djavadifar, X. Liu, and H. Najjaran, “Object recognition datasets and challenges: A review,” Neurocomputing, vol. 495, pp. 129–152, 2022.
R. Solovyev, W. Wang, and T. Gabruseva, “Weighted boxes fusion: Ensembling boxes from different object detection models,” Image and Vision Computing, vol. 107, p. 104117, 2021.
M. O. Ojo and A. Zahid, “Improving deep learning classifiers performance via preprocessing and class imbalance approaches in a plant disease detection pipeline,” Agronomy, vol. 13, no. 3, p. 887, 2023.
Q. Zhao, S. Wu, Z. Zhang, Y. Sun, Y. Fu, and H. Wang, “Sar image noise reduction based on wavelet transform and dncnn,” in 2021 2nd China International SAR Symposium (CISS). IEEE, 2021, pp. 1–4.
A. Pawar, “Noise reduction in images using autoencoders,” in 2020 3rd International Conference on Intelligent Sustainable Systems (ICISS). IEEE, 2020, pp. 987–990.
A. Gupta, A. Anpalagan, L. Guan, and A. S. Khwaja, “Deep learning for object detection and scene perception in self-driving cars: Survey, challenges, and open issues,” Array, vol. 10, p. 100057, 2021.
W. Zhang, P. Zhuang, H.-H. Sun, G. Li, S. Kwong, and C. Li, “Underwaterimage enhancement via minimal color loss and locally adaptive contrast enhancement,” IEEE Transactions on Image Processing, vol. 31, pp. 3997– 4010, 2022.
P. Kandhway, A. K. Bhandari, and A. Singh, “A novel reformed histogram equalization based medical image contrast enhancement using krill herd optimization,” Biomedical Signal Processing and Control, vol. 56, p. 101677, 2020.
G. Shao, F. Gao, T. Li, R. Zhu, T. Pan, and Y. Chen, “An adaptive image contrast enhancement algorithm based on retinex,” in 2020 Chinese Automation Congress (CAC). IEEE, 2020, pp. 6294–6299.
J. Li, X. Feng, and Z. Hua, “Low-light image enhancement via progressiverecursive network,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 31, no. 11, pp. 4227–4240, 2021.
D. Wang, T. Gao, and Y. Zhang, “Image sharpening detection based on difference sets,” IEEE Access, vol. 8, pp. 51 431–51 445, 2020.
P. Guo, P. Zhuang, and Y. Guo, “Bayesian pan-sharpening with multiorder gradient-based deep network constraints,” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol. 13, pp. 950–962,
N. R. Pal and S. K. Pal, “A review on image segmentation techniques,” Pattern recognition, vol. 26, no. 9, pp. 1277–1294, 1993.
S. Minaee, Y. Boykov, F. Porikli, A. Plaza, N. Kehtarnavaz, and D. Terzopoulos, “Image segmentation using deep learning: A survey,” IEEE transactions on pattern analysis and machine intelligence, vol. 44, no. 7, pp. 3523–3542, 2021.
N. Kheradmandi and V. Mehranfar, “A critical review and comparative study on image segmentation-based techniques for pavement crack detection,” Construction and Building Materials, vol. 321, p. 126162, 2022.
S. Ray, “A quick review of machine learning algorithms,” in 2019 International conference on machine learning, big data, cloud and parallel computing (COMITCon). IEEE, 2019, pp. 35–39.
B. Mahesh, “Machine learning algorithms-a review,” International Journal of Science and Research (IJSR).[Internet], vol. 9, no. 1, pp. 381–386, 2020.
M. Binkhonain and L. Zhao, “A review of machine learning algorithms for identification and classification of non-functional requirements,” Expert Systems with Applications: X, vol. 1, p. 100001, 2019.
J. M. Helm, A. M. Swiergosz, H. S. Haeberle, J. M. Karnuta, J. L. Schaffer, V. E. Krebs, A. I. Spitzer, and P. N. Ramkumar, “Machine learning and artificial intelligence: definitions, applications, and future directions,” Current reviews in musculoskeletal medicine, vol. 13, pp. 69–76, 2020.
Q. Wang, Y. Ma, K. Zhao, and Y. Tian, “A comprehensive survey of loss functions in machine learning,” Annals of Data Science, pp. 1–26, 2020.
S. Badillo, B. Banfai, F. Birzele, I. I. Davydov, L. Hutchinson, T. Kam- Thong, J. Siebourg-Polster, B. Steiert, and J. D. Zhang, “An introduction to machine learning,” Clinical pharmacology & therapeutics, vol. 107, no. 4, pp. 871–885, 2020.
P. C. Sen, M. Hajra, and M. Ghosh, “Supervised classification algorithms in machine learning: A survey and review,” in Emerging Technology in Modelling and Graphics: Proceedings of IEM Graph 2018. Springer, 2020, pp. 99–111.
K. Tyagi, C. Rane, and M. Manry, “Supervised learning,” in Artificial Intelligence and Machine Learning for EDGE Computing. Elsevier, 2022, pp. 3–22.
A. Olaode, G. Naghdy, and C. Todd, “Unsupervised classification of images: a review,” International Journal of Image Processing, vol. 8, no. 5, pp. 325–342, 2014.
B. Rajoub, “Supervised and unsupervised learning,” in Biomedical Signal Processing and Artificial Intelligence in Healthcare. Elsevier, 2020, pp. 51–89.
J.-O. Palacio-Ni textasciitilde no and F. Berzal, “Evaluation metrics for unsupervised learning algorithms,” arXiv preprint arXiv:1905.05667, 2019.
K. Sharifani and M. Amini, “Machine learning and deep learning: A review of methods and applications,” World Information Technology and Engineering Journal, vol. 10, no. 07, pp. 3897–3904, 2023.
F. Sultana, A. Sufian, and P. Dutta, “A review of object detection models based on convolutional neural network,” Intelligent computing: image processing based applications, pp. 1–16, 2020.
A. Dhillon and G. K. Verma, “Convolutional neural network: a review of models, methodologies and applications to object detection,” Progress in Artificial Intelligence, vol. 9, no. 2, pp. 85–112, 2020.
Z. Li, F. Liu, W. Yang, S. Peng, and J. Zhou, “A survey of convolutional neural networks: analysis, applications, and prospects,” IEEE transactions on neural networks and learning systems, 2021.
A. Ghosh, A. Sufian, F. Sultana, A. Chakrabarti, and D. De, “Fundamental concepts of convolutional neural network,” Recent trends and advances in artificial intelligence and Internet of Things, pp. 519–567, 2020.
A. Patil and M. Rane, “Convolutional neural networks: an overview and its applications in pattern recognition,” Information and Communication Technology for Intelligent Systems: Proceedings of ICTIS 2020, Volume 1, pp. 21–30, 2021.
J. Rezaeenour, M. Ahmadi, H. Jelodar, and R. Shahrooei, “Systematic review of content analysis algorithms based on deep neural networks,” Multimedia Tools and Applications, vol. 82, no. 12, pp. 17 879–17 903, 2023.
Y. Yu, X. Si, C. Hu, and J. Zhang, “A review of recurrent neural networks: Lstm cells and network architectures,” Neural computation, vol. 31, no. 7, pp. 1235–1270, 2019.
M. Mers, Z. Yang, Y.-A. Hsieh, and Y. Tsai, “Recurrent neural networks for pavement performance forecasting: review and model performance comparison,” Transportation Research Record, vol. 2677, no. 1, pp. 610– 624, 2023.
L. Chand, S. S. Cheema, and M. Kaur, “Understanding neural networks,” Factories of the Future: Technological Advancements in the Manufacturing Industry, pp. 83–102, 2023.
G. Moreno, K. Bennion, C. King, and S. Narumanchi, “Evaluation of performance and opportunities for improvements in automotive power electronics systems,” in 2016 15th IEEE Intersociety Conference on Thermal and Thermomechanical Phenomena in Electronic Systems (ITherm). IEEE, 2016, pp. 185–192.
M. Scutari, C. E. Graafland, and J. M. Gutierrez, “Who learns better bayesian network structures: Accuracy and speed of structure learning algorithms,” International Journal of Approximate Reasoning, vol. 115, pp. 235–253, 2019.
H. Yu, J. Liu, C. Chen, A. A. Heidari, Q. Zhang, H. Chen, M. Mafarja, and H. Turabieh, “Corn leaf diseases diagnosis based on k-means clustering and deep learning,” IEEE Access, vol. 9, pp. 143 824–143 835, 2021.
N. Audebert, B. Le Saux, and S. Lefevre, “Deep learning for classification of hyperspectral data: A comparative review,” IEEE geoscience and remote sensing magazine, vol. 7, no. 2, pp. 159–173, 2019.
Z. Li, H. Shen, Q. Cheng, Y. Liu, S. You, and Z. He, “Deep learning based cloud detection for medium and high resolution remote sensing images of different sensors,” ISPRS Journal of Photogrammetry and Remote Sensing, vol. 150, pp. 197–212, 2019.
W. Qayyum, R. Ehtisham, A. Bahrami, C. Camp, J. Mir, and A. Ahmad, “Assessment of convolutional neural network pre-trained models for detection and orientation of cracks,” Materials, vol. 16, no. 2, p. 826, 2023.
A. Krizhevsky, I. Sutskever, and G. E. Hinton, “Imagenet classification with deep convolutional neural networks,” Advances in neural information processing systems, vol. 25, 2012.
V. Azamfirei, F. Psarommatis, and Y. Lagrosen, “Application of automation for in-line quality inspection, a zero-defect manufacturing approach,” Journal of Manufacturing Systems, vol. 67, pp. 1–22, 2023.
D. Tsiktsiris, T. Sanida, A. Sideris, and M. Dasygenis, “Accelerated defective product inspection on the edge using deep learning,” in Recent Advances in Manufacturing Modelling and Optimization: Select Proceedings of RAM 2021. Springer, 2022, pp. 185–191.
V. R. Joseph and A. Vakayil, “SPlit: An Optimal Method for Data Splitting,” Technometrics, pp. 1–11, jun 2021. [Online]. Available: https://doi.org/10.1080/00401706.2021.1921037https: //www.tandfonline.com/doi/full/10.1080/00401706.2021.1921037
G. J. Bowden, H. R. Maier, and G. C. Dandy, “Optimal division of data for neural network models in water resources applications,” Water Resources Research, vol. 38, no. 2, pp. 2–1–2–11, feb 2002.
A. Torralba and A. A. Efros, “Unbiased look at dataset bias,” in CVPR 2011. IEEE, 2011, pp. 1521–1528.
S. Fabbrizzi, S. Papadopoulos, E. Ntoutsi, and I. Kompatsiaris, “A survey on bias in visual datasets,” Computer Vision and Image Understanding, vol. 223, p. 103552, 2022.
J. Humphries, K. O’Brien, L. O’Brien, and N. Dunne, “Impact of illuminance on object detection in industrial vision systems using neural networks,” in 2020 2nd International Conference on Artificial Intelligence, Robotics and Control, 2020, pp. 24–28.
P. Mouzenidis, A. Louros, D. Konstantinidis, K. Dimitropoulos, P. Daras, and T. Mastos, “Multi-modal variational faster r-cnn for improved visual object detection in manufacturing,” in Proceedings of the IEEE/CVF International Conference on Computer Vision, 2021, pp. 2587–2594.
G. I. Parisi, R. Kemker, J. L. Part, C. Kanan, and S. Wermter, “Continual lifelong learning with neural networks: A review,” Neural networks, vol. 113, pp. 54–71, 2019.
E. I. Papageorgiou, T. Theodosiou, G. Margetis, N. Dimitriou, P. Charalampous, D. Tzovaras, and I. Samakovlis, “Short survey of artificial intelligent technologies for defect detection in manufacturing,” in 2021 12th International Conference on Information, Intelligence, Systems & Applications (IISA). IEEE, 2021, pp. 1–7.
L. Prezas, G. Michalos, Z. Arkouli, A. Katsikarelis, and S. Makris, “Aienhanced vision system for dispensing process monitoring and quality control in manufacturing of large parts,” Procedia CIRP, vol. 107, pp. 1275–1280, 2022.
DOI: https://doi.org/10.18196/jrc.v5i2.20441
Refbacks
- There are currently no refbacks.
Copyright (c) 2024 Nizar Zouhri, Aimad El Mourabit, Alaoui Ismaili Zine El Abidine
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Journal of Robotics and Control (JRC)
P-ISSN: 2715-5056 || E-ISSN: 2715-5072
Organized by Peneliti Teknologi Teknik Indonesia
Published by Universitas Muhammadiyah Yogyakarta in collaboration with Peneliti Teknologi Teknik Indonesia, Indonesia and the Department of Electrical Engineering
Website: http://journal.umy.ac.id/index.php/jrc
Email: jrcofumy@gmail.com