Development of Method to Predict Career Choice of IT Students in Kazakhstan by Applying Machine Learning Methods
DOI:
https://doi.org/10.18196/jrc.v6i1.25558Keywords:
Educational Prediction, Machine Learning in Education, Artificial Intelligence in Education, Prediction Systems in EducationAbstract
The growing intricacy of IT education requires resources to aid students in choosing specialized pathways. This study investigates the prediction of specialization preferences among IT students at SDU University in Kazakhstan through the application of machine learning techniques. The research contribution is the development of a predictive model that enhances academic advising by incorporating multiple factors, including academic performance, personality traits, qualifications, and extracurricular involvement. The research examined 692 anonymized student profiles and evaluated the efficacy of five machine learning algorithms: Random Forest, K-Nearest Neighbors, Support Vector Machine, Gradient Boosting, and Naive Bayes. Stratified 10-fold cross-validation was utilized to reduce the risk of overfitting. Gradient Boosting attained a peak accuracy of 99.10% in validation; however, its performance decreased to 92.16% on an independent test set, suggesting overfitting. Naive Bayes exhibited the lowest accuracy, recorded at 35.26%. Logistic regression analysis indicated a statistically significant correlation (p < 0.05) among academic performance, extracurricular involvement, and specialization selection. Personality traits and certifications significantly influenced the prediction process. The findings suggest that although Gradient Boosting demonstrates high effectiveness, the associated risk of overfitting requires additional refinement for practical application. The notable impact of academic performance and extracurricular activities indicates that educational institutions ought to prioritize these elements in student guidance. The incorporation of machine learning-based recommendations into advising frameworks enhances the precision of specialization predictions, thereby improving student decision-making and career alignment.
References
M. L. Bernacki, J. A. Greene, and H. Crompton, "Mobile technology, learning, and achievement: Advances in understanding and measuring the role of mobile technology in education," Contemp. Educ. Psychol., vol. 60, p. 101827, 2020.
S. Lew, G. W. H. Tan, X. M. Loh, J. J. Hew, and K. B. Ooi, "The disruptive mobile wallet in the hospitality industry: An extended mobile technology acceptance model," Technol. Soc., vol. 63, p. 101430, 2020.
A. Albarq, "The emergence of mobile payment acceptance in Saudi Arabia: the role of reimbursement condition," J. Islamic Mark., vol. 15, no. 6, pp. 1632-1650, 2024.
A. Serek and M. Zhaparov, "Optimizing preference satisfaction with genetic algorithm in matching students to supervisors," Appl. Math., vol. 18, no. 1, pp. 133-138, 2024.
M. A. Fuentes, D. G. Zelaya, and J. W. Madsen, "Rethinking the course syllabus: Considerations for promoting equity, diversity, and inclusion," Teach. Psychol., vol. 48, no. 1, pp. 69-79, 2021.
A. Serek, M. Zhaparov, and S. M. Yoo, "Analysis of Data to Improve System of an Educational Organization," in 2018 14th International Conference on Electronics Computer and Computation (ICECCO), pp. 206-212, Nov. 2018.
S. M. Johnson and S. E. Birkeland, "Pursuing a 'sense of success': New teachers explain their career decisions," Am. Educ. Res. J., vol. 40, no. 3, pp. 581-617, 2003.
G. V. Caprara, C. Barbaranelli, P. Steca, and P. S. Malone, "Teachers' self-efficacy beliefs as determinants of job satisfaction and students' academic achievement: A study at the school level," J. Sch. Psychol., vol. 44, no. 6, pp. 473-490, 2006.
A. Hirschi, "Career adaptability development in adolescence: Multiple predictors and effect on sense of power and life satisfaction," J. Vocat. Behav., vol. 74, no. 2, pp. 145-155, 2009.
S. Fantinelli, C. Esposito, L. Carlucci, P. Limone, and F. Sulla, "The influence of individual and contextual factors on the vocational choices of adolescents and their impact on well-being," Behav. Sci., vol. 13, no. 3, p. 233, 2023.
X. Wang, Y. Gao, Q. Wang, and P. Zhang, "Relationships between self-efficacy and teachers’ well-being in middle school English teachers: The mediating role of teaching satisfaction and resilience," Behav. Sci., vol. 14, no. 8, p. 629, 2024.
X. Zhou, Y. Padrón, H. C. Waxman, E. Baek, and S. Acosta, "How do school climate and professional development in multicultural education impact job satisfaction and teaching efficacy for STEM teachers of English learners? A path-analysis," Int. J. Sci. Math. Educ., vol. 22, no. 2, pp. 447-468, 2024.
M. Wang and S. Liu, "Machine learning-based research on the adaptability of adolescents to online education," arXiv preprint arXiv:2408.16849, 2024.
A. Aburayya, S. Salloum, K. Alderbashi, F. Shwedeh, Y. Shaalan, R. Alfaisal, ... and K. Shaalan, "SEM-machine learning-based model for perusing the adoption of metaverse in higher education in UAE," Int. J. Data Netw. Sci., vol. 7, no. 2, pp. 667-676, 2023.
A. Rejeb, K. Rejeb, A. Appolloni, H. Treiblmaier, and M. Iranmanesh, "Exploring the impact of ChatGPT on education: A web mining and machine learning approach," Int. J. Manag. Educ., vol. 22, no. 1, p. 100932, 2024.
A. Serek, A. Akhmetov, N. Ismagulov, B. Rysbek, B. Rysbek, and S. Alim, "Application of k-means in the perception of supervisors from students’ side," in 2021 16th International Conference on Electronics Computer and Computation (ICECCO), pp. 1-3, Nov. 2021.
I. T. Sanusi, S. S. Oyelere, H. Vartiainen, J. Suhonen, and M. Tukiainen, "A systematic review of teaching and learning machine learning in K-12 education," Educ. Inf. Technol., vol. 28, no. 5, pp. 5967-5997, 2023.
A. Serek, A. Bazarkulova, A. Chazhabayev, and A. Akhmetov, "Analysis of supervisors and students in the context of diploma defense," in 2021 16th International Conference on Electronics Computer and Computation (ICECCO), pp. 1-4, Nov. 2021.
D. Akiba and M. C. Fraboni, "AI-supported academic advising: Exploring ChatGPT’s current state and future potential toward student empowerment," Educ. Sci., vol. 13, no. 9, p. 885, 2023.
A. A. Makki, A. Y. Alqahtani, R. M. Abdulaal, and A. I. Madbouly, "A novel strategic approach to evaluating higher education quality standards in University Colleges using multi-criteria decision-making," Educ. Sci., vol. 13, no. 6, p. 577, 2023.
M. S. Iswahyudi, N. Nofirman, I. K. A. Wirayasa, S. Suharni, and I. Soegiarto, "Use of ChatGPT as a decision support tool in human resource management," Jurnal Minfo Polgan, vol. 12, no. 1, pp. 1522-1532, 2023.
A. Abulibdeh, E. Zaidan, and R. Abulibdeh, "Navigating the confluence of artificial intelligence and education for sustainable development in the era of industry 4.0: Challenges, opportunities, and ethical dimensions," J. Clean. Prod., p. 140527, 2024.
C. C. Thelma, Z. H. Sain, D. L. Mpolomoka, W. M. Akpan, and M. Davy, "Curriculum design for the digital age: Strategies for effective technology integration in higher education," Int. J. Res., vol. 11, no. 07, pp. 185-201, 2024.
Y. Gao, X. Wang, and P. Fan, "Exploring male English major’s motivation trajectory through complex dynamic systems theory," Curr. Psychol., vol. 43, no. 10, pp. 9089-9100, 2024.
S. Amer-Yahia, "Towards AI-powered data-driven education," Proc. VLDB Endowment, vol. 15, no. 12, pp. 3798-3806, 2022.
C. Guan, J. Mou, and Z. Jiang, "Artificial intelligence innovation in education: A twenty-year data-driven historical analysis," Int. J. Innov. Stud., vol. 4, no. 4, pp. 134-147, 2020.
S. Gaftandzhieva, S. Hussain, S. Hilcenko, R. Doneva, and K. Boykova, "Data-driven decision making in higher education institutions: State-of-play," Int. J. Adv. Comput. Sci. Appl., vol. 14, no. 6, pp. 397-405, 2023.
M. Yağcı, "Educational data mining: prediction of students' academic performance using machine learning algorithms," Smart Learn. Environ., vol. 9, no. 1, p. 11, 2022.
H. Luan and C. C. Tsai, "A review of using machine learning approaches for precision education," Educ. Technol. Soc., vol. 24, no. 1, pp. 250-266, 2021.
F. Ofori, E. Maina, and R. Gitonga, "Using machine learning algorithms to predict students’ performance and improve learning outcome: A literature based review," J. Inf. Technol., vol. 4, no. 1, pp. 33-55, 2020.
R. B. Rolf, I. Jackson, M. Müller, S. Lang, T. Reggelin, and D. Ivanov, "A review on reinforcement learning algorithms and applications in supply chain management," Int. J. Prod. Res., vol. 61, no. 20, pp. 7151-7179, 2023.
Y. Wang, "Artificial intelligence in educational leadership: a symbiotic role of human-artificial intelligence decision-making," J. Educ. Adm., vol. 59, no. 3, pp. 256-270, 2021.
L. S. Neuwirth, S. Jović, and B. R. Mukherji, "Reimagining higher education during and post-COVID-19: Challenges and opportunities," J. Adult Cont. Educ., vol. 27, no. 2, pp. 141-156, 2021.
N. Almazova, E. Krylova, A. Rubtsova, and M. Odinokaya, "Challenges and opportunities for Russian higher education amid COVID-19: Teachers’ perspective," Educ. Sci., vol. 10, no. 12, p. 368, 2020.
C. Rapanta, L. Botturi, P. Goodyear, L. Guàrdia, and M. Koole, "Balancing technology, pedagogy and the new normal: Post-pandemic challenges for higher education," Postdigit. Sci. Educ., vol. 3, no. 3, pp. 715-742, 2021.
E. Elder, A. Struminger, A. Wilkerson, S. Wilkins, M. Rosenthal, and E. Post, "A Social Ecological Approach to Understanding Youth Sport Specialization," J. Sport Behav., vol. 47, no. 2, 2024.
M. Kroher and K. Leuze, "Degree Differentiation and Changing Career Outcomes of Higher Education Graduates in Germany: A Matter of Specialization, Extracurricular Activities or Labor Market Segmentation?," in Career Paths Inside and Outside Academia, pp. 20-54, 2023.
Z. Shu, K. Mottan, H. Chen, and Y. Pang, "Chinese Teachers’ Perceptions on Perceived Teacher Support and Student Engagement," Environ.-Behav. Proc. J., vol. 9, no. 30, pp. 57-62, 2024.
C. Fischer, E. Witherspoon, H. Nguyen, Y. Feng, S. Fiorini, P. Vincent‐Ruz, and C. Schunn, "Advanced placement course credit and undergraduate student success in gateway science courses," J. Res. Sci. Teach., vol. 60, no. 2, pp. 304-329, 2023.
M. Abou Naaj, R. Mehdi, E. A. Mohamed, and M. Nachouki, "Analysis of the factors affecting student performance using a neuro-fuzzy approach," Educ. Sci., vol. 13, no. 3, p. 313, 2023.
S. M. F. D. Syed Mustapha, "Predictive analysis of students’ learning performance using data mining techniques: A comparative study of feature selection methods," Appl. Syst. Innov., vol. 6, no. 5, p. 86, 2023.
N. Ribeiro, C. Malafaia, T. Neves, and I. Menezes, "The impact of extracurricular activities on university students’ academic success and employability," Eur. J. Higher Educ., vol. 14, no. 3, pp. 389-409, 2024.
V. Dang. Employability development through extracurricular activities: A case study of AIESEC membership. Bachelor's thesis, 2023.
N. Shah, S. Bano, U. N. Saraih, N. A. A. Abdelwahed, and B. A. Soomro, "Leading towards the students’ career development and career intentions through using multidimensional soft skills in the digital age," Educ. Train., vol. 65, no. 6/7, pp. 848-870, 2023.
G. Chapman, W. Emambocus, and D. Obembe, "Higher education student motivations for extracurricular activities: Evidence from UK universities," J. Educ. Work, vol. 36, no. 2, pp. 138-152, 2023.
O. O. Ayeni, C. C. Unachukwu, N. M. Al Hamad, O. N. Chisom, and O. E. Adewusi, "The impact of robotics clubs on K-12 students' interest in STEM careers," Magna Scientia Adv. Res. Rev., vol. 10, no. 1, pp. 361-367, 2024.
O. O. Ayeni, C. C. Unachukwu, N. M. Al Hamad, B. Osawaru, and O. E. Adewusi, "A multidisciplinary approach to STEM education: Combining HR, counseling, and mentorship," Magna Scientia Advanced Research and Reviews, vol. 10, no. 1, pp. 351-360, 2024.
Z. Zhong, H. Guo, and K. Qian, "Deciphering the impact of machine learning on education: Insights from a bibliometric analysis using bibliometrix R-package," Educ. Inf. Technol., pp. 1-28, 2024.
S. Elbanna and L. Armstrong, "Exploring the integration of ChatGPT in education: Adapting for the future," Manag. Sustainability: An Arab Rev., vol. 3, no. 1, pp. 16-29, 2024.
P. Shah, AI and the Future of Education: Teaching in the Age of Artificial Intelligence, John Wiley & Sons, 2023.
A. Dirin, C. Adriana, and S. Saballe, "Machine learning models to predict students' study path selection," Int. J. Interact. Mobile Technol., vol. 16, no. 1, pp. 158-183, 2022, doi: 10.3991/ijim.v16i01.20121.
A. Fizar, M. H. Imam, B. Sheak, R. H. Noori, T. R. Habibur, R. Hemal, M. S. Arefin, "The comparison of machine learning algorithms to find the career path by Bloom’s Taxonomy evaluation," International Conference on Big Data, IoT and Machine Learning, pp. 747-761, 2024, doi: 10.1007/978-981-99-8937-9_50.
T. Althubiti, T. M. Ahmed, and O. Alassafi, "Developing a predictive model for selecting academic track via GPA by using classification algorithms: Saudi universities as case study," Int. J. Adv. Comput. Sci. Appl., vol. 14, no. 5, 2023, doi: 10.14569/ijacsa.2023.0140539.
W. Alghamdi, "A comparative analysis on machine learning based student placement prediction," 2023 International Conference on Sustainable Communication Networks and Application (ICSCNA), pp. 986-991, 2023, doi: 10.1109/icscna58489.2023.10370392.
Y. Terawaki, T. Unoki, T. Kato, and Y. Kodama, "Performance evaluation for four types of machine learning algorithms using educational open data," Smart Education and e-Learning 2019, pp. 281-289, 2019, doi: 10.1007/978-981-13-8260-4_26.
N. S. Brohi, T. Ramiah Pillai, S. K. Kaur, H. K. Kaur, S. Sukumaran, and D. Asirvatham, "Accuracy comparison of machine learning algorithms for predictive analytics in higher education," Emerging Technologies in Computing: Second International Conference, iCETiC 2019, London, UK, August 19–20, 2019, Proceedings 2, pp. 254-261, 2019, doi: 10.1007/978-3-030-23943-5_19.
H. S. Thapa, "Development of employability skills through work-based learning," Journal of Technical and Vocational Education and Training (TVET), vol. 18, no. 1, pp. 102-111, 2024.
C. O. Elom, U. C. Okolie, C. C. Uwaleke, C. C. Umoke, S. O. Abonyi, and A. O. Nwele, "The effect of openness to experience on students’ readiness for school-to-work transition," Journal of Career Assessment, vol. 32, 2024.
T. X. Tolqunovna and M. N. Leonodovna, "Understanding the pedagogical basis of students' interest in professions: A comprehensive analysis," International Journal of Advance Scientific Research, vol. 4, no. 3, pp. 118-126, 2024.
A. Samagaio, P. Morais Francisco, and T. Felício, "The relationship between soft skills, stress and reduced audit quality practices," Review of Accounting and Finance, vol. 23, no. 3, pp. 353-374, 2024.
A. Chelis, In the heart of data: machine learning applications for improved heart failure outcome prediction. Master's thesis, Πανεπιστήμιο Πειραιώς, 2024.
T. A. Shaikh, T. Rasool, P. Verma, and W. A. Mir, "A fundamental overview of ensemble deep learning models and applications: systematic literature and state of the art," Annals of Operations Research, pp. 1-77, 2024.
K. U. Apu, M. Ali, M. F. Islam, and M. Miah, "A systematic literature review on AI approaches to address data imbalance in machine learning," Frontiers in Applied Engineering and Technology, vol. 2, no. 01, pp. 58-77, 2025.
X. Lu and L. Wei, "Teaching reform and innovation of vocational development and employment guidance courses in colleges and universities based on random forest model," Applied Mathematics and Nonlinear Sciences, 2024.
S. Bankins, S. Jooss, S. L. D. Restubog, M. Marrone, A. C. Ocampo, and M. Shoss, "Navigating career stages in the age of artificial intelligence: A systematic interdisciplinary review and agenda for future research," Journal of Vocational Behavior, p. 104011, 2024.
L. R. Pelima, Y. Sukmana, and Y. Rosmansyah, "Predicting university student graduation using academic performance and machine learning: a systematic literature review," IEEE Access, vol. 12, pp. 23451-23465, 2024.
N. A. Kuadey, C. Ankora, F. Tahiru, L. Bensah, C. C. M. Agbesi, and S. O. Bolatimi, "Using machine learning algorithms to examine the impact of technostress creators on student learning burnout and perceived academic performance," International Journal of Information Technology, vol. 16, no. 4, pp. 2467-2482, 2024.
M. A. Ayanwale, R. R. Molefi, and S. Oyeniran, "Analyzing the evolution of machine learning integration in educational research: a bibliometric perspective," Discover Education, vol. 3, no. 1, pp. 47, 2024.
A. Kukkar, R. Mohana, A. Sharma, and A. Nayyar, "A novel methodology using RNN+ LSTM+ ML for predicting student’s academic performance," Education and Information Technologies, pp. 1-37, 2024.
C. Song, S. Y. Shin, and K. S. Shin, "Implementing the Dynamic Feedback-Driven Learning Optimization Framework: A machine learning approach to personalize educational pathways," Applied Sciences, vol. 14, no. 2, p. 916, 2024.
A. B. Feroz Khan and S. R. A. Samad, "Evaluating online learning adaptability in students using machine learning-based techniques: A novel analytical approach," Educ. Sci. Manag., vol. 2, no. 1, pp. 25-34, 2024.
R. AlAli, Y. Wardat, S. Saleh, and N. Alshraifin, "Evaluation of STEM-Aligned Teaching Practices for Gifted Mathematics Teachers," European Journal of STEM Education, vol. 9, no. 1, p. 08, 2024.
D. Al Kez, C. Lowans, and A. Foley, "Sustainable Development in Third Level Programs: Distilling a Pathway to a True Net-Zero Education," Sustainability, vol. 16, no. 5, p. 1998, 2024.
H. E. Gandolfi, "Teaching in the age of environmental emergencies: A 'utopian' exploration of the experiences of teachers committed to environmental education in England," Educational Review, vol. 76, no. 7, pp. 1786-1806, 2024.
M. Renkema and A. Tursunbayeva, "The future of work of academics in the age of Artificial Intelligence: State-of-the-art and a research roadmap," Futures, vol. 163, p. 103453, 2024.
E. Langran, M. Searson, and J. Trumble, "Transforming Teacher Education in the Age of Generative AI," in Exploring New Horizons: Generative Artificial Intelligence and Teacher Education, vol. 2, 2024.
N. A. M. Zin and M. S. Mahmud, "Perceptions of Malaysian University Mathematics Instructors of the Challenges they Face in Implementing Effective Distance Learning," International Journal of Learning, Teaching and Educational Research, vol. 23, no. 5, pp. 158-179, 2024.
T. Feraco, D. Resnati, D. Fregonese, A. Spoto, and C. Meneghetti, "An integrated model of school students’ academic achievement and life satisfaction. Linking soft skills, extracurricular activities, self-regulated learning, motivation, and emotions," European Journal of Psychology of Education, vol. 38, no. 1, pp. 109-130, 2023.
J. C. H. So, Y. H. Ho, A. K. L. Wong, H. C. Chan, K. H. Y. Tsang, A. P. L. Chan, and S. C. W. Wong, "Analytic study for predictor development on student participation in generic competence development activities based on academic performance," IEEE Transactions on Learning Technologies, vol. 16, no. 5, pp. 790-803, 2023.
X. Li, S. Duan, and H. Liu, "Unveiling the predictive effect of students’ perceived EFL teacher support on academic achievement: the mediating role of academic buoyancy," Sustainability, vol. 15, no. 13, p. 10205, 2023.
Downloads
Published
Issue
Section
License
Copyright (c) 2025 Bauyrzhan Berlikozha, Azamat Serek, Tamara Zhukabayeva, Azamat Zhamanov, Oliver Dias
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
This journal is based on the work at https://journal.umy.ac.id/index.php/jrc under license from Creative Commons Attribution-ShareAlike 4.0 International License. You are free to:
- Share – copy and redistribute the material in any medium or format.
- Adapt – remix, transform, and build upon the material for any purpose, even comercially.
The licensor cannot revoke these freedoms as long as you follow the license terms, which include the following:
- Attribution. You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
- ShareAlike. If you remix, transform, or build upon the material, you must distribute your contributions under the same license as the original.
- No additional restrictions. You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.
• Creative Commons Attribution-ShareAlike (CC BY-SA)
JRC is licensed under an International License
