Intelligent analysis of applicant classification using neural networks based on an adaptive activation function.
Keywords:
machine learning, deep learning, data augmentation, recommendation systems, university admission, adaptive activationAbstract
The process of selecting a specialization during university admission represents a critical decision in an applicant’s academic trajectory, directly influencing future career prospects and professional development. However, due to the constraints of limited information available at the time of selection, applicants are susceptible to suboptimal decision-making, which may result in academic dissatisfaction, diminished performance and potential changes in their field of study. In recent years, machine learning methodologies have been extensively investigated for their potential in developing intelligent recommendation systems capable of integrating a broad spectrum of factors to enhance decision-making personalization. This study presents the development of an advanced recommendation system leveraging a neural network-based framework, wherein the core innovation lies in the implementation of an adaptive activation function. Unlike conventional activation functions, this approach dynamically adjusts the response characteristics of neurons, thereby augmenting model flexibility during training and improving predictive accuracy. A comparative evaluation between a baseline model and the proposed adaptive activation model is conducted, demonstrating a statistically significant improvement in classification accuracy for specialization recommendation. The empirical results substantiate the efficacy of the proposed approach in optimizing applicant decision support within the university admission process.
References
Agarap, A. F. (2018). Deep learning using Rectified Linear Units (ReLU) [arXiv preprint arXiv:1803.08375]. https://arxiv.org/abs/1803.08375
Alyahyan, E., & Düştegör, D. (2020). Predicting academic success in higher education: Literature review and best practices. International Journal of Educational Technology in Higher Education, 17(3). https://doi.org/10.1186/s41239-020-0177-7
Apicella, A., Donnarumma, F., Isgrò, F., & Prevete, R. (2021). A survey on modern trainable activation functions. Neural Networks, 138, 14–32. https://doi.org/10.1016/j.neunet.2021.01.026
Drachsler, H., Hummel, H. G. K., & Koper, R. (2008). Personal recommender systems for learners in lifelong learning networks: The requirements, techniques and model. International Journal of Learning Technology, 3(4), 404–423. https://doi.org/10.1504/IJLT.2008.019376
Even-Dar, E., Mannor, S., & Mansour, Y. (2006). Action elimination and stopping conditions for the multi-armed bandit and reinforcement learning problems. Journal of Machine Learning Research, 7, 1079–1105. (Original work published as arXiv preprint: cs/0206020)
Fong, S., & Biuk-Aghai, R. P. (2009). An automated university admission recommender system for secondary school students. In Proceedings of the 6th International Conference on Information Technology and Applications (ICITA) (pp. 37–42). Hanoi, Vietnam. Retrieved from https://www.researchgate.net/publication/221154329_An_Automated_University_Admission_Recommender_System_for_Secondary_School_Students
Jabeen, H., & Baig, A. R. (2010). Review of classification using genetic programming. International Journal of Engineering Science and Technology, 2(2), 94–103. Retrieved from https://www.researchgate.net/publication/275022403_Review_of_classification_using_genetic_programming
Lee, K., Yang, J., Lee, H., & Hwang, J. Y. (2022). Stochastic adaptive activation function [arXiv preprint arXiv:2210.11672]. https://arxiv.org/abs/2210.11672
Lin, X., Zhong, G., Chen, K., Li, Q., & Huang, K. (2021). Attention-Augmented Machine Memory. Cognitive Computation, 13(3), 751–760. https://doi.org/10.1007/s12559-021-09854-5
Lops, P., de Gemmis, M., & Semeraro, G. (2011). Content-based recommender systems: State of the art and trends. In F. Ricci, L. Rokach, B. Shapira, & P. B. Kantor (Eds.), Recommender Systems Handbook (1st ed., pp. 73–105). Springer. https://doi.org/10.1007/978-0-387-85820-3_3
Ma, C., Wu, J., Si, C., & Tan, K. C. (2024). Scaling supervised local learning with augmented auxiliary networks [arXiv preprint arXiv:2402.17318]. https://arxiv.org/abs/2402.17318
Molina, M., & Blasco, G. (2003). A multi-agent system for emergency decision support. In Lecture Notes in Computer Science (Vol. 2669, pp. 43–51). https://doi.org/10.1007/978-3-540-45080-1_6
Romero, C., & Ventura, S. (2010). Educational data mining: A review of the state of the art. IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews), 40(6), 601–618. https://doi.org/10.1109/TSMCC.2010.2053532
Sakho, A., Malherbe, E., & Scornet, E. (2024). Do we need rebalancing strategies? A theoretical and empirical study around SMOTE and its variants [arXiv preprint arXiv:2402.03819]. https://arxiv.org/abs/2402.03819
Sebastiani, F. (2002). Machine learning in automated text categorization. ACM Computing Surveys, 34(1), 1–47. https://doi.org/10.1145/505282.505283
Miftahul, J. M., Sumi, K., & Mohammad, S. A. (2020). A content-based recommender system for choosing universities. Turkish Journal of Electrical Engineering & Computer Sciences, 28(4), 2128–2142. https://doi.org/10.3906/elk-1911-37
Misra, D. (2020). Mish: A self regularized non-monotonic activation function [arXiv preprint arXiv:1908.08681]. https://arxiv.org/abs/1908.08681
