(2) Herman Herman
(3) Muhammad Hafis
(4) Kurnia Cantra
*corresponding author
AbstractMental health severity assessment is often hindered by limited access to professional services and the time required for clinical evaluation. This study proposes an interpretable soft voting method to classify the severity levels of depression, anxiety, and stress using DASS-42 questionnaire data. The proposed framework integrates Logistic Regression, Random Forest, Support Vector Machine, and Extreme Gradient Boosting, and is evaluated on 35,445 anonymized responses from a public psychometric dataset. Model performance was assessed using accuracy, precision, recall, F1-score, macro-averaged and weighted F1-score and the precision-recall curve under stratified cross-validation for class imbalance between the normal and mild classes. Explainable Artificial Intelligence using SHAP was employed to interpret model decisions. The soft voting achieved strong predictive performance, with accuracy values of 0.98 for depression, 0.99 for anxiety, and 0.97 for stress, outperforming or matching individual base models. SHAP analysis identified clinically consistent features contributing to model predictions; due to computational constraints, SHAP analysis was not applied to the SVM model. Despite strong performance, the use of secondary self-reported data and class imbalance, particularly the underrepresentation of normal and mild cases, were limitations. The proposed model demonstrates the potential of interpretable soft voting as a decision-support tool for mental health severity stratification in resource-constrained settings.
KeywordsMental Health; DASS-42; Ensemble Learning; Soft Voting Classifier; Explainable AI
|
DOIhttps://doi.org/10.26555/ijain.v12i3.2385 |
Article metricsAbstract views : 185 | PDF views : 27 |
Cite |
Full Text Download
|
References
[1] V. Singh, A. Kumar, and S. Gupta, “Mental Health Prevention and Promotion—A Narrative Review,” Front. Psychiatry, vol. 13, no. July, p. 898009, Jul. 2022, doi: 10.3389/fpsyt.2022.898009.
[2] K. K. Y. Ma, J. K. Anderson, and A. Burn, “Review: School‐based interventions to improve mental health literacy and reduce mental health stigma – a systematic review,” Child Adolesc. Ment. Health, vol. 28, no. 2, pp. 230–240, May 2023, doi: 10.1111/camh.12543.
[3] “World health statistics 2025: monitoring health for the SDGs, Sustainable Development Goals,” World Health Organization, 2025. [Online]. Available at: https://www.who.int/publications/b/78420.
[4] M. Solmi et al., “Age at onset of mental disorders worldwide: large-scale meta-analysis of 192 epidemiological studies,” Mol. Psychiatry, vol. 27, no. 1, pp. 281–295, Jan. 2022, doi: 10.1038/s41380-021-01161-7.
[5] M. A. Subu et al., “Exploring mental health stigma among Indonesian healthcare students towards individuals with mental illnesses: a qualitative study,” Int. J. Qual. Stud. Health Well-being, vol. 19, no. 1, p. 11, Dec. 2024, doi: 10.1080/17482631.2024.2327103.
[6] L. Munira, P. Liamputtong, and P. Viwattanakulvanid, “Barriers and facilitators to access mental health services among people with mental disorders in Indonesia: A qualitative study,” Belitung Nurs. J., vol. 9, no. 2, pp. 110–117, Apr. 2023, doi: 10.33546/bnj.2521.
[7] A. E. Wahdi et al., “Indonesia – National Adolescent Mental Health Survey (I-NAMHS) Report (Bahasa Indonesia) - Queensland Centre for Mental Health Research (QCMHR),” QCMHR-Queensland Centre for Mental Health Research. Accessed: Mar. 31, 2026. [Online]. Available at: https://qcmhr.org/outputs/reports/12-i-namhs-report-bahasa-indonesia.
[8] M. Subotic-Kerry et al., “While they wait: a cross-sectional survey on wait times for mental health treatment for anxiety and depression for adolescents in Australia,” BMJ Open, vol. 15, no. 3, p. e087342, Mar. 2025, doi: 10.1136/bmjopen-2024-087342.
[9] M. Makara-Studzińska, E. Tyburski, M. Załuski, K. Adamczyk, J. Mesterhazy, and A. Mesterhazy, “Confirmatory Factor Analysis of Three Versions of the Depression Anxiety Stress Scale (DASS-42, DASS-21, and DASS-12) in Polish Adults,” Front. Psychiatry, vol. 12, p. 770532, Jan. 2022, doi: 10.3389/fpsyt.2021.770532.
[10] T. Timakum, Q. Xie, and M. Song, “Analysis of E-mental health research: mapping the relationship between information technology and mental healthcare,” BMC Psychiatry, vol. 22, no. 1, p. 57, Dec. 2022, doi: 10.1186/s12888-022-03713-9.
[11] R. Islam and M. A. Layek, “StackEnsembleMind: Enhancing well-being through accurate identification of human mental states using stack-based ensemble machine learning,” Informatics Med. Unlocked, vol. 43, no. 2, p. 101405, Jan. 2023, doi: 10.1016/j.imu.2023.101405.
[12] W. A. Fazraningtyas, B. Rahmatullah, H. Naparin, M. Basit, and N. A. Razak, “A predictive model for postpartum depression: ensemble learning strategies in machine learning,” Indones. J. Electr. Eng. Comput. Sci., vol. 37, no. 1, p. 443, Jan. 2025, doi: 10.11591/ijeecs.v37.i1.pp443-451.
[13] Z. Chen et al., “Identifying major depressive disorder among US adults living alone using stacked ensemble machine learning algorithms,” Front. Public Heal., vol. 13, p. 1472050, Feb. 2025, doi: 10.3389/fpubh.2025.1472050.
[14] K. Vaishnavi, U. Nikhitha Kamath, B. Ashwath Rao, and N. V Subba Reddy, “Predicting Mental Health Illness using Machine Learning Algorithms,” J. Phys. Conf. Ser., vol. 2161, no. 1, p. 012021, Jan. 2022, doi: 10.1088/1742-6596/2161/1/012021.
[15] A. Daza, Arroyo-Paz, J. Bobadilla, O. Apaza, and J. Pinto, “Stacking ensemble learning model for predict anxiety level in university students using balancing methods,” Informatics Med. Unlocked, vol. 42, no. 4, p. 101340, Jan. 2023, doi: 10.1016/j.imu.2023.101340.
[16] A. Daza Vergaray, J. C. H. Miranda, J. B. Cornelio, A. R. López Carranza, and C. F. Ponce Sánchez, “Predicting the depression in university students using stacking ensemble techniques over oversampling method,” Informatics Med. Unlocked, vol. 41, p. 101295, Jan. 2023, doi: 10.1016/j.imu.2023.101295.
[17] K. Battista, L. Diao, K. A. Patte, J. A. Dubin, and S. T. Leatherdale, “Examining the use of decision trees in population health surveillance research: an application to youth mental health survey data in the COMPASS study,” Heal. Promot. Chronic Dis. Prev. Canada, vol. 43, no. 2, pp. 73–86, Feb. 2023, doi: 10.24095/hpcdp.43.2.03.
[18] S. A. Sulak and N. Koklu, “Analysis of Depression, Anxiety, Stress Scale (DASS‐42) With Methods of Data Mining,” Eur. J. Educ., vol. 59, no. 4, p. e12778, Dec. 2024, doi: 10.1111/ejed.12778.
[19] A. Siddiqua, A. M. Oni, A. Saleh Musa Miah, and J. Shin, “Enhancing PTSD Outcome Prediction with Ensemble Models in Disaster Contexts,” in 2025 International Conference on Electrical, Computer and Communication Engineering (ECCE), IEEE, Feb. 2025, pp. 1–6. doi: 10.1109/ECCE64574.2025.11013125.
[20] S. Hadhri, M. Hadiji, and W. Labidi, “A voting ensemble classifier for stress detection,” J. Inf. Telecommun., vol. 8, no. 3, pp. 399–416, Jul. 2024, doi: 10.1080/24751839.2024.2306786.
[21] K. Akyol, E. Uçar, Ü. Atila, and M. Uçar, “An ensemble approach for classification of tympanic membrane conditions using soft voting classifier,” Multimed. Tools Appl., vol. 83, no. 32, pp. 77809–77830, Feb. 2024, doi: 10.1007/s11042-024-18631-z.
[22] L. Hermawan et al., “Early Mental Health Detection with Machine Learning : A Practical Approach to Model Development and Implementation,” Indones. J. Electr. Eng. Informatics, vol. 13, no. 2, pp. 509–524, Jun. 2025, doi: 10.52549/ijeei.v13i2.6111.
[23] J. Biswas, M. N. Hasan, M. S. R. Gazi, and M. M. Rahman, “Enhancing mental well-being: An artificial intelligence model for predicting mental disorders,” Array, vol. 26, no. July, p. 100417, Jul. 2025, doi: 10.1016/j.array.2025.100417.
[24] H. G. Jabbar, “Advanced Threat Detection Using Soft and Hard Voting Techniques in Ensemble Learning,” J. Robot. Control, vol. 5, no. 4, pp. 1104–1116, Jun. 2024, doi: 10.18196/JRC.V5I4.22005.
[25] S. Kudlapura Shivaiah, K. Krishnappa, N. Kumar Boraiah, P. Deepa Shenoy, and V. Kuppanna Rajuk, “Prediction of mental illness using ensemble model and grid search hyperparameter optimization,” Bull. Electr. Eng. Informatics, vol. 13, no. 5, pp. 3726–3736, Oct. 2024, doi: 10.11591/eei.v13i5.7309.
[26] S. S. Shinde and A. S. Ghotkar, “From Questionnaires to Actionable Insights: Machine Learning for Mental Stress Detection,” Eng. Technol. Appl. Sci. Res., vol. 15, no. 6, pp. 29240–29250, Dec. 2025, doi: 10.48084/etasr.13513.
[27] T. ShamsEldin et al., “Artificial intelligence for predicting depression anxiety and stress using psychometric data,” Sci. Rep., vol. 15, no. 1, p. 37282, Oct. 2025, doi: 10.1038/s41598-025-21301-1.
[28] A. Rai, “Explainable AI: from black box to glass box,” J. Acad. Mark. Sci., vol. 48, no. 1, pp. 137–141, Jan. 2020, doi: 10.1007/S11747-019-00710-5/TABLES/1.
[29] M. Ali, S. Ali, Q. Abbas, Z. Abbas, and S. W. Lee, “Artificial intelligence for mental health: A narrative review of applications, challenges, and future directions in digital health,” Digit. Heal., vol. 11, pp. 1–25, May 2025, doi: 10.1177/20552076251395548.
[30] P. Cruz-Gonzalez et al., “Artificial intelligence in mental health care: a systematic review of diagnosis, monitoring, and intervention applications,” Psychol. Med., vol. 55, p. e18, Feb. 2025, doi: 10.1017/S0033291724003295.
[31] R. Tornero-Costa, A. Martinez-Millana, N. Azzopardi-Muscat, L. Lazeri, V. Traver, and D. Novillo-Ortiz, “Methodological and Quality Flaws in the Use of Artificial Intelligence in Mental Health Research: Systematic Review,” JMIR Ment. Heal., vol. 10, no. 1, p. e42045, Feb. 2023, doi: 10.2196/42045.
[32] H. Semmelrock et al., “Reproducibility in machine‐learning‐based research: Overview, barriers, and drivers,” AI Mag., vol. 46, no. 2, p. e70002, Jun. 2025, doi: 10.1002/aaai.70002.
[33] S. Hameed, M. Nauman, N. Akhtar, M. A. B. Fayyaz, and R. Nawaz, “Explainable AI-driven depression detection from social media using natural language processing and black box machine learning models,” Front. Artif. Intell., vol. 8, p. 1627078, Sep. 2025, doi: 10.3389/frai.2025.1627078.
[34] E. Kerz, S. Zanwar, Y. Qiao, and D. Wiechmann, “Toward explainable AI (XAI) for mental health detection based on language behavior,” Front. Psychiatry, vol. 14, p. 1219479, Dec. 2023, doi: 10.3389/fpsyt.2023.1219479.
[35] E.-S. Atlam et al., “Explainable artificial intelligence systems for predicting mental health problems in autistics,” Alexandria Eng. J., vol. 117, no. April, pp. 376–390, Apr. 2025, doi: 10.1016/j.aej.2024.12.120.
[36] J. J. Wadden, “Defining the undefinable: the black box problem in healthcare artificial intelligence,” J. Med. Ethics, vol. 48, no. 10, pp. 764–768, Oct. 2022, doi: 10.1136/medethics-2021-107529.
[37] N. Thalpage, “Unlocking the Black Box: Explainable Artificial Intelligence (XAI) for Trust and Transparency in AI Systems,” J. Digit. Art Humanit., vol. 4, no. 1, pp. 31–36, Jun. 2023, doi: 10.33847/2712-8148.4.1_4.
[38] S. Hur et al., “Comparison of SHAP and clinician friendly explanations reveals effects on clinical decision behaviour,” npj Digit. Med., vol. 8, no. 1, p. 578, Sep. 2025, doi: 10.1038/s41746-025-01958-8.
[39] Z. Ding et al., “Trade-offs between machine learning and deep learning for mental illness detection on social media,” Sci. Rep., vol. 15, no. 1, p. 14497, Apr. 2025, doi: 10.1038/s41598-025-99167-6.
[40] J. Chung and J. Teo, “Single classifier vs. ensemble machine learning approaches for mental health prediction,” Brain Informatics, vol. 10, no. 1, p. 1, Dec. 2023, doi: 10.1186/s40708-022-00180-6.
[41] C. Schröer, F. Kruse, and J. M. Gómez, “A Systematic Literature Review on Applying CRISP-DM Process Model,” Procedia Comput. Sci., vol. 181, pp. 526–534, Jan. 2021, doi: 10.1016/j.procs.2021.01.199.
[42] P. F. Lovibond and S. H. Lovibond, “The structure of negative emotional states: Comparison of the Depression Anxiety Stress Scales (DASS) with the Beck Depression and Anxiety Inventories,” Behav. Res. Ther., vol. 33, no. 3, pp. 335–343, Mar. 1995, doi: 10.1016/0005-7967(94)00075-U.
[43] V. Berisha et al., “Digital medicine and the curse of dimensionality,” npj Digit. Med., vol. 4, no. 1, p. 153, Oct. 2021, doi: 10.1038/s41746-021-00521-5.
[44] A. Rácz, D. Bajusz, and K. Héberger, “Effect of Dataset Size and Train/Test Split Ratios in QSAR/QSPR Multiclass Classification,” Molecules, vol. 26, no. 4, p. 1111, Feb. 2021, doi: 10.3390/molecules26041111.
[45] M. T R, V. K. V, D. K. V, O. Geman, M. Margala, and M. Guduri, “The stratified K-folds cross-validation and class-balancing methods with high-performance ensemble classifiers for breast cancer classification,” Healthc. Anal., vol. 4, no. December, p. 100247, Dec. 2023, doi: 10.1016/j.health.2023.100247.
[46] G. Van den Broeck, A. Lykov, M. Schleich, and D. Suciu, “On the Tractability of SHAP Explanations,” J. Artif. Intell. Res., vol. 74, pp. 851–886, Jun. 2022, doi: 10.1613/jair.1.13283.
[47] A. M. Salih et al., “A Perspective on Explainable Artificial Intelligence Methods: SHAP and LIME,” Adv. Intell. Syst., vol. 7, no. 1, p. 2400304, Jan. 2025, doi: 10.1002/aisy.202400304.

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
___________________________________________________________
International Journal of Advances in Intelligent Informatics
ISSN 2442-6571 (print) | 2548-3161 (online)
Organized by UAD and ASCEE Computer Society
Published by Universitas Ahmad Dahlan
W: http://ijain.org
E: info@ijain.org (paper handling issues)
andri.pranolo.id@ieee.org (publication issues)
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0

























Download