PCA-Based Labeling of Student Academic and Non-Academic Achievement: A Comparison of Data Transformation Methods
Abstract
Variance preservation does not necessarily establish meaningful achievement categories. This study compares six data transformations for principal component analysis (PCA)-based labeling using records from SMAN 1 Kertosono in 2024/2025. Academic data comprise 216 semester observations from 108 students in Grades X–XII; non-academic data comprise 144 observations from 72 students in Grades X–XI. Normalizer, StandardScaler, MinMaxScaler, MaxAbsScaler, RobustScaler, and QuantileTransformer were evaluated using student-grouped nested cross-validation. Transformations were selected by inner-validation macro F1 against teacher assessments. PCA fitting, sign orientation of the first principal component (PC1), and estimation of the one-third and two-thirds quantiles were confined to training data. These quantiles defined Low, Medium, and High categories for held-out students. MaxAbsScaler was selected in all five academic development sets, yielding 73.15% accuracy, macro F1 of 0.7233, and Cohen's kappa of 0.5982. Academic PC1 explained 81.07–82.16% of transformed training variance, but labeling did not outperform the raw-score tertile baseline. Non-academic selections varied across folds, yielding 27.78% accuracy, macro F1 of 0.2377, and kappa of −0.0904. Non-academic PC1 explained 17.48–27.86% of variance and primarily contrasted activity profiles, limiting its interpretation as an achievement scale. The contribution is an empirical evaluation separating variance retention, component interpretation, and teacher agreement. Results support a limited descriptive interpretation of academic PC1 but do not support the current non-academic categories as an overall achievement ranking. Findings are restricted to one school and require independent validation.
Keywords
Full Text:
PDFReferences
[1] C. Romero and S. Ventura. “Educational data mining and learning analytics: An updated survey”. In: WIREs Data Mining and Knowledge Discovery 10.3, e1355 (2020). doi: 10.1002/widm.1355.
[2] S. Gunasekara and M. Saarela. “Explainability in Educational Data Mining and Learning Analytics: An Umbrella Review”. In: Proceedings of the 17th International Conference on Educational Data Mining. 2024, pp. 887–892. doi: 10.5281/zenodo.12729987.
[3] I. T. Jolliffe and J. Cadima. “Principal component analysis: a review and recent developments”. In: Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences 374.2065, 20150202 (2016). doi: 10.1098/rsta.2015.0202.
[4] A. T. W. Almais et al. “Principal Component Analysis-Based Data Clustering for Labeling of Level Damage Sector in Post-Natural Disasters”. In: IEEE Access 11 (2023), pp. 74590–74601. doi: 10.1109/access.2023.3275852.
[5] scikit-learn developers. Preprocessing data. Version 1.8.0. URL: https://scikit-learn.org/1.8/modules/preprocessing.html (visited on 10/07/2026).
[6] S. Varma and R. Simon. “Bias in error estimation when using cross-validation for model selection”. In: BMC Bioinformatics 7, 91 (2006). doi: 10.1186/1471-2105-7-91.
[7] S. Kapoor and A. Narayanan. “Leakage and the reproducibility crisis in machine-learning-based science”. In: Patterns 4.9, 100804 (2023). doi: 10.1016/j.patter.2023.100804.
[8] J. Cohen. “A Coefficient of Agreement for Nominal Scales”. In: Educational and Psychological Measurement 20.1 (1960), pp. 37–46. doi: 10.1177/001316446002000104.
[9] F. Pedregosa et al. “Scikit-learn: Machine Learning in Python”. In: Journal of Machine Learning Research 12 (2011), pp. 2825–2830. URL: https://jmlr.org/papers/v12/pedregosa11a.html.
[10] scikit-learn developers. PCA. Version 1.8.0. URL: https://scikit-learn.org/1.8/modules/generated/sklearn.decomposition.PCA.html (visited on 10/07/2026).
[11] R. J. Hyndman and Y. Fan. “Sample Quantiles in Statistical Packages”. In: The American Statistician 50.4 (1996), pp. 361–365. doi: 10.1080/00031305.1996.10473566.
[12] NumPy developers. numpy.quantile. Version 2.3. NumPy. URL: https://numpy.org/doc/2.3/reference/generated/numpy.quantile.html (visited on 10/07/2026).
[13] M. Sokolova and G. Lapalme. “A systematic analysis of performance measures for classification tasks”. In: Information Processing & Management 45.4 (2009), pp. 427–437. doi: 10.1016/j.ipm.2009.03.002.
[14] scikit-learn developers. precision_recall_fscore_support. Version 1.8.0. URL: https://scikit-learn.org/1.8/modules/generated/sklearn.metrics.precision_recall_fscore_support.html (visited on 10/07/2026).
[15] scikit-learn developers. LogisticRegression. Version 1.8.0. URL: https://scikit-learn.org/1.8/modules/generated/sklearn.linear_model.LogisticRegression.html (visited on 10/07/2026).
DOI: https://doi.org/10.18860/cauchy.v11i2.45741
Refbacks
- There are currently no refbacks.
Copyright (c) 2026 Salsabila Alya Putri Waluyo, Dr. Agung Teguh Wibowo Almais, M.T, Cahyo Crysdian

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Editorial Office
Mathematics Department,
Maulana Malik Ibrahim State Islamic University of Malang
Gajayana Street 50 Malang, East Java, Indonesia 65144
e-mail: cauchy@uin-malang.ac.id

CAUCHY: Jurnal Matematika Murni dan Aplikasi is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.







