PCA-Based Labeling of Student Academic and Non-Academic Achievement: A Comparison of Data Transformation Methods

Salsabila Alya Putri Waluyo, Agung Teguh Wibowo Almais, Cahyo Crysdian

Abstract


Variance preservation does not necessarily establish meaningful achievement categories. This study compares six data transformations for principal component analysis (PCA)-based labeling using records from SMAN 1 Kertosono in 2024/2025. Academic data comprise 216 semester observations from 108 students in Grades X–XII; non-academic data comprise 144 observations from 72 students in Grades X–XI. Normalizer, StandardScaler, MinMaxScaler, MaxAbsScaler, RobustScaler, and QuantileTransformer were evaluated using student-grouped nested cross-validation. Transformations were selected by inner-validation macro F1 against teacher assessments. PCA fitting, sign orientation of the first principal component (PC1), and estimation of the one-third and two-thirds quantiles were confined to training data. These quantiles defined Low, Medium, and High categories for held-out students. MaxAbsScaler was selected in all five academic development sets, yielding 73.15% accuracy, macro F1 of 0.7233, and Cohen's kappa of 0.5982. Academic PC1 explained 81.07–82.16% of transformed training variance, but labeling did not outperform the raw-score tertile baseline. Non-academic selections varied across folds, yielding 27.78% accuracy, macro F1 of 0.2377, and kappa of −0.0904. Non-academic PC1 explained 17.48–27.86% of variance and primarily contrasted activity profiles, limiting its interpretation as an achievement scale. The contribution is an empirical evaluation separating variance retention, component interpretation, and teacher agreement. Results support a limited descriptive interpretation of academic PC1 but do not support the current non-academic categories as an overall achievement ranking. Findings are restricted to one school and require independent validation.


Keywords


Principal Component Analysis; data standardization; data labeling; academic achievement; non-academic achievement

Full Text:

PDF

References


[1] C. Romero and S. Ventura. “Educational data mining and learning analytics: An updated survey”. In: WIREs Data Mining and Knowledge Discovery 10.3, e1355 (2020). doi: 10.1002/widm.1355.

[2] S. Gunasekara and M. Saarela. “Explainability in Educational Data Mining and Learning Analytics: An Umbrella Review”. In: Proceedings of the 17th International Conference on Educational Data Mining. 2024, pp. 887–892. doi: 10.5281/zenodo.12729987.

[3] I. T. Jolliffe and J. Cadima. “Principal component analysis: a review and recent developments”. In: Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences 374.2065, 20150202 (2016). doi: 10.1098/rsta.2015.0202.

[4] A. T. W. Almais et al. “Principal Component Analysis-Based Data Clustering for Labeling of Level Damage Sector in Post-Natural Disasters”. In: IEEE Access 11 (2023), pp. 74590–74601. doi: 10.1109/access.2023.3275852.

[5] scikit-learn developers. Preprocessing data. Version 1.8.0. URL: https://scikit-learn.org/1.8/modules/preprocessing.html (visited on 10/07/2026).

[6] S. Varma and R. Simon. “Bias in error estimation when using cross-validation for model selection”. In: BMC Bioinformatics 7, 91 (2006). doi: 10.1186/1471-2105-7-91.

[7] S. Kapoor and A. Narayanan. “Leakage and the reproducibility crisis in machine-learning-based science”. In: Patterns 4.9, 100804 (2023). doi: 10.1016/j.patter.2023.100804.

[8] J. Cohen. “A Coefficient of Agreement for Nominal Scales”. In: Educational and Psychological Measurement 20.1 (1960), pp. 37–46. doi: 10.1177/001316446002000104.

[9] F. Pedregosa et al. “Scikit-learn: Machine Learning in Python”. In: Journal of Machine Learning Research 12 (2011), pp. 2825–2830. URL: https://jmlr.org/papers/v12/pedregosa11a.html.

[10] scikit-learn developers. PCA. Version 1.8.0. URL: https://scikit-learn.org/1.8/modules/generated/sklearn.decomposition.PCA.html (visited on 10/07/2026).

[11] R. J. Hyndman and Y. Fan. “Sample Quantiles in Statistical Packages”. In: The American Statistician 50.4 (1996), pp. 361–365. doi: 10.1080/00031305.1996.10473566.

[12] NumPy developers. numpy.quantile. Version 2.3. NumPy. URL: https://numpy.org/doc/2.3/reference/generated/numpy.quantile.html (visited on 10/07/2026).

[13] M. Sokolova and G. Lapalme. “A systematic analysis of performance measures for classification tasks”. In: Information Processing & Management 45.4 (2009), pp. 427–437. doi: 10.1016/j.ipm.2009.03.002.

[14] scikit-learn developers. precision_recall_fscore_support. Version 1.8.0. URL: https://scikit-learn.org/1.8/modules/generated/sklearn.metrics.precision_recall_fscore_support.html (visited on 10/07/2026).

[15] scikit-learn developers. LogisticRegression. Version 1.8.0. URL: https://scikit-learn.org/1.8/modules/generated/sklearn.linear_model.LogisticRegression.html (visited on 10/07/2026).




DOI: https://doi.org/10.18860/cauchy.v11i2.45741

Refbacks

  • There are currently no refbacks.


Copyright (c) 2026 Salsabila Alya Putri Waluyo, Dr. Agung Teguh Wibowo Almais, M.T, Cahyo Crysdian

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

Editorial Office
Mathematics Department,
Maulana Malik Ibrahim State Islamic University of Malang
Gajayana Street 50 Malang, East Java, Indonesia 65144
e-mail: cauchy@uin-malang.ac.id

Creative Commons License
CAUCHY: Jurnal Matematika Murni dan Aplikasi is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.