A Simulation Study On The Robustness Of Bayesian Structural Equation Modeling Under Small Samples, Heavy Tails, and Collinearity

Agustina Susi Susanti Parung, Ani Budi Astuti, Rahma Fitriani

Abstract


Bayesian Structural Equation Modeling (BSEM) is increasingly used in health and social research, yet its operating characteristics under district-level constraints remain under-documented when three difficulties co-occur: small sample sizes, heavy-tailed errors, and strong correlations among exogenous constructs. We evaluate BSEM robustness using a Monte Carlo simulation with a fixed full-mediation SEM comprising four latent variables (two exogenous constructs, a mediator, and an outcome) and three reflective indicators per construct. A balanced 2×2×2 design varies sample size (n ∈ {22, 75}), error family (Normal vs. Student-t with ν = 5, variance-matched), and exogenous correlation (ρ ∈ {0.30, 0.80}). For each scenario, R = 50 independent datasets are generated and fitted using MCMC (Stan/NUTS via blavaan). We summarize global fit via posterior predictive p-values (PPP), sampling quality via \hat{R} and effective sample size (ESS), and sampler diagnostics including divergent transitions, alongside parameter recovery via Monte Carlo bias, RMSE, and 95% credible-interval coverage for structural paths, mediated effects, and ρ. Across conditions, increasing n improves both parameter recovery and sampling behavior. The most fragile settings occur when n = 22 and ρ is high, where the parallel paths X1→M and X2→M become weakly identified and heavy-tailed errors can further degrade precision. These results provide practical guidance for applying BSEM to district-level studies with limited sample sizes.


Keywords


Bayesian structural equation modeling; collinearity; heavy tails; simulation study;small sample size.

Full Text:

PDF

References


[1] S. P. Manongga, H. Hendry, and D. H. F. Manongga, “Predicting a stunting prevalence using semi-supervised learning models in east nusa tenggara,” International Journal of Innovative Computing, Information and Control, vol. 19, no. 4, pp. 1073–1086, 2023. doi:10.24507/ijicic.19.04.1073.

[2] M. Ariani, “Determinan penyebab kejadian stunting pada balita: Tinjauan literatur,” Dinamika Kesehatan: Jurnal Kebidanan dan Keperawatan, vol. 11, no. 1, pp. 172–186, Jul. 2020. doi: 10.33859/dksm.v11i1.559.

[3] T. A. E. Permatasari, Y. Chadirin, Ernirita, F. Elvira, and B. A. Putri, “The association of sociodemographic, nutrition, and sanitation on stunting in children under five in rural area of west java province in indonesia,” Journal of Public Health Research, vol. 12, no. 3, Jul. 2023. doi: 10.1177/22799036231197169.

[4] T. A.Whittaker and R. E. Schumacker, A Beginner’s Guide to Structural Equation Modeling.New York: Routledge, 2022. doi: 10.4324/9781003044017.

[5] R. H. 573 Hoyle, Ed., Handbook of Structural Equation Modeling. London and New York: The Guilford Press, 2023.

[6] J. C. Westland, Structural Equation Models (Studies in Systems, Decision and Control). Cham: Springer International Publishing, 2019, vol. 22. doi: 10.1007/978-3-030-12508-0.

[7] A. Robitzsch, “Comparing the robustness of the structural after measurement (sam) approach to structural equation modeling (sem) against local model misspecifications with alternative,” Stats, vol. 3, no. 2, pp. 631–672, 2022. doi: 10.3390/stats3020009.

[8] L. J. Jobst, M. Auerswald, and M. Moshagen, “The effect of latent and error non-normality on measures of fit in structural equation modeling,” Educational and Psychological Measurement, 2022. doi: 10.1177/00131644211046201.

[9] M. E. Civelek, Essentials of structural equation modeling, Zea Books, Mar. 2018. doi:10.13014/K2SJ1HR5.

[10] N. W. S. Wardhani, W. H. Nugroho, A. A. R. Fernandes, and S. Solimun, “Structural equation modeling (sem) analysis with warppls approach based on theory of planned behavior (tpb),” Mathematics and Statistics, vol. 8, no. 3, pp. 311–322, 2020. doi: 10.13189/ms.2020.080310.

[11] J. J. Thakkar, Structural Equation Modelling (Studies in Systems, Decision and Control). Singapore: Springer Singapore, 2020, vol. 285. doi: 10.1007/978-981-15-3793-6.

[12] W. H. Nugroho, N.W. S.Wardhani, A. A. R. Fernandes, and S. Solimun, “Robust regression analysis study for data with outliers at some significance levels,” Mathematics and Statistics, vol. 8, no. 4, pp. 373–381, 2020. doi: 10.13189/ms.2020.080401.

[13] S. Depaoli, Bayesian Structural Equation Modeling. New York, United States of America:The Guilford Press, 2021.

[14] H. Liu, W. Qu, Z. Zhang, and H. Wu, “A new bayesian structural equation modeling approach with priors on the covariance matrix parameter,” Journal of Behavioral Data Science, vol. 2, no. 2, pp. 1–24, 2022. doi: 10.35566/jbds/v2n2/p2.

[15] A. Gelman, J. B. Carlin, H. S. Stern, D. B. Dunson, A. Vehtari, and D. B. Rubin, Bayesian Data Analysis, Third. CRC Press, 2014.

[16] A. A. Johnson, M. Q. Ott, and M. Dogucu, Bayes Rules! Boca Raton: Chapman and Hall/CRC, 2022. doi: 10.1201/9780429288340.

[17] L. Ben, A Student’s Guide to Bayesian Statistics, 1st ed. London: SAGE Publications, 2018.

[18] X. Y. Song and S. Y. Lee, “A tutorial on the bayesian approach for analyzing structural equation models,” Journal of Mathematical Psychology, vol. 56, no. 3, pp. 135–148, 2012. doi: 10.1016/j.jmp.2012.02.001.

[19] R. Jacobucci and K. J. Grimm, “Comparison of frequentist and bayesian regularization in structural equation modeling,” Structural Equation Modeling: A Multidisciplinary Journal, vol. 25, no. 4, pp. 639–649, Jul. 2018. doi: 10.1080/10705511.2017.1410822.

[20] R. McElreath, Statistical Rethinking: A Bayesian Course with Examples in R and Stan. CRC Press, 2020.

[21] E. C. Merkle and Y. Rosseel, “blavaan: Bayesian structural equation models via parameter expansion,” Journal of Statistical Software, vol. 85, no. 4, pp. 1–30, 2018. doi: 10.18637/jss.v085.i04.

[22] E. C. Merkle, E. Fitzsimmons, J. Uanhoro, and B. Goodrich, “Efficient Bayesian structural equation modeling in Stan,” Journal of Statistical Software, vol. 100, no. 6, pp. 1–22, 2021.doi: 10.18637/jss.v100.i06.




DOI: https://doi.org/10.18860/cauchy.v11i1.41328

Refbacks

  • There are currently no refbacks.


Copyright (c) 2026 Agustina Susi Susanti Parung, Ani Budi Astuti, Rahma Fitriani

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

Editorial Office
Mathematics Department,
Universitas Islam Negeri Maulana Malik Ibrahim Malang
Gajayana Street 50 Malang, East Java, Indonesia 65144
Faximile (+62) 341 558933
e-mail: cauchy@uin-malang.ac.id

Creative Commons License
CAUCHY: Jurnal Matematika Murni dan Aplikasi is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.