Assessing the effectiveness of MISHEQA for internal quality assurance: a multi-stakeholder evaluation
Article Sidebar
Main Article Content
Abstract
The Higher Education Service Institutes (LLDIKTI) Region VII in Indonesia oversees quality assurance for 334 private higher education institutions (HEIs) in East Java. In 2019, it launched the MISHEQA system to support reporting of Internal Quality Assurance System (IQAS) implementation. However, a major issue arose: 26% of HEIs (88 out of 334 institutions) did not report their IQAS data through MISHEQA in 2021, showing a significant increase compared to 11% (35 out of 318 institutions) in 2020. This study assesses the effectiveness of MISHEQA from multiple stakeholder perspectives using the Technology Acceptance Model (TAM), examining how perceived usefulness and ease of use influenced user acceptance. A qualitative approach was used, combining in-depth interviews, surveys (82 respondents), and FGD with six HEIs, LLDIKTI officials, and quality assurance experts. Thematic analysis was conducted to identify patterns in user experience and system implementation. Three major findings emerged. First, MISHEQA was seen as useful by institutions in the yellow and red clusters, with the reporting and upload features noted as most beneficial. Second, some features were considered redundant: the IQAS document upload feature overlapped with the PPEPP cycle, and the Research and Community Service feature duplicated tracking already conducted via SINTA. Third, findings highlighted the importance of system integration and reducing redundancy in digital quality assurance tools. This study provided valuable feedback to LLDIKTI VII, contributing to the decision to discontinue MISHEQA, which was later replaced by the nationally managed 'Pelaporan SPMI' application by DIKTI (IQAS reporting application).
Downloads
Article Details
Alsharida, R. A., Hammood, M. M., & Al-Emran, M. (2021). Mobile Learning Adoption: A Systematic Review of the Technology Acceptance Model from 2017 to 2020. International Journal of Emerging Technologies in Learning, 16(5), 147–162. https://doi.org/10.3991/ijet.v16i05.18093
Asiyai, R. I. (2020). Best practices for quality assurance in higher education: implications for educational administration. International Journal of Leadership in Education. https://doi.org/10.1080/13603124.2019.1710569
Davis, F. D. (1989). Davis 1989. MIS Quarterly, 13(3), 319–340.
Enu-Kwesi, F., & Opoku, M. O. (2020). Relevance of the technology acceptance model (TAM) in information management research: a review of selected empirical evidence. Pressacademia, 7(1), 34–44. https://doi.org/10.17261/pressacademia.2020.1186
Fagrell, P., Fahlgren, A., & Gunnarsson, S. (2020). Curriculum development and quality work in higher education in Sweden: The external stakeholder perspective. Journal of Praxis in Higher Education, 2(1), 28–45. https://www.abet.org/
Giatman, M., Siswati, S., & Basri, I. Y. (2020). Online Learning Quality Control in the Pandemic Covid-19 Era in Indonesia. Journal of Nonformal Education, 6(2), 168–175. https://doi.org/10.15294/jne.v6i2.25594
Guangli, Z. (2016). The Effectiveness of the Higher Education Quality Assessment System: Problems and Countermeasures in China. Chinese Education & Society, 49(1–2), 39–48. https://doi.org/10.1080/10611932.2016.1192385
Hariyanti, D., & La Masidonda, J. (2020). Developing The Model Of Assistance, Monitoring And Evaluation To Implement Leader Commitment In Re-Functioning Of Higher Education Internal Audit In Maluku-Palarch’s. Journal Of Archaeology Of Egypt/Egyptology, 17(4), 968.
Hidayah, N. A., Amri, F. B., & Mutholib, A. (2024). Design and Integration of Information Systems for the Halal Inspection Institute (LPH) UIN Syarif Hidayatullah Jakarta with SiHalal Ministry of Religion of the Republic of Indonesia. Applied Information System and Management (AISM), 7(2), 7–16. https://doi.org/10.15408/aism.v7i2.36786
Jain, V., Mogaji, E., Sharma, H., & Babbili, A. S. (2024). A multi-stakeholder perspective of relationship marketing in higher education institutions. In Journal of Marketing for Higher Education (Vol. 34, Issue 2, pp. 502–520). Routledge. https://doi.org/10.1080/08841241.2022.2034201
Kooli, C. (2019). Governing and managing higher education institutions: The quality audit contributions. Evaluation and Program Planning, 77. https://doi.org/10.1016/j.evalprogplan.2019.101713
Kumar, P., Shukla, B., & Passey, D. (2020). IMPACT OF ACCREDITATION ON QUALITY AND EXCELLENCE OF HIGHER EDUCATION INSTITUTIONS. In REVISTA INVESTIGACION OPERACIONAL (Vol. 41, Issue 2).
Laliyo, S., Usu, I., Yakup, Y., & Karundeng, D. R. (2023). Service Strategy for Higher Education Service Institutions Region XVI Gorontalo. International Journal Of Education, Social Studies, And Management (IJESSM), 3(2), 46–58. https://doi.org/10.52121/ijessm.v3i2.153
Lester, J. N., Cho, Y., & Lochmiller, C. R. (2020). Learning to Do Qualitative Data Analysis: A Starting Point. Human Resource Development Review, 19(1), 94–106. https://doi.org/10.1177/1534484320903890
LLDIKTI VII. (2022). Buku pedoman pengisian aplikasi MISHEQA (Vol. 15018).
Lvovich, I. Y., Lvovich, Y. E., Preobrazhenskiy, A. P., Preobrazhenskiy, Y. P., & Choporov, O. N. (2019). Modelling of information systems with increased efficiency with application of optimization-expert evaluation. Journal of Physics: Conference Series, 1399(3). https://doi.org/10.1088/1742-6596/1399/3/033079
Naeem, M., Ozuem, W., Howell, K., & Ranfagni, S. (2023). A Step-by-Step Process of Thematic Analysis to Develop a Conceptual Model in Qualitative Research. International Journal of Qualitative Methods, 22. https://doi.org/10.1177/16094069231205789
Nasim, K., Sikander, A., & Tian, X. (2020). Twenty years of research on total quality management in Higher Education: A systematic literature review. Higher Education Quarterly, 74(1), 75–97. https://doi.org/10.1111/hequ.12227
Nurul Izza, N., & Mi’raj, D. A. (2023). A Qualitative Analysis on Pesantren Economic: NVivo Approach. The Economic Review of Pesantren, 2(1). http://journals.smartinsight.id/index.php/ERP
Rasheed, Z., Waseem, M., Ahmad, A., Kemell, K.-K., Xiaofeng, W., Duc, A. N., & Abrahamsson, P. (2024). Can Large Language Models Serve as Data Analysts? A Multi-Agent Assisted Approach for Qualitative Data Analysis. ArXiv. http://arxiv.org/abs/2402.01386
Redrup Hill, E., Mitchell, C., Brigden, T., & Hall, A. (2023). Ethical and legal considerations influencing human involvement in the implementation of artificial intelligence in a clinical pathway: A multi-stakeholder perspective. Frontiers in Digital Health, 5. https://doi.org/10.3389/fdgth.2023.1139210
Religia, Y., Ramawati, Y., & Syahwildan, M. (2024). Analysis of the Effect of Perceived Product Quality on Retail Purchase Intention: The Mediating Role of Consumer Trust and Price Sensitivity Moderation. Applied Information System and Management (AISM), 7(1), 17–22. https://doi.org/10.15408/aism.v7i1.33914
Rosairo, H. S. R. (2023). Thematic analysis in qualitative research. In Journal of Agricultural Sciences - Sri Lanka (Vol. 18, Issue 3). Faculty of Agricultural Sciences, Sabaragamuwa University of Sri Lanka. https://doi.org/10.4038/JAS.V18I3.10526
Schellekens, L. H., van der Schaaf, M. F., van der Vleuten, C. P. M., Prins, F. J., Wools, S., & Bok, H. G. J. (2023). Developing a digital application for quality assurance of assessment programmes in higher education. Quality Assurance in Education, 31(2), 346–366. https://doi.org/10.1108/QAE-03-2022-0066
Setyowati, W., Widayanti, R., & Supriyanti, D. (2021). Implementation Of E-Business Information System In Indonesia?: Prospects And Challenges. In International Journal of Cyber and IT Service Management (IJCITSM) (Vol. 1, Issue 2). https://iiast-journal.org/ijcitsm/index.php/IJCITSM/article/view/49
Ubachs, G., & Henderikx, P. (2022). Quality assurance systems for Digital Higher Education in Europe. In Handbook of Open, Distance and Digital Education (pp. 1–20). Springer Nature Singapore. https://doi.org/10.1007/978-981-19-0351-9_41-1
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.