EFL secondary school teachers’ conceptions of online assessment in emergency remote teaching: A phenomenographic study

Roghibatul Luthfiyyah, Bambang Yudi Cahyono, Francisca Maria Ivone, Nunung Suryati

Abstract


The investigation of teachers' conceptions of online assessment during a global pandemic has received relatively scarce attention in the current literature. Situated in an emergency remote teaching, this phenomenographic study aims at identifying and describing EFL secondary school teachers' qualitative different ways of understanding online assessment. A cohort of fifteen EFL teachers from different Indonesian secondary schools were recruited purposively using a set of criteria. They were invited to involve in online semi-structured interviews to explore their online assessment conceptions. Then, the interview data were analyzed qualitatively in an iterative process to discern categories of description and an outcome space. The findings point out five categories of teachers' conceptions. The participants view online assessment in emergency remote teaching (ERT) as a means of (1) measuring knowledge, (2) checking learning targets, (3) enhancing online interaction, (4) facilitating authentic tasks, and (5) reflecting the teaching and learning process. Furthermore, an analysis of relationships among those categories is reported hierarchically, ranging from accountability to enhancement assessment purposes. Some implications promote our understanding to consider several mediating factors affecting teachers' conceptions. Although emergency remote teaching situation is provisional, the findings bring out the possibility of implementing assessment for learning, as an alternative to assessment of learning, in the context of online assessment after the pandemic.


Keywords


conceptions; emergency remote teaching; online assessment; phenomenography

Full Text:

PDF

References


Åkerlind, G. S. (2012). Variation and commonality in phenomenographic research methods. Higher Education Research & Development, 31(1), 115-127. https://doi.org/10.1080/07294360.2011.642845

Anderson, T. D., & Garrison, D. R. (1998). Learning in a networked world: New roles and responsibilities. In C. Gibson (Ed.), Distance learners in higher education (pp. 97-112). Atwood Publishing.

Ashford-Rowe, K., Herrington, J., & Brown, C. (2014). Establishing the critical elements that determine authentic assessment. Assessment & Evaluation in Higher Education, 39(2), 205-222. https://doi.org/10.1080/02602938.2013.819566

Azis, A. (2015). Conceptions and practices of assessment: A case of teachers representing improvement conception. TEFLIN Journal, 26(2), 129-154. https://doi.org/10.15639/teflinjournal.v26i2

Benson, A. D. (2003). Assessing participant learning in online environments. New Directions for Adult and Continuing Education, 2003(100), 69-78. https://doi.org/10.1002/ace.120

Benson, R., & Brack, C. (2010). Online learning and assessment in higher education Elsevier. https://doi.org/10.1016/B978-1-84334-577-0.50004-3

Brown, G. T. L., & Gao, L. (2015). Chinese teachers’ conceptions of assessment for and of learning: Six competing and complementary purposes. Cogent Education, 2(1), 993-836. https://doi.org/10.1080/2331186X.2014.993836

Brown, G. T. L., Kennedy, K. J., Fok, P. K., Chan, J. K. S., & Yu, W. M. (2009). Assessment for student improvement: Understanding Hong Kong teachers’ conceptions and practices of assessment. Assessment in Education: Principles, Policy & Practice, 16(3), 347-363. https://doi.org/10.1080/09695940903319737

Brown, G. T. L., Lake, R., & Matters, G. (2011). Queensland teachers’ conceptions of assessment: The impact of policy priorities on teacher attitudes. Teaching and Teacher Education, 27(1), 210-220. https://doi.org/10.1016/j.tate.2010.08.003

Burgos, D., Tlili, A., & Tabacco, A. (Eds.). (2021). Radical solutions for education in a crisis context: Covid-19 as an opportunity for global learning. Springer Singapore. https://doi.org/10.1007/978-981-15-7869-4

Byrne, V. L., Hogan, E., Dhingra, N., Anthony, M., & Gannon, C. (2021). An exploratory study of how novice instructors pivot to online assessments strategies. Distance Education, 42(2), 184-199. https://doi.org/10.1080/01587919.2021.1911624

Cahyadi, A., Hendryadi, Widyastuti, S., Mufidah, V. N., & Achmadi. (2021). Emergency remote teaching evaluation of the higher education in Indonesia. Heliyon, 7(8), 77-88. https://doi.org/10.1016/j.heliyon.2021.e07788

Cahyadi, A., Hendryadi, Widyastuti, S., & Suryani. (2021). Covid-19, emergency remote teaching evaluation: The case of Indonesia. Education and Information Technologies, 4, 1-16. https://doi.org/10.1007/s10639-021-10680-3

Cheng, A.-C., Jordan, M. E., & Schallert, D. L. (2013). Reconsidering assessment in online/hybrid courses: Knowing versus learning. Computers & Education, 68, 51-59. https://doi.org/10.1016/j.compedu.2013.04.022

Coombe, C., Vafadar, H., & Mohebbi, H. (2020). Language assessment literacy: What do we need to learn, unlearn, and relearn? Language Testing in Asia, 10(3), 1-16. https://doi.org/10.1186/s40468-020-00101-6

Dayal, H. C., & Lingam, G. (2015). Fijian teachers’ conceptions of assessment. Australian Journal of Teacher Education, 40(8), 43-58. https://doi.org/10.14221/ajte.2015v40n8.3

Erdem-Aydin, İ. (2021). Investigation of higher education instructors’ perspectives towards emergency remote teaching. Educational Media International, 58(1), 78–98. https://doi.org/10.1080/09523987.2021.1908501

Gebril, A. (2017). Language teachers’ conceptions of assessment: An Egyptian perspective. Teacher Development, 21(1), 81-100. https://doi.org/10.1080/13664530.2016.1218364

Gikandi, J. W., Morrow, D., & Davis, N. E. (2011). Online formative assessment in higher education: A review of the literature. Computers & Education, 57(4), 2333-2351. https://doi.org/10.1016/j.compedu.2011.06.004

Guangul, F. M., Suhail, A. H., Khalit, M. I., & Khidhir, B. A. (2020). Challenges of remote assessment in higher education in the context of Covid-19: A case study of Middle East College. Educational Assessment, Evaluation and Accountability, 32(4), 519-535. https://doi.org/10.1007/s11092-020-09340-w

Hajar, A. (2021). Theoretical foundations of phenomenography: A critical review. Higher Education Research & Development, 40(7), 1421-1436. https://doi.org/10.1080/07294360.2020.1833844

Hodges, C., Moore, S., Lockee, B., Trust, T., & Bond, A. (2020). The difference between emergency remote teaching and online learning. EDUCAUSE Review, 3. https://er.educause.edu/articles/2020/3/the-difference-between-emergency-remote-teaching-and-online-learning

Huang, R., & Jiang, L. (2021). Authentic assessment in Chinese secondary English classrooms: Teachers’ perception and practice. Educational Studies, 47(6), 633-646. https://doi.org/10.1080/03055698.2020.1719387

Hung, M. L., & Chou, C. (2015). Students’ perceptions of instructors’ roles in blended and online learning environments: A comparative study. Computers & Education, 81, 315-325. https://doi.org/10.1016/j.compedu.2014.10.022

Inbar-Lourie, O. (2017). Language assessment literacy. In E. Shohamy, I. G. Or, & S. May (Eds.), Language testing and assessment (pp. 257–270). Springer International Publishing. https://doi.org/10.1007/978-3-319-02261-1_19

Indonesian Ministry of Education, Culture, Research, and Technology. (2020, May 29) Kemendikbud terbitkan pedoman penyelenggaraan belajar dari rumah [Ministry of Education and Culture issues guidelines for organizing learning from home]. https://www.kemdikbud.go.id/main/blog/2020/05/kemendikbud-terbitkan-pedoman-penyelenggaraan-belajar-dari-rumah

Kusuma, I. P. I. (2022). EFL teachers’ online teaching in rural schools during the Covid-19 pandemic: Stories from Indonesia. Studies in English Language and Education, 9(1), 203-221. https://doi.org/10.24815/siele.v9i1.21239

Law, H. F. E., & Miura, U. (2015). Transforming teaching and learning in Asia and the Pacific: Case studies from seven countries. UNESCO.

Luthfiyyah, R., Cahyono, B. Y., & Ivone, F. M. (2021). Classroom-based assessment practices during emergency remote teaching in Indonesia: Challenges and opportunities. In I. Jalaluddin, N. Kaur, R. Darmi, & T. A. Chowdhuri (Eds.), 29th MELTA International Conference Proceedings (pp. 115-119). Malaysian English Language Teaching Association. https://melta.org.my/conference/proceedings.html

Marton, F. (1981). Phenomenography: Describing conceptions of the world around us. Instructional Science, 10, 177–200. https://doi.org/10.1007/BF00132516

Marton, F., & Pong, W. Y. (2005). On the unit of description in phenomenography. Higher Education Research & Development, 24(4), 335-348. https://doi.org/10.1080/07294360500284706

Meccawy, Z., Meccawy, M., & Alsobhi, A. (2021). Assessment in ‘survival mode’: Student and faculty perceptions of online assessment practices in HE during Covid-19 pandemic. International Journal for Educational Integrity, 17(1), 16. https://doi.org/10.1007/s40979-021-00083-9

Mimirinis, M. (2019). Qualitative differences in academics’ conceptions of e-assessment. Assessment & Evaluation in Higher Education, 44(2), 233-248. https://doi.org/10.1080/02602938.2018.1493087

Ninković, S., Olić Ninković, S., Lazarević, T., & Adamov, J. (2021). Serbian teachers’ perceptions of online assessment during COVID-19 school closure: The role of teachers’ self-efficacy. Educational Studies, 1-13. https://doi.org/10.1080/03055698.2021.1960151

Postareff, L., Virtanen, V., Katajavuori, N., & Lindblom-Ylänne, S. (2012). Academics’ conceptions of assessment and their assessment practices. Studies in Educational Evaluation, 38(3–4), 84-92. https://doi.org/10.1016/j.stueduc.2012.06.003

Pu, S., & Xu, H. (2021). Examining changing assessment practices in online teaching: A multiple-case study of EFL school teachers in China. The Asia-Pacific Education Researcher, 30(6), 553-561. https://doi.org/10.1007/s40299-021-00605-6

Rahiem, M. D. H. (2020). The emergency remote learning experience of university students in Indonesia amidst the Covid-19 crisis. International Journal of Learning, Teaching and Educational Research, 19(6), 1-26. https://doi.org/10.26803/ijlter.19.6.1

Rovai, A. P. (2000). Online and traditional assessments: What is the difference? The Internet and Higher Education, 3(3), 141-151. https://doi.org/10.1016/S1096-7516(01)00028-8

Şenel, S., & Şenel, H. C. (2021). Remote assessment in higher education during Covid-19 pandemic. International Journal of Assessment Tools in Education, 8(2), 181-199. https://doi.org/10.21449/ijate.820140

Sjostrom, B., & Dahlgren, L. O. (2002). Applying phenomenography in nursing research. Journal of Advanced Nursing, 40(3), 339-345. https://doi.org/10.1046/j.1365-2648.2002.02375.x

Stiggins, R. J. (1991). Relevant classroom assessment training for teachers. Educational Measurement: Issues and Practice, 10(1), 7-12. https://doi.org/10.1111/j.1745-3992.1991.tb00171.x

Villarroel, V., Bloxham, S., Bruna, D., Bruna, C., & Herrera-Seda, C. (2018). Authentic assessment: Creating a blueprint for course design. Assessment & Evaluation in Higher Education, 43(5), 840-854. https://doi.org/10.1080/02602938.2017.1412396

Zhang, C., Yan, X., & Wang, J. (2021). EFL teachers’ online assessment practices during the Covid-19 pandemic: Changes and mediating factors. The Asia-Pacific Education Researcher, 30(6), 499-507. https://doi.org/10.1007/s40299-021-00589-3

Zou, M., Kong, D., & Lee, I. (2021). Teacher engagement with online formative assessment in EFL writing during Covid-19 pandemic: The case of China. The Asia-Pacific Education Researcher, 30(6), 487-498. https://doi.org/10.1007/s40299-021-00593-7




DOI: https://doi.org/10.24815/siele.v9i3.23459

Refbacks

  • There are currently no refbacks.


Print ISSN: 2355-2794, Online ISSN: 2461-0275

This work is licensed under a Creative Commons Attribution 4.0 International License.