Developing A Dialogic Digital Reading Learning Environment For Indonesian Literacy: Evidence From Annotation, Discussion, and Comprehension Traces
Digital reading environments make students' reading processes more visible because they capture annotations, discussion posts, comprehension attempts, and activity logs. However, these traces are often reduced to participation totals rather than used to inform the design of reading pedagogy. This study developed and evaluated a dialogic digital reading learning environment for Indonesian literacy. Using a design-based mixed-methods approach, 100 undergraduate students engaged with genre-based Indonesian texts over six weeks through interactive annotation, threaded discussion, audio support, and comprehension practice. The dataset comprised 1,842 annotations, 1,126 discussion comments, pretest and posttest reading comprehension scores, platform activity logs, and 20 follow-up interviews. The learning environment was organized around five dialogic engagement dimensions: text-grounded noticing, inferential linking, evaluative stance, dialogic uptake, and metacognitive reflection. Coding showed strong interrater reliability (Cohen's kappa = .86). Reading comprehension increased from pretest (M = 69.84, SD = 9.18) to posttest (M = 83.72, SD = 7.64), t(99) = 15.99, p < .001, with a repeated-measures effect size of dz = 1.60. Dialogic uptake and inferential linking were the strongest predictors of comprehension gain, and the regression model explained 65% of the variance. Interview findings indicated that annotations helped students locate textual difficulty, discussion threads supported peer-mediated interpretation, and comprehension tasks prompted students to return to the text rather than respond superficially. The study offers a pedagogical model for designing Indonesian digital reading environments as social, reflective, and evidence-informed learning spaces.
Keywords: Digital reading, Dialogic engagement, Learning environment, Social annotation; Indonesian literacy.
Adesope, O. O., Trevisan, D. A., & Sundararajan, N. (2017). Rethinking the use of tests: A meta-analysis of practice testing. Review of Educational Research, 87(3), 659–701. https://doi.org/10.3102/0034654316689306
Alderson, J. C., & Banerjee, J. (2002). Language testing and assessment (Part 2). Language Teaching, 35(2), 79–113. https://doi.org/10.1017/S0261444802001751
Allred, J. B., Connors, S. P., & Goering, C. Z. (2025). Social annotation and dialogic teaching and learning in English language arts. Journal of Adolescent & Adult Literacy, 68(5), 515–525. https://doi.org/10.1002/jaal.1382
Anderson, T., & Shattuck, J. (2012). Design-based research. Educational Researcher, 41(1), 16–25. https://doi.org/10.3102/0013189X11428813
Anmarkrud, Ø., Andresen, A., & Bråten, I. (2019). Cognitive load and working memory in multimedia learning: Conceptual and measurement issues. Educational Psychologist, 54(2), 61–83. https://doi.org/10.1080/00461520.2018.1554484
Banihashem, S. K., Noroozi, O., van Ginkel, S., Macfadyen, L. P., & Biemans, H. J. A. (2022). A systematic review of the role of learning analytics in enhancing feedback practices in higher education. Educational Research Review, 37, 100489. https://doi.org/10.1016/j.edurev.2022.100489
Ben-Yehudah, G., & Eshet-Alkalai, Y. (2021). Print versus digital reading comprehension tests: Does the congruency of study and test medium matter? British Journal of Educational Technology, 52(1), 426–440. https://doi.org/10.1111/bjet.13014
Clapp, J., DeCoursey, M., Lee, S. W. S., & Li, K. (2021). "Something fruitful for all of us": Social annotation as a signature pedagogy for literature education. Arts and Humanities in Higher Education, 20(3), 295–319. https://doi.org/10.1177/1474022220915128
Clinton, V. (2019). Reading from paper compared to screens: A systematic review and meta-analysis. Journal of Research in Reading, 42(2), 288–325. https://doi.org/10.1111/1467-9817.12269
Cromley, J. G., & Azevedo, R. (2007). Testing and refining the direct and inferential mediation model of reading comprehension. Journal of Educational Psychology, 99(2), 311–325. https://doi.org/10.1037/0022-0663.99.2.311
Csanadi, A., Eagan, B., Kollar, I., Shaffer, D. W., & Fischer, F. (2018). When coding-and-counting is not enough: Using epistemic network analysis (ENA) to analyze verbal data in CSCL research. International Journal of Computer-Supported Collaborative Learning, 13(4), 419–438. https://doi.org/10.1007/s11412-018-9292-z
Cui, T., & Wang, J. (2024). Empowering active learning: A social annotation tool for improving student engagement. British Journal of Educational Technology, 55(2), 712–730. https://doi.org/10.1111/bjet.13403
Delgado, P., & Salmerón, L. (2021). The inattentive on-screen reading: Reading medium affects attention and reading comprehension under time pressure. Learning and Instruction, 71, 101396. https://doi.org/10.1016/j.learninstruc.2020.101396
Delgado, P., Vargas, C., Ackerman, R., & Salmerón, L. (2018). Don't throw away your printed books: A meta-analysis on the effects of reading media on reading comprehension. Educational Research Review, 25, 23–38. https://doi.org/10.1016/j.edurev.2018.09.003
de la Peña, C., Chaves-Yuste, B., & Luque-Rojas, M.-J. (2024). Digital reading comprehension: Multimodal and monomodal inputs under debate. Reading Psychology, 45(5), 500–518. https://doi.org/10.1080/02702711.2024.2339809
Dunlosky, J., Rawson, K. A., Marsh, E. J., Nathan, M. J., & Willingham, D. T. (2013). Improving students' learning with effective learning techniques: Promising directions from cognitive and educational psychology. Psychological Science in the Public Interest, 14(1), 4–58. https://doi.org/10.1177/1529100612453266
Fan, Y., van der Graaf, J., Lim, L., Raković, M., Singh, S., Kilgour, J., Moore, J., Molenaar, I., Bannert, M., & Gašević, D. (2022). Towards investigating the validity of measurement of self-regulated learning based on trace data. Metacognition and Learning, 17(3), 949–987. https://doi.org/10.1007/s11409-022-09291-1
Gao, F. (2013). A case study of using a social annotation tool to support collaboratively learning. The Internet and Higher Education, 17, 76–83. https://doi.org/10.1016/j.iheduc.2012.11.002
Ghaluh, B. M., Wulandari, E., Swatika Sari, E., & Suryaman, M. (2026). Enhancing digital and multimodal literacy in Indonesia's language education: A strategic policy framework for twenty-first-century engagement. Current Issues in Language Planning, 1–38. https://doi.org/10.1080/14664208.2026.2633476
Hadwin, A. F., Nesbit, J. C., Jamieson-Noel, D., Code, J., & Winne, P. H. (2007). Examining trace data to explore self-regulated learning. Metacognition and Learning, 2(2–3), 107–124. https://doi.org/10.1007/s11409-007-9016-7
Halamish, V., & Elbaz, E. (2020). Children's reading comprehension and metacomprehension on screen versus on paper. Computers & Education, 145, 103737. https://doi.org/10.1016/j.compedu.2019.103737
Howe, C., & Abedin, M. (2013). Classroom dialogue: A systematic review across four decades of research. Cambridge Journal of Education, 43(3), 325–356. https://doi.org/10.1080/0305764X.2013.786024
Ifenthaler, D., & Yau, J. Y. K. (2020). Utilising learning analytics to support study success in higher education: A systematic review. Educational Technology Research and Development, 68(4), 1961–1990. https://doi.org/10.1007/s11423-020-09788-z
Järvelä, S., & Hadwin, A. F. (2013). New frontiers: Regulating learning in CSCL. Educational Psychologist, 48(1), 25–39. https://doi.org/10.1080/00461520.2012.748006
Järvelä, S., Kirschner, P. A., Hadwin, A., Järvenoja, H., Malmberg, J., Miller, M., & Laru, J. (2016). Socially shared regulation of learning in CSCL: Understanding and prompting individual- and group-level shared regulatory activities. International Journal of Computer-Supported Collaborative Learning, 11(3), 263–280. https://doi.org/10.1007/s11412-016-9238-2
Karpicke, J. D., & Roediger, H. L. (2008). The critical importance of retrieval for learning. Science, 319(5865), 966–968. https://doi.org/10.1126/science.1152408
Kielstra, J., Molenaar, I., van Steensel, R., & Verhoeven, L. (2022). Supporting socially shared regulation during collaborative task-oriented reading. International Journal of Computer-Supported Collaborative Learning, 17(1), 65–105. https://doi.org/10.1007/s11412-022-09365-x
Kintsch, W. (1988). The role of knowledge in discourse comprehension: A construction-integration model. Psychological Review, 95(2), 163–182. https://doi.org/10.1037/0033-295X.95.2.163
Kong, Y., Seo, Y. S., & Zhai, L. (2018). Comparison of reading performance on screen and on paper: A meta-analysis. Computers & Education, 123, 138–149. https://doi.org/10.1016/j.compedu.2018.05.005
Kuhn, A., Schwabe, A., Boomgarden, H., Brandl, L., Stocker, G., Lauer, G., Brendel-Kepser, I., & Krause-Wolters, M. (2024). Who gets lost? How digital academic reading impacts equal opportunity in higher education. New Media & Society, 26(2), 1034–1055. https://doi.org/10.1177/14614448211072306
Larrabee Sønderlund, A., Hughes, E., & Smith, J. (2019). The efficacy of learning analytics interventions in higher education: A systematic review. British Journal of Educational Technology, 50(5), 2594–2618. https://doi.org/10.1111/bjet.12720
Lakens, D. (2013). Calculating and reporting effect sizes to facilitate cumulative science: A practical primer for t tests and ANOVAs. Frontiers in Psychology, 4, Article 863. https://doi.org/10.3389/fpsyg.2013.00863
Li, H., Hunter, C. V., & Lei, P. W. (2016). The selection of cognitive diagnostic models for a reading comprehension test. Language Testing, 33(3), 391–409. https://doi.org/10.1177/0265532215590848
Littrell-Baez, M. K., Friend, A., Caccamise, D., & Okochi, C. (2015). Using retrieval practice and metacognitive skills to improve content learning. Journal of Adolescent & Adult Literacy, 58(8), 682–689. https://doi.org/10.1002/jaal.420
Li, S., Huang, X., Lin, L., & Chen, F. (2024). Exploring influential factors in peer upvoting within social annotation. British Journal of Educational Technology, 55(5), 2212–2225. https://doi.org/10.1111/bjet.13455
Mercer, N., Hennessy, S., & Warwick, P. (2019). Dialogue, thinking together and digital technology in the classroom: Some educational implications of a continuing line of inquiry. International Journal of Educational Research, 97, 187–199. https://doi.org/10.1016/j.ijer.2017.08.007
Miles, M. B., Huberman, A. M., & Saldaña, J. (2014). Qualitative data analysis: A methods sourcebook (3rd ed.). Sage.
Moreno, R., & Mayer, R. E. (1999). Cognitive principles of multimedia learning: The role of modality and contiguity. Journal of Educational Psychology, 91(2), 358–368. https://doi.org/10.1037/0022-0663.91.2.358
Moreno, R., & Mayer, R. E. (2002). Verbal redundancy in multimedia learning: When reading helps listening. Journal of Educational Psychology, 94(1), 156–163. https://doi.org/10.1037/0022-0663.94.1.156
Novak, E., Razzouk, R., & Johnson, T. E. (2012). The educational use of social annotation tools in higher education: A literature review. The Internet and Higher Education, 15(1), 39–49. https://doi.org/10.1016/j.iheduc.2011.09.002
Nursaid, N., Ghaluh, B. M., & Wulandari, E. (2025). An artificial intelligence assistant to reader response theory: Pioneering novel analysis in the digital age. Language Teaching Research. https://doi.org/10.1177/13621688251368636
Pan, S. C., & Rickard, T. C. (2018). Transfer of test-enhanced learning: Meta-analytic review and synthesis. Psychological Bulletin, 144(7), 710–756. https://doi.org/10.1037/bul0000151
Pellicer-Sánchez, A., Tragant, E., Conklin, K., Rodgers, M., Serrano, R., & Llanes, Á. (2020). Young learners' processing of multimodal input and its impact on reading comprehension. Studies in Second Language Acquisition, 42(3), 577–598. https://doi.org/10.1017/S0272263120000091
Pellicer-Sánchez, A., Conklin, K., Rodgers, M. P. H., & Parente, F. (2021). The effect of auditory input on multimodal reading comprehension: An examination of adult readers' eye movements. The Modern Language Journal, 105(4), 936–956. https://doi.org/10.1111/modl.12743
Roediger, H. L., & Karpicke, J. D. (2006). Test-enhanced learning: Taking memory tests improves long-term retention. Psychological Science, 17(3), 249–255. https://doi.org/10.1111/j.1467-9280.2006.01693.x
Rowland, C. A. (2014). The effect of testing versus restudy on retention: A meta-analytic review of the testing effect. Psychological Bulletin, 140(6), 1432–1463. https://doi.org/10.1037/a0037559
Rupp, A. A., Ferne, T., & Choi, H. (2006). How assessing reading comprehension with multiple-choice questions shapes the construct: A cognitive processing perspective. Language Testing, 23(4), 441–474. https://doi.org/10.1191/0265532206lt337oa
Singer, L. M., & Alexander, P. A. (2017). Reading across mediums: Effects of reading digital and print texts on comprehension and calibration. The Journal of Experimental Education, 85(1), 155–172. https://doi.org/10.1080/00220973.2016.1143794
Støle, H., Mangen, A., & Schwippert, K. (2020). Assessing children's reading comprehension on paper and screen: A mode-effect study. Computers & Education, 151, 103861. https://doi.org/10.1016/j.compedu.2020.103861
Tabbers, H. K., Martens, R. L., & van Merriënboer, J. J. G. (2004). Multimedia instructions and cognitive load theory: Effects of modality and cueing. British Journal of Educational Psychology, 74(1), 71–81. https://doi.org/10.1348/000709904322848824
ter Beek, M., Brummer, L., Donker, A. S., & Opdenakker, M. J. (2018). Supporting secondary school students' reading comprehension in computer environments: A systematic review. Journal of Computer Assisted Learning, 34(5), 557–566. https://doi.org/10.1111/jcal.12260
Vandenberg, J., Zakaria, Z., Tsan, J., Iwanski, A., Lynch, C., Boyer, K. E., & Wiebe, E. (2021). Prompting collaborative and exploratory discourse: An epistemic network analysis study. International Journal of Computer-Supported Collaborative Learning, 16(3), 339–366. https://doi.org/10.1007/s11412-021-09349-3
Viberg, O., Baars, M., Mello, R. F., Weerheim, N., Spikol, D., Bogdan, C., Gasevic, D., & Paas, F. (2024). Exploring the nature of peer feedback: An epistemic network analysis approach. Journal of Computer Assisted Learning, 40(6), 2809–2821. https://doi.org/10.1111/jcal.13035
Wang, F., & Hannafin, M. J. (2005). Design-based research and technology-enhanced learning environments. Educational Technology Research and Development, 53(4), 5–23. https://doi.org/10.1007/bf02504682
Wilson, N. S., Dussling, T., Adams, B., Stevens, E., Baumann, J., Yang, S., Smetana, L., Bean-Folkes, J., & Van Wig, A. (2024). What a multi-institutional collective case study of social annotation data reveals about graduate students' metacognitive reading practices. Literacy, 58(2), 190–203. https://doi.org/10.1111/lit.12364
Ye, D., & Pennisi, S. (2022). Using trace data to enhance students' self-regulation: A learning analytics perspective. The Internet and Higher Education, 54, 100855. https://doi.org/10.1016/j.iheduc.2022.100855
Zamecnik, A., Kovanović, V., Joksimović, S., Grossmann, G., Ladjal, D., Marshall, R., & Pardo, A. (2023). Using online learner trace data to understand the cohesion of teams in higher education. Journal of Computer Assisted Learning, 39(6), 1733–1750. https://doi.org/10.1111/jcal.12829
Refbacks
- There are currently no refbacks.
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
The copyright is reserved to Pedagogy Review that is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Address:
CV. IMRECS: Jalan Gagak I, Kecamatan Larangan, Kota Tangerang. Postal Code: 15155
STKIP Al Islam Tunas Bangsa: Jalan Z.A. Pagar Alam No. 41 Gedong Meneng Bandar Lampung