Difficulty Index and Cognitive Skills of English Textbook for Senior High School

Keywords: Bloom Taxonomy, cognitive level, difficulty index, HOTS, LOTS, readability


This study explored the difficulty index, the terms for the category for reading text level, and cognitive levels of reading texts in the English textbook, Interlanguage, for Senior High School grade 12. The primary aim was to determine the extent to which the degree of the available different categories of reading text levels included the cognitive level of questions. Through the readability test formulas for difficulty index and a checklist based on revised Bloom Taxonomy for cognitive skills, 11 reading texts completed with 56 reading comprehension questions were analyzed. The result revealed that the Interlanguage textbook contained four different categories of reading level such as difficult, fairly difficult, plain, and fairly easy to read. The textbook had in the average category of fairly difficult to read for difficulty index and contained fewer HOTS–based questions than LOTS ones (34% < 66%). Besides, higher reading text levels included fewer HOTS-based questions than those of lower ones. This means a higher level of cognitive skill of questions may appear in any text with a different level of difficulty index. This suggests that the English textbook should be revised to have more HOTS-based question items for developing the students’ high cognitive levels.

Author Biographies

Muslih Hambali, Sriwijaya University
English Education Study Program, Sriwiwjaya University, Jl. Raya-Palembang Prabumulih km 32, Indralaya, Ogan Ilir, Sumatera Selatan 30662
Soni Mirizon, Sriwijaya University
English Education Study Program, Faculty of Teacher Training and Education, Sriwijaya University


Abusa’aleek, R., & Khataybeh, A. (2020). Analyzing the readability level of English textbooks used in Jordan. Research in English Language Pedagogy, 8(2), 334-348.
Anderson, L. W., Krathwohl, D. R., Airasian, P. W., Cruikshank, K. A., Mayer, R. E., Pintrich, P., Raths, J., & Wittrock, M. C. (2001). A taxonomy for learning, teaching, and assessing: A revision of Bloom’s taxonomy of educational objectives, abridged edition. White Plains, NY: Longman.
Assaly, I. R. & Smadi, O. M. (2015). Using Bloom’s Taxonomy to Evaluate the Cognitive Levels of Master Class Textbook’s Questions. English Language Teaching, 8 (5), 100-110.
Automatic Readability Checker, English Writing Tool. Retrieved from https://read abilityformulas.com/free-readability-formula-tests.php
Chalak, A. (2015). The effect of task-based instruction on reading comprehension of Iranian EFL learners. Applied Research in English, 4 (1), 19-30
Hashemi, M., Azizinezhad, M., & Darvishi, S. (2012). Using task-based language teaching, learning practically in English classes. Procedia Social and Behavioral Science, 31(2), 526-529.
Hidayat, R. (2016) The readability of reading texts on the English textbook. In: International Conference: Role of International Languages toward Global Education System, 25 June 2016, IAIN Palangka Raya, Central Kalimantan, Indonesia. Retrieved from digilib.iain-palangkaraya.ac.id/989/
Hogue, M. E. (2016). Three Domains of Learning: Cognitive, Affective, and Psychomotor. The Journal of EFL Education and Research, 2(2). Retrieved from https://www.researchgate.net/publication/330811334_Three_Domains_ of_Learning_Cognitive_Affective_and_Psychomotor
Igbaria, A. K. (2013). A Content Analysis of the Wh-Questions in the EFL Textbook of Horizons. International Education Studies, 6(7), 200-212
Kennedy, D. (2007). Writing and Using Learning Outcomes: A Practical Guide. Ireland: University College Cork
Krathwohl, D. R. (2002). A revision of Bloom’s taxonomy: An overview. Theory into Practice, 41(4), 212-219. Retrieved from http://dx.doi.org/10.1207/ s15430421tip4104_2
Muslich, M. 2010. Text Book Writing. Jakarta: Ar-Ruzz Media
Muzammil, S. (2016). QAR (Question Answer Relationship) as an Alternative Strategy to Teach Reading. JL3T Journal of Linguistics, Literature & Language Teaching, 2(2), 101-123.
Nappi, Y. S. (2018). The Importance of Questioning in Developing Critical Thinking Skills. The Delta Kappa Gamma Bulletin: International Journal for Professional Educators. Retrieved from https://cpb-us-e1.wpmucdn.com/cobblearning.net/ dist/6/3101/files/2018/05/The-Importance-of-Questioning-2aqkc5j.pdf
Nuhamsih, J. (2017). The Analysis of Readability Levels of the Reading Texts in Textbook Entitled Fast Tract to English for the Third Year Students of SMA Based on Raygor Readability Estimate. International Journal of Language Teaching and Education, 1(1), 50-57.
Peraturan Menteri Pendidikan dan Kebudayaan Republik Indonesia Nomor 8 Tahun 2016 Tentang Buku yang Digunakan Oleh Satuan Pendidikan
Pikulski , J. J. (2002). Readability. Boston: Houghton Mifflin.
Pratiwi, N. (2014). Higher order thinking skill in reading exercise (An analysis of reading exercises in Pathway to English textbook for the eleventh grade of senior high school students). Unpublished Thesis. The Syarif Hidayatullah State Islamic University Jakarta.
Rahmawati. I. Y., & Lestari. A. L. (2012). The Readability Level of Reading Texts in the English Language Textbooks Used by the Tenth Grade. Retrieved from https://core.ac.uk/download/pdf/230772898.pdf
Richards, J. C. (2001). Curriculum Development in Language Teaching. New York: Cambridge University Press.
San, K. M. (2019). The Cognitive Thinking Levels Demanded in the Tasks in the Coursebook Global Level 1 (A2). International Journal of Innovative Science and Research Technology, 4(2), 513-519.
Satriani. E. (2018). Reading Comprehension Difficulties Encountetred by English Students of Islamic University of Riau. J-SHMIC: Journal of English for Academic, 5 (2), 15-26.
Watson, S.(2019). What Is the HOTS Concept in American Education Reform? Thought Co. Retrieved from https://www.thoughtco.com/higher-order-thinking-skills-hots-education-3111297
Wu, Y., & Pei, Z. (2018). An investigation of critical thinking manifested in the questions of EFL textbooks for tertiary-level English majors of China. American Journal of Education and Learning, 3(2), 72-84.
How to Cite
Hambali, M., Mirizon, S., & Heryana, N. (2021). Difficulty Index and Cognitive Skills of English Textbook for Senior High School. Indonesian Journal of EFL and Linguistics, 6(1), 17-28. https://doi.org/10.21462/ijefl.v6i1.331