Designing A Speaking Test for Special Purposes (SP) in Hiring Experts for a Company

Md. Abdus Salam

doi:10.21462/ijefl.v11i1.1015

Md. Abdus Salam Jagannath University, Dhaka 1100

DOI: https://doi.org/10.21462/ijefl.v11i1.1015

Keywords: Hi-stakes test, reliability, speaking-test-design, validity

Abstract

Designing speaking tests for special purposes involves contentious debates regarding specific contexts, company goals, and learner requirements, and hence, requires further research. This article designs a speaking test for the specific purpose of recruiting company professionals. At present, multinational companies around the globe are evolving day by day, and their sister concerns are getting diverse perspectives. The research objective of this article is to design a speaking test. This study requires finding an answer to the research question: how to design a valid and reliable speaking test for recruiting company professionals? This study applied a qualitative data analysis approach to find an answer to the research question, in which research articles, books, periodicals, and magazines were treated as secondary, and the speaking test design was primary data. This study finds that multiple challenges are present in designing a speaking test, keeping in mind the reliability and validity of the tests, like test-time, assessment-criteria, validity, and reliability. The findings of this article will be helpful and have positive impacts for the examinees as well as the employers. Observing the necessities, this study recommends further research for designing a speaking test, keeping real-world relevance in all contexts.

References

Bachman, L. F. (1990). Fundamental Considerations in Language Testing. Oxford University Press.
Bachman, L. F., & Palmer, A. S. (1996). Language Testing in Practice: Designing and Developing Useful Language Tests (Vol. 1). Oxford University Press.
Breiner-Sanders, K. E., Lowe, P., Miles, J., & Swender, E. (2000). ACTFL Proficiency Guidelines-Speaking (Revised 1999). Foreign Language Annals, 33(1), 13.
Brindley, G. (1998). Describing Language Development? Rating Scales and SLA. Interfaces Between Second Language Acquisition and Language Testing Research, 112-140.
Bygate, M. (1987). Speaking. Oxford University Press.
Davidson, S. (2018). How Valid Are Domain Experts' Judgements of Workplace Communication? Implications for Setting Standards on the Occupational English Test (OET) Writing Sub-test (Doctoral dissertation, The University of Melbourne).
Demerouti, E., Bakker, A. B., Nachreiner, F., & Schaufeli, W. B. (2001). The Job Demands-resources Model of Burnout. Journal of Applied Psychology, 86(3), 499.
Fulcher, G., & Reiter, R. M. (2003). Task Difficulty in Speaking Tests. Language Testing, 20(3), 321-344.
Galaczi, E. D. (2008). Peer–peer Interaction in a Speaking Test: The Case of the First Certificate in English Examination. Language Assessment Quarterly, 5(2), 89-119.
Galaczi, E. D. (2013). Interactional Competence Across Proficiency Levels: How Do Learners Manage Interaction in Paired Speaking Tests? Applied Linguistics, 35(5), 553-574.
Ginting, R. S., Dalimunte, A. A., Dalimunte, M., Kurniati, E. Y., & Adelita, D. (2023). A Critical Review of IELTS Speaking Test. JL3T (Journal of Linguistics, Literature and Language Teaching), 9(2), 138-155.
Gong, K. (2023). Challenges and Opportunities for Spoken English Learning and Instruction Brought by Automated Speech Scoring in Large-scale Speaking Tests: A Mixed-method Investigation into the Washback of Speech Rater in TOEFL iBT. Asian-Pacific Journal of Second and Foreign Language Education, 8(1), 25.
Hatipo?lu, Ç. (2021). Testing and Assessment of Speaking Skills, Test Task Types, and Sample Test Items. Language Assessment and Test Preparation in English as a Foreign Language (EFL) Education, 119-173.
Hughes, A. (2020). Testing for Language Teachers. Cambridge University Press.
Iwashita, N., Brown, A., McNamara, T., & O’hagan, S. (2008). Assessed Levels of Second Language Speaking Proficiency: How Distinct? Applied Linguistics, 29(1), 24-49.
Jung Youn, S. (2023). Test Design and Validity Evidence of Interactive Speaking Assessment in the Era of Emerging Technologies. Language Testing, 40(1), 54-60.
Khabbazbashi, N., Nakatsuhara, F., Inoue, C., Kaplan, G., & Green, A. (2022). The Design and Validation of an Online Speaking Test for Young Learners in Uruguay: Challenges and Innovations. International Journal of TESOL Studies, 4(1).
Khamkhien, A. (2010). Teaching English Speaking and English Speaking Tests in the Thai Context: A Reflection from Thai Perspective. English language teaching, 3(1), 184-190.
Lumley, T. (1998). Perceptions of Language-trained Raters and Occupational Experts in a Test of Occupational English Language Proficiency. English for Specific Purposes, 17(4), 347-367.
MacIntyre, P. D., Clément, R., Dörnyei, Z., & Noels, K. A. (1998). Conceptualizing Willingness to Communicate in a L2: A Situational Model of L2 Confidence and Affiliation. The Modern Language Journal, 82(4), 545-562.
Nation, I. S. (2008). Teaching ESL/EFL Reading and Writing. Routledge.
Orr, M. (2002). The FCE Speaking Test: Using Rater Reports to Help Interpret Test Scores. System, 30(2), 143-154.
Pennington, M. C. (1999). Computer-aided Pronunciation Pedagogy: Promise, Limitations, Directions. Computer Assisted Language Learning, 12(5), 427-440.
Spolsky, B. (1995). Measured Words: The Development of Objective Language Testing. Oxford University Press
Zhang, X., & Head, K. (2010). Dealing with Learner Reticence in the Speaking Class. ELT Journal, 64(1), 1-9.