اخبار و اعلانات
آمار
| تعداد نشریات | 20 |
| تعداد شمارهها | 429 |
| تعداد مقالات | 3,546 |
| تعداد مشاهده مقاله | 5,445,254 |
| تعداد دریافت فایل اصل مقاله | 3,710,802 |
Developing and Validating an Online Diagnostic Test of L2 Pragmatic Competence: a Meaning-Oriented Model | ||
| Journal of Modern Research in English Language Studies | ||
| دوره 13، شماره 2، تیر 2026، صفحه 125-152 اصل مقاله (948.35 K) | ||
| نوع مقاله: Research Paper | ||
| شناسه دیجیتال (DOI): 10.30479/jmrels.2025.22497.2561 | ||
| نویسندگان | ||
| Malihe Ketabdar1؛ Mohammad Hashamdar* 2؛ Gholamhassan Famil Khalili1 | ||
| 1Department of Teaching English and Translation, Ka.C., Islamic Azad University, Karaj, Iran, | ||
| 2Department of Teaching English and Translation, Ka.C., Islamic Azad University, Karaj, Iran | ||
| تاریخ دریافت: 14 مهر 1404، تاریخ بازنگری: 02 دی 1404، تاریخ پذیرش: 09 دی 1404 | ||
| چکیده | ||
| Research on second language (L2) pragmatics has predominantly focused on speech acts, leaving broader dimensions of pragmatic competence relatively unexplored. To address this gap, the present study developed and validated an Online Diagnostic Test of L2 Pragmatic Competence (DTPC) informed by Purpura’s (2017) meaning-oriented model. Using a mixed-methods design, the researchers developed DTPC through several stages, including literature and expert review, a written discourse completion task (DCT), test construction, piloting, final administration, and follow-up interviews. Initially, a total of 369 Iranian EFL learners were selected through purposive sampling to participate in the study. Following the proficiency test, the researchers excluded 11 advanced learners to ensure sample homogeneity, and data from 358 participants were retained for the final statistical analyses. After item screening and refinement, 34 of the 75 DTPC items were retained based on the results of item analysis, exploratory factor analysis, and confirmatory factor analysis. The analyses confirmed a four-factor structure comprising sociolinguistic, sociocultural, psychological, and situational meanings, with high reliability and acceptable model fit. Sociolinguistic and psychological meanings showed the most decisive influence on learners’ pragmatic competence. Thematic analysis of interviews indicated learners’ positive perceptions of the DTPC’s diagnostic value and online delivery. The findings provide empirical validation of Purpura’s meaning-oriented model in the Iranian EFL context. In this context, the DTPC provides diagnostic insights into EFL learners’ pragmatic challenges, thereby supporting more targeted and responsive instruction. | ||
| کلیدواژهها | ||
| Meaning-Oriented Model؛ Online Diagnostic Test of Pragmatic Competence (DTPC)؛ Pragmatic Meaning؛ Second Language Pragmatics | ||
| مراجع | ||
|
Alamer, A., & Marsh, H. (2022). Exploratory structural equation modeling in second language research: An applied example using the dualistic model of passion. Studies in Second Language Acquisition, 44(5), 1477-1500. https://doi.org/10.1017/S0272263121000863
Alavi, S. M., Shahsavar, M., & Norouzi, M. H. (2020). Diagnosing EFL learners’ development of pragmatic competence implementing computerized dynamic assessment. Issues in Language Teaching, 9(1), 117–149.
Arabmofrad, A., & Mehdiabadi, F. (2022). Developing a multiple-choice discourse completion test for Iranian EFL learners: The case of the four speech acts of apology, request, refusal, and thanks. Language Related Research, 13(4), 1-34.
Bachman, L. F., & Palmer, A. S. (2010). Language assessment in practice: Developing language assessments and justifying their use in the real world. Oxford University Press.
Bardovi-Harlig, K. (2020). Pedagogical linguistics: A view from L2 pragmatics. Pedagogical Linguistics, 1(1), 44-65.
Beltrán, J. (2019). A meaning-based multiple-choice test of pragmatic knowledge: Does it work? Studies in Applied Linguistics & TESOL, 19(1), 42–71.
Birjandi, P., & Rezaei, S. (2010). Developing a multiple-choice discourse completion test of interlanguage pragmatics for Iranian EFL learners. ILI Language Teaching Journal, 6(1–2), 43–58.
Braun, V., & Clarke, V. (2012). Thematic analysis. American Psychological Association. https://doi.org/10.1037/13620-004
Cheung, G. W., Cooper-Thomas, H. D., Lau, R. S., & Wang, L. C. (2024). Reporting reliability, convergent and discriminant validity with structural equation modeling: A review and best-practice recommendations. Asia Pacific Journal of Management, 41(2), 745-783. https://doi.org/10.1007/s10490-023-09871-y
Creswell, J. W., & Creswell, J. D. (2018). Research design: Qualitative, quantitative, and mixed methods approaches (5th ed.). SAGE Publications.
Culpeper, J., Mackey, A., & Taguchi, N. (2018). Second language pragmatics: From theory to research. Routledge.
Derakhshan, A., R. Eslami, Z., & Shakki, F. (2024). Comparing compliments in face-to-face vs. online interactions among Iranian speakers of Persian. Pragmatics and Society, 15(2), 320-344.
Derakhshan, A., Eslami, Z. R., & Ghandhari, N. (2021). Investigating the interplay of emotional intelligence and interlanguage pragmatic competence in Iranian lower-intermediate EFL learners. Issues in Language Teaching, 10(1), 37-66.
Derakhshan, A., & Shakki, F. (2023). A meta-analytic study of instructed second language pragmatics: A case of the speech acts of request. Journal of Research in Applied Linguistics, 12(1),15-32.
Fakher Ajabshir, Z. (2025). A comparative study of teacher feedback and chatbot feedback on second language learners’ pragmalinguistic and sociopragmatic competences. International Journal of Human–Computer Interaction, 41(16), 9881-9892. https://doi.org/10.1080/10447318.2024.2429756
Grabowski, K. C. (2007). Reconsidering the measurement of pragmatic knowledge using a reciprocal written task format. Studies in Applied Linguistics and TESOL, 7(1), 1-48.
Grabowski, K. (2013). Investigating the construct validity of a role-play test designed to measure grammatical and pragmatic knowledge at multiple proficiency levels. In S. J., Ross & G. Kasper (Eds.), Assessing second language pragmatics (pp. 149–171). Palgrave Macmillan. https://doi.org/10.1057/9781137003522_6
Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1-55.
Hudson, T., Detmer, E., & Brown, J. D. (1992). A framework for testing cross-cultural pragmatics (Vol. 2). National Foreign Language Resource Center.
Ikeda, N. (2021). Assessing L2 learners’ pragmatic ability in problem-solving situations at English-medium university. Applied Pragmatics, 3(1), 51-83.
Ishihara, N., & Cohen, A. D. (2021). Assessment of L2 pragmatics in the classroom. In N. Ishihara & A. D. Cohen (Eds.), Teaching and learning pragmatics (2nd ed., pp. 259-296). Routledge.
Jianda, L. (2007). Developing a pragmatics test for Chinese EFL learners. Language Testing, 24(3), 391-415.
Kecskes, I. (2014). Intercultural pragmatics (Vol. 288). Oxford University Press.
Kline, R. B. (2023). Principles and practice of structural equation modeling. Guilford Publications.
Laughlin, V. T., Wain, J., & Schmidgall, J. (2015). Defining and operationalizing the construct of pragmatic competence: Review and recommendations. ETS Research Report Series, 2015(1), 1-43. https://doi.org/10.1002/ets2.12053
Leech, G. (2014). The pragmatics of politeness. Oxford University Press.
Malmir, A., & Derakhshan, A. (2020). The socio-pragmatic, lexico-grammatical, and cognitive strategies in L2 pragmatic comprehension: The case of Iranian male vs. female EFL learners. Iranian Journal of Language Teaching Research, 8(1), 1-23.
Mao, T., & He, S. (2021). An integrated approach to pragmatic competence: Its framework and properties. SAGE Open, 11(2), 1–13 https://doi.org/10.1177/21582440211011472
Marian, V., Blumenfeld, H. K., & Kaushanskaya, M. (2007). The language experience and proficiency questionnaire (LEAP-Q): Assessing language profiles in bilinguals and multilinguals. Journal of Speech, Language, and Hearing Research, 50(4), 940–967.
Mootoosamy, K., & Aryadoust, V. (2024). Transitioning from communicative competence to multimodal and intercultural competencies: A systematic review. Societies, 14(7), 115. https://doi.org/10.3390/soc14070115
O'Grady, S. (2023). An AI-generated test of pragmatic competence and connected speech. Language Teaching Research Quarterly, 37, 188-203. https://doi.org/10.32038/ltrq.2023.37.10
Purpura, J. E. (2017). Assessing meaning. In E. Shohamy, I. Or, & S. May (Eds.), Language testing and assessment (pp. 33–61). Springer.
Roever, C. (2006). Validation of a web-based test of ESL pragmalinguistics. Language Testing, 23(2), 229-256.
Roever, C. (2021). Teaching and testing second language pragmatics and interaction: A practical guide. Routledge.
Roever, C. (2024). Assessment and L2 pragmatics. Applied Pragmatics, 6(2), 117-130.
Saeedi, Z., & Soltani, M. (2025). Developing an AI chatbot for language pragmatics instruction: from algorithms to dynamic assessment in an EFL context. Computer Assisted Language Learning, 1-22. https://doi.org/10.1080/09588221.2025.2532014
Savadkouhi, Z. B., & Mostafaei Alaei, M. (2022). Cross-cultural pragmatic failure in English language classrooms: Development of a multi-dimensional model based on EFL teachers’ and learners’ perceptions. Journal of Modern Research in English Language Studies, 9(3), 49–72. https://doi.org/10.30479/jmrels.2022.16141.1962
Sedaghatgoftar, N., Karimi, M. N., Babaii, E., & Reiterer, S. M. (2019). Developing and validating a second language pragmatics aptitude test. Cogent Education, 6(1), Article e1654650.
Shakki, F., Naeini, J., Mazandarani, O., & Derakhshan, A. (2021). Instructed second language pragmatics for the speech act of apology in an Iranian EFL context: A meta-analysis. Applied Research on English Language, 10(3), 77-104. https://doi.org/10.22108/are.2021.128213.1709
Tajeddin, Z., & Khanlarzadeh, N. (2024). The role of learner variables in pragmatic development during study abroad: A systematic review. Languages, 9(3), 96.
Taguchi, N. (2019). Second language acquisition and pragmatics: An overview. In N. Taguchi (Ed.), The Routledge handbook of second language acquisition and pragmatics (pp. 1–14). Routledge.
Taguchi, N., & Li, S. (2020). Contrastive pragmatics and second language (L2) pragmatics: Approaches to assessing L2 speech act production. Contrastive Pragmatics, 2(1), 1-23.
Taguchi, N., & Roever, C. (2020). Second language pragmatics. Oxford University Press.
Timpe-Laughlin, V., & Choi, I. (2017). Exploring the validity of a second language intercultural pragmatics assessment tool. Language Assessment Quarterly, 14(1), 19–35. https://doi.org/10.1080/15434303.2016.1256406
Wilson, A., & Bishop, D. (2021). A novel online assessment of pragmatic and core language skills: An attempt to tease apart language domains in children. Journal of Child Language, 49, 38-59. https://doi.org/10.1017/s0305000920000690
Yousefi, M., & Nassaji, H. (2024). The impact of corrective feedback on L2 pragmatics production in face-to-face and technology-mediated settings. Language Teaching Research Quarterly, 39, 305–328.
Zangoei, A., Zareian, G., Adel, S. M. R., & Amirian, S. M. R. (2019). The impact of computerized dynamic assessment on Iranian EFL learners' interlanguage pragmatic development. Journal of Modern Research in English Language Studies, 6(4), 139–165. https://doi.org/10.30479/jmrels.2019.11536.1433
Zhang, Y. (2023). The effects of interleaved and blocked corpus-based practice on L2 pragmatic development. Studies in Second Language Acquisition, 45(4), 812–837. | ||
|
آمار تعداد مشاهده مقاله: 116 تعداد دریافت فایل اصل مقاله: 10 |
||