اخبار و اعلانات
آمار
| تعداد نشریات | 20 |
| تعداد شماره‌ها | 347 |
| تعداد مقالات | 2,862 |
| تعداد مشاهده مقاله | 3,253,629 |
| تعداد دریافت فایل اصل مقاله | 2,389,232 |
طراحی و اعتبارسنجی اوّلین آزمون تعیین سطح زبان فارسی براساس منابع آموزشی جامعه-المصطفی(ص) العالمیّه | ||
| پژوهش نامه آموزش زبان فارسی به غیر فارسی زبانان | ||
| مقاله 4، دوره 12، شماره 1 - شماره پیاپی 25، فروردین 1402، صفحه 45-72 اصل مقاله (1.51 M) | ||
| نوع مقاله: مقاله پژوهشی | ||
| شناسه دیجیتال (DOI): 10.30479/jtpsol.2022.17549.1602 | ||
| نویسندگان | ||
| زهرا سمائی1؛ عطیه کامیابی گل* 2؛ محمود مهرآوران3 | ||
| 1کارشناسی ارشد آموزش زبان فارسی به غیر فارسی زبانان، دانشگاه فردوسی مشهد، مشهد، ایران. | ||
| 2نویسندۀ مسئول،دانشیار گروه زبان و ادبیات فارسی و گروه زبانشناسی، دانشگاه فردوسی مشهد، مشهد، ایران. | ||
| 3دانشیار گروه زبان و ادبیات فارسی، دانشگاه قم، قم. ایران. | ||
| تاریخ دریافت: 22 تیر 1401، تاریخ بازنگری: 13 شهریور 1401، تاریخ پذیرش: 19 مهر 1401 | ||
| چکیده | ||
| آزمون و آزمون‌سازی همواره بخش جدانشدنی آموزش زبان است. وجود یک آزمون تعیین سطح استانده برای مراکز آموزش زبان فارسی به غیر فارسی زبانان (آزفا) امری ضروری است؛ بدین منظور برای اولین بار آزمون تعیین سطح متناسب با منابع آموزش زبان فارسی جامعه المصطفی(ص) طراحی و اعتبارسنجی گردید. هدف پژوهش، طراحی آزمون استاندارد هنجار شده و علمی برای تعیین سطح زبان فارسی، در سه سطح مبتدی، میانی،و پیشرفته بر اساس مجموعه کتاب‌های«پارسا» است. جامعه آماری این پژوهش 135 فارسی‌آموز مراکز آموزش زبان فارسی جامعه‌المصطفی(ص) از چهار ملیّت مختلف، در ایران و ترکیه بودند که به صورت نمونه‌گیری در دسترس جهت شرکت در پژوهش دعوت شدند. آزمون شامل بخش‌های واژگان و دستور، شنیدار، خواندار، نوشتار و گفتار است. تحلیل سوال‌های آزمون با استفاده از فرمول‌های ضریب تمییز و ضریب دشواری محاسبه گردید که نتایج نشان دهندة قدرت تشخیص مناسب و قابل قبول بودن ضریب دشواری ماده‌های آزمون بود. روایی صوری و محتوایی آزمون‌ها نیز با استفاده از مصاحبة کتبی با 20 مدرس جامعه المصطفی(ص) واکاوی و تایید شد. در بخش شفاهی و سنجش مهارت گفتاری، پایایی بین نمرات دو ارزیاب، با ضریب کاپای کوهن محاسبه شد و نتایج حاکی از توافق قابل قبول بین آن‌ها بود. در نهایت، پایایی آزمون‌ها با استفاده از فرمول کودر- ریچاردسون21 محاسبه شد که نتیجة پایایی هر سه آزمون بالای 80% به دست آمد که نشان از مطلوب بودن آزمون‌ها دارد. | ||
| کلیدواژه‌ها | ||
| آزمون تعیین سطح زبان فارسی؛ پایایی؛ روایی؛ آزمون‌سازی زبان؛ مرکز آموزش زبان جامعه المصطفی(ص) | ||
| عنوان مقاله [English] | ||
| Design and Validation of the First Persian Placement Test Based on the Educational Resources of Al-Mustafi (PBUH) Center for Teaching Persian to Non-Persian Speakers | ||
| نویسندگان [English] | ||
| Zahra Samaee1؛ Atiyeh Kamyabi Gol2؛ Mahmood Mehravaran3 | ||
| 1M.A. Student in TPNPS at Ferdowsi University of Mashhad, Instructor at Al-Mustafi Center for Teaching Persian to Non-Persian Speakers, Mashhad, Iran. | ||
| 2Corresponding Author, Assistant professor, Department of Persian Language and Literature and the Department of linguistics, Ferdowsi university of Mashhad, Mashhad, Iran. | ||
| 3Associate Professor, Department of Persian Language and Literature, Qom University,Qom, Iran. | ||
| چکیده [English] | ||
| Testing has always been an inseparable part of teaching. Having a test to determine the level of proficiency for Persian language teaching non-Persian speakers (Azfa) centers is a necessity. To this purpose, the first placement test based on the Persian language teaching textbooks of Al-Mustafa was designed and validated. The purpose of the present research was to design a standard test to determine the language proficiency level of the Persian language learners (beginner, intermediate, and advanced) based on "Parsa" textbooks. The participants were 135 Persian learners from Al-Mustafi (PBUH) Center for Teaching Persian to Non-Persian Speakers from four different nationalities studying in Iran and Turkey. The participants were recruited based on convenience sampling. The designed placement test included vocabulary and grammar, listening, reading, writing and speaking. The item analysis of the test was calculated using item difficulty and item discrimination formulas and the results showed that both the difficulty and discrimination levels were acceptable. The face and content validities were analyzed and confirmed using a written interview with 20 teachers of Al-Mustafa Center for Teaching Persian to Non-Persian Speakers. The inter-rater reliability (Cohen’s Kappa) between the evaluators’ scores for the speaking and writing sections of the test also indicated an acceptable agreement. Finally, the reliability of the tests was calculated using KR-21, and the reliability results of all three tests were above 80%, which shows the suitability of the tests. Extended Abstract: Introduction Language testing is an inseparable part of language teaching. Through language assessment and evaluation, educators can determine whether the learner has successfully achieved the learning outcomes. A language test is an instrument which measures the quality and performance of a language program and educational resources. Tests are of different types and one of the most important tests is the placement test which helps educational institutions to place a learner in the right class or group based on the learner’s language knowledge and proficiency (Farhady et al., 2014; Bachman & Palmer, 2010). There is no doubt that the more standard the test, the more successful the language program. Therefore, it is of the utmost importance to design and validate language proficiency tests in order to assign learners to the right classes (Farhady et al., 2014) and help remove their psychological barriers (Kim & Shin, 2006). The present study is focused on designing and validating a placement test based on Al-Mustafi (PBUH) Center for Teaching Persian to Non-Persian Speakers’ Persian textbooks. Al-Mustafi (PBUH) Center for Teaching Persian to Non-Persian Speakers was established around 30 years ago and has over 60 branches around the world. Past literature has focused on the design and validation of English placement tests (Akhidenor-Bamidele, 2019; Kadwa & Sheik, 2021; Kim & Shin, 2006; Nasem & Mohammad, 2018) and has highlighted the importance of using such tests to group learners. Persian proficiency tests (Abbassi, 2014; Ghonsooly, 2003; Zandi et al., 2020;) and placement tests (Sahraei & Rezapour, 2011) have also been the focus of some research, but to the best of the authors’ knowledge, no study has been conducted on designing and validating a placement test for Al-Mustafi (PBUH) Center for Teaching Persian to Non-Persian Speakers. This was the research gap that motivated the authors to focus on designing such a test for the three language proficiency levels of elementary, intermediate, and advanced. The research questions for the present research focused on the item analysis, reliability and validity of the designed placement test. Methodology The designed tests contained 40 questions on vocabulary, grammar, reading, and listening. Also, two writing tasks were considered for the writing section. Finally, 10 oral questions were used for the speaking section of the test. Two raters scored the writing and speaking sections individually. Item analysis was used to analyze all multiple choice items on the tests. Also, in order to check the inter-rater reliability for the speaking and writing sections of the test, Cohen’s Kappa was used. SPSS version 26 was used for calculating the Kappa. The reliability of the tests was analyzed through KR-21 and teacher feedback (written interview) was collected for the face and content validities. After taking all teacher comments and suggestion on board, the test was ready to be administered. A total of 135 Persian language learner participants were recruited from the three language proficiency levels. The participants were from Pakistan, India, Azerbaijan, and Turkey. The test was administered both in Iran and Turkey. The 90 participants studying in Iran were all females and their age range was 18-25 (SD=1.62) and the 45 participants studying in Turkey were 25 females and 15 males and their age range was 13-47 (SD= 9.15). The teacher participants who took part in a written interview included 15 females and 5 males. Their ages ranged between 25 and 58 (SD=7.92) with a 4-18 years of teaching experience. All participants signed a written consent form. Results and Discussion The internal consistency of the designed test items was measured through Cronbach’s alpha. Cronbach’s alpha reliability coefficient normally ranges between 0 and 1. The closer the coefficient is to 1, the more internally consistent the test items. The reliability coefficient results for the three placement test levels revealed 0.94 for the beginner level which was found to be highly reliable, 0.83 for the intermediate level which indicates good internal consistency, and 0.80 for the advanced level which again indicates good internal consistency for the test items. The Kuder-Richardson 21 formula was also used to measure the internal consistency of the test items. All KR-21 results for the reliability showed acceptable results of over 0.7 (Dornyei, 2011; Farhady et al., 2014). Also, the inter-rater reliability results for the speaking and writing tasks of the tests were also considered acceptable. The inter-reliability was measured in order to measure the degree of agreement among independent observers. This was used to limit the subjective scoring of each rater. These results ranged from 0.69-0.91. The face and content validity of the tests were conducted through a written interview and the results showed that all teachers approved both the face and content validities. The only concern some teachers had was regarding the test time. For the beginner level, 10% of the teachers, and five percent of the teachers for the intermediate level test believed that the time should be increased by five minutes. The item analysis results also indicated that for the beginner level out of the 40 items, 39 items had acceptable difficulty levels and all 40 items enjoyed an acceptable discrimination level. For the intermediate level test, out of the 40 items, 32 items were considered to have acceptable difficulty levels and 8 items were considered difficult. 38 of the items also showed an acceptable discrimination level. Finally, for the advanced proficiency level, out of the 40 items, 38 items had an acceptable range and 2 items were considered to be simple. One reason for this simplicity might have been the shared interlingual lexicon since most advanced level participants were from Pakistan. The discrimination level for 39 of the advanced level test items was considered to be acceptable as well. All in all, it seems that the designed test was generally dominated by acceptable items. Also, most of the question items could successfully discriminate between high and low students. The overall face and content validities were also approved by the teachers and the reliability was approved through KR-21. Conclusion The present study aimed to design and validate a placement test based on Al-Mustafi (PBUH) Center for Teaching Persian to Non-Persian Speakers’ Persian textbooks. This was the first validated placement test to be designed for the Al-Mustafi (PBUH) Center for Teaching Persian to Non-Persian Speakers. The results revealed that the designed test for all three proficiency levels were considered acceptable. The internal consistency of the designed test items, measured through Cronbach’s alpha and KR-21 were considered reliable and also Cohen’s Kappa values showing the results for the inter-rater reliability measurement, ranging from 0.69-0.91, were considered very good to excellent. As for the validity of the placement tests, the results for the face validity and content validity of the tests, conducted through a written interview with teacher participants at all three proficiency levels (beginner, intermediate, and advanced), indicated an overall approval. The teachers’ suggestions regarding the time limit on the test for each level was also taken into consideration. The item analysis results including both item difficulty and item discrimination also showed acceptable levels for the test items. In the end the authors hope that the designed placement test could be used at Al-Mustafi (PBUH) Centers for Teaching Persian to Non-Persian Speakers worldwide and that this instrument could help both teachers and learners alike to have a better learning experience. Acknowledgment This paper and the research behind it would not have been possible without the exceptional support from Al-Mustafi (PBUH) Center for Teaching Persian to Non-Persian Speakers in Istanbul and Mashhad. Conflict of Interest No conflicts of interest are reported by the author for this article. | ||
| کلیدواژه‌ها [English] | ||
| proficiency test, reliability, validity, language testing, Al-Mustafi (PBUH) Center for Teaching Persian to Non-Persian Speakers | ||
| مراجع | ||
|
جعفرپور، عبدالجواد. (1375). مقدمه‌ای بر آزمون‌شناسی زبان. شیراز: انتشارات دانشگاه شیراز.
داگلاس، دن. (2014). درآمدی بر آزمون سازی زبان. ترجمۀ هدی صحرایی و دیگران. (1397). تهران: انتشارات نشر نویسۀ پارسی.
زندی، بهمن؛ روشن، بلقیس؛ وکیلی فرد، امیررضا و گلپور، لیلا. (1398). طراحی و اعتباربخشی آزمون استاندارد زبان فارسی برپایۀ چهار مهارت زبانی. جستارهای زبانی 10 (6)، 139-171.
سمائی، زهرا و کامیابی‌گل، عطیه. (1399). اعتبار سنجی آزمون نهایی زبان فارسیِ مدرسه المهدی (عج) جامعه المصطفی(ص) العالمیّه. همایش ملّی الزامات آموزش زبان وادبیات فارسی در مدارس. مراکز زبان آموزی، دانشگاه‌ها و فضای مجازی، دانشگاه فردوسی مشهد.
سیف، علی‌اکبر. (1390). اندازه‌گیری، سنجش و ارزشیابی آموزشی. تهران: نشر دوران.
صحرایی، رضامراد و جلیلی، سیداکبر. (1391). مبانی تهیه و تدوین آزمون مهارتی فارسی (آمفا). پژوهش‌نامۀ آموزش زبان فارسی به غیرفارسی‌زبانان، 1 (1)، 124-150.
صحرایی، رضامراد و رضاپور، غلامحسین. (1398). ارزیابی روایی و پایایی آزمون تعیین سطح زبان فارسی برای غیرفارسی‌زبانان بنیاد سعدی. اندازه‌گیری تربیتی، 9 (37)، 91-111.
عباسی، زهرا. (1393). تهیه و تدوین آزمون بسندگی زبان فارسی. نخستین همایش زبان فارسی، تهران، دانشگاه تربیت مدرس.
قنسولی، بهزاد. (1382)، فرهنگ واژگان آزمون‌سازی (توصیفی-توضیحی). مشهد: انتشارات تابران.
قنسولی، بهزاد. (1389). طراحی و روایی سنجی آزمون بسندگی زبان فارسی. پژوهش‌های زبان‌های خارجی، 57، 115-129.
References
Abbasi, Z. (2014). Preparing and compiling the Persian language proficiency test. Tarbiat Modares University. [ In Persian]
Akhidenor-Bamidele, A. (2019). The roles of online placement test in English language teaching. KnE Social Sciences, 3 (24), 1–9. https://doi.org/10.18502/kss.v3i24.5163
Bachman, L. F. (1995). Fundamental considerations in language testing. Oxford University Press.
Bachman, L. F., & Palmer, A. S. (2010). Language assessment in practice. Oxford University Press. Birjandi, P., & Mosallanejad, P., (2010), An overview of testing and assessment: An overview of testing and assessment. Sepahan Publication.
Brown, D. (2010). Language assessment: Principles and classroom practices. Pearson Education.
Brown, J. D. (2008). Testing in language programs. USA: McGraw-Hill.
Carletta, J. (1996). Assessing agreement on classification tasks: The Kappa statistic. Computational Linguistics, 22 (2), 249–254.
Chastain٫ K. (1988). Developing second language skills. Harcourt Brace Jovanovich Publishers.
Cohen, A. D. (1994). Assessing language ability in the classroom. Heinle & Heinle.
Dornyei, Z. (2011). Research methods in applied linguistics. Oxford University Press.
Douglas, D. (2014). Understanding language testing. Translators: Sahraei, Rezamorad؛ Salimi,Hoda؛ Marsus, Faeze. Tehran. Neveeseh Parsi Press. [ In Persian]
Farhady, H.& Ja’farpur, A. & Birjandi, P. (2014). Testing language skills: From theory to practice. SAMT.
Fulcher, G. (2013). Practical language testing. Routledge.
Ghonsooli, B. (2003). A dictionary of language testing. Tabaran Press. [In Persian]
Ghonsooli, B. (2010). Designing and validation of Persian language proficiency test. Foreign Language Research, 57, 115-129. [In Persian]
Glen, S. (2016). Kuder-Richardson 20 (KR-20) & 21 (KR-21). Retrieved from statisticsHowTo.com: Elementary Statistics for the rest of us! https://www.statisticshowto.com/kuder-richardson/ on July 05, 2022.
Hughes, A. (2012). Testing for language teachers. Cambridge University Press.
Jafarpur, A. (1997). An Introduction to language Testing. Shiraz University Press. [In Persian]
Kadwa, M. S., & Sheik, A. (2021). A critical review of the Oxford q-skills placement test at a Saudi Arabian University. International Journal of Linguistics, Literature and Translation, 4 (1), 198-209.
Kim, H. J., & Shin, H. W. (2006). A reading and writing placement test: Design, evaluation, and analysis. Studies in Applied Linguistics and TESOL, 6 (2), 68-80.
Klein-Braley, C. (1984). Advance Prediction of Difficulty with C-Tests. In T. Culhane, C. Klein-Braley, and D. K. Stevenson (Eds.), Practice and problems in language testing (pp. 97-112). University of Essex.
Kusiak-Pisowacka, M. (2015). The use of the Iteman program in designing a general foreign language placement test. International Journal of Scientific and Research Publications, 5 (12), 50-68.
Nasem, H. & Mohammad, A. (2018). Teachers’ perceptions on the effectiveness of the Oxford Online Placement Test at King Abdulaziz University (Doctoral dissertation, Durham University).
Sahraee, R., Rezapour, G. (2019). Evaluation of reliability and validity of Persian for non-Persian speakers placement tests of Sa’adi Foundation. Quarterly of Educational Measurement, 10 (37), 91-111. doi: 10.22054/jem.2020.39125.1892 [In Persian]
Sahraei, R., & Jalili, A. (2011). Skill based Persian language test on the basis of 4 main language skills. Journal of Teaching Persian to Speakers of Other Languages (JTPSOL), 1 (1),124-150. [In Persian]
Samaei, Z., & Kamyabi Gol, A. (2020). Validation of the final Persian language exam of Al-Mahdi School (AS) of Al-Mustafa University. National conference on the requirements of teaching Persian language and literature in schools, language learning centers, universities and virtual space. Ferdowsi University of Mashhad. [In Persian]
Seif, A. A. (2011). Pedagogical measurement, examination and evaluation. Davaran Publ. [In Persian]
Traub, R.E. (1994). Reliability for the social sciences: Theory and applications. Sage.
Zandi, B., Rovshan, B., Vakilifard, A., & Golpour L. (2011) Planning and validating Persian language standard test (On the basis of four language skills). LRR., 10 (6), 139-171. [In Persian] | ||
|
آمار تعداد مشاهده مقاله: 448 تعداد دریافت فایل اصل مقاله: 194 |
||