|
|
Publication
|
| Title of Article |
Revision of an Academic English Writing Rubric for a University Admission Test |
| Date of Acceptance |
10 May 2023 |
| Journal |
| Title of Journal |
PASAA Journal |
| Standard |
SCOPUS |
| Institute of Journal |
Chulalongkorn University Language Institute |
| ISBN/ISSN |
|
| Volume |
|
| Issue |
65 |
| Month |
January to June |
| Year of Publication |
2023 |
| Page |
|
| Abstract |
This study aimed to revise an academic English writing rubric for a university admission test. The samples of the study were 134 scored writing responses. Four trained raters were also recruited. The data were analyzed using the developed revision model based on the two revision models, the Triangulation Scale Revision Process (Banerjee et al., 2015) and the Mixed-methods Conceptual Design Model (Janssen et al., 2015). Corpus analyses were employed to investigate the lexical profiles, i.e., lexical diversity, lexical density, and grammatical profile, and response length. Multi-facet RASCH Model analyses (MFRM) were used for identifying the in-depth correlations among three facets in rating: test takers’ abilities, raters’ severity, and scales. Finally, a raters’ discussion with four trained raters was conducted to identify significant features in rating and to examine the extent to which the rubric can be revised. The findings revealed that the proposed revision model can be used for revising scales. The corpus analyses revealed that the grammatical and lexical profiles were not significantly correlated (p<0.05). Hence, language use trait was separated into grammar and vocabulary traits. The results of the MFRM showed that the original rubric can be revised in terms of score weighing, giving decimal scores, and raters’ severity. Thus, the consensus to weigh each trait equally and the consensus to give only integer scores had been made. The rubric was revised following the results of the corpus analyses, and the descriptor was revised according to the significant features retrieved from the raters’ discussion. |
| Keyword |
Academic Writing, Writing Test, Writing Rubric, Writing Rubric Revision |
| Author |
|
| Reviewing Status |
มีผู้ประเมินอิสระ |
| Status |
ได้รับการตอบรับให้ตีพิมพ์ |
| Level of Publication |
นานาชาติ |
| citation |
true |
| Part of thesis |
true |
| Attach file |
|
| Citation |
0
|
|
|
|
|
|
|
|
|
Journal Publication
ไทย