Integrating Syntactic and Semantic Features for Automated Essay Scoring
(1. School of Computer Science and Technology, Xinjiang Normal University, Urumqi 830054, China; 2. School of Computer Science and Technology, Inner Mongolia University for Nationalities, Tongliao 028000, China)
CHEN Yuhang1, YANG Yong1, Palidan TUERXUN1, FAN Xiaochao1, REN Ge1, DIAO Yufeng2. Integrating Syntactic and Semantic Features for Automated Essay Scoring[J]. Computer and Modernization, 2024, 0(11): 64-69.
[1] CHEN Y Y, LIU C L, CHANG T H, et al. An unsupervised automated essay scoring system[J]. IEEE Intelligent Systems, 2010,25(5):61-67.
[2] BURSTEIN J, CHODOROW M, LEACOCK C. Automated essay evaluation: The Criterion online writing service[J]. AI Magazine, 2004,25(3):27-36.
[3] KE Z X, NG V. Automated essay scoring: A survey of the state of the art[C]// 28th International Joint Conference on Artificial Intelligence(IJCAI). IJCAI, 2019:6300-6308.
[4] WIRATMO A, FATICHAH C. Assessment of Indonesian short essay using transfer learning siamese dependency tree-LSTM[C]// 2020 4th International Conference on Informatics and Computational Sciences (ICICoS). IEEE, 2020. DOI: 10.1109/ICICOS51170.2020.9299044.
[5] MEZHER R, OMAR N. A hybrid method of syntactic feature and latent semantic analysis for automatic Arabic essay scoring[J]. Journal of Applied Sciences, 2016,16(5):209-215.
[6] BURSTEIN J, KUKICH K, WOLFF S, et al. Automated scoring using a hybrid feature identification technique[C]// 36th Annual Meeting of the Association for Computational Linguistics and 17th International Conference on Computational Linguistics. ACL, 1998:206-210.
[7] 韩辉,刘秀文. 海事适任评估中主观题自动评分技术研究[J]. 数据分析与知识发现, 2021,5(8):113-121.
[8] RODRIGUEZ P U, JAFARI A, ORMEROD C M. Language models and automated essay scoring[J]. arXiv preprint arXiv:1909.09482, 2019.
[9] HOULSBY N, GIURGIU A, JASTRZEBSKI S, et al. Parameter-efficient transfer learning for NLP[C]// 2019 International Conference on Machine Learning. PMLR, 2019:2790-2799.
[10] HONNIBAL M, JOHNSON M. An improved non-monotonic transition system for dependency parsing[C]// Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing. ACL, 2015:1373-1378.
[11] TAGHIPOUR K, NG H T. A neural approach to automated essay scoring[C]// Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing. ACL, 2016:1882-1891.
[12] 周险兵,樊小超,任鸽,等. 基于多层次语义特征的英文作文自动评分方法[J]. 计算机应用, 2021,41(8):2205-2211.
[13] HOWARD J, RUDER S. Universal language model fine-tuning for text classification[J]. arXiv preprint arXiv:1801.06146, 2018.
[14] SONG W, ZHANG K, FU R J, et al. Multi-stage pre-training for automated Chinese essay scoring[C]// Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing. ACL, 2020:6723-6733.
[15] MIM F S, INOUE N, REISERT P, et al. Unsupervised learning of discourse-aware text representation for essay scoring[C]// Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics: Student Research Workshop. ACL, 2019:378-385.
[16] MAYFIELD E, BLACK A W. Should you fine-tune BERT for automated essay scoring?[C]// Proceedings of the 15th Workshop on Innovative Use of NLP for Building Educational Applications. ACL, 2020:151-162.
[17] YANG R S, CAO J N, WEN Z Y, et al. Enhancing automated essay scoring performance via fine-tuning pre-trained language models with combination of regression and ranking[C]// Findings of ACL: EMNLP 2020, Part 3: Conference on Empirical Methods in Natural Language Processing(EMNLP 2020). ACL, 2020:1560-1569.
[18] XUE J, TANG X Y, ZHENG L Y. A hierarchical BERT-based transfer learning approach for multi-dimensional essay scoring[J]. IEEE Access, 2021,9:125403-125415.
[19] SUN J B, SONG T B, SONG J H, et al. Improving automated essay scoring by prompt prediction and matching[J]. Entropy, 2022,24(9). DOI: 10.3390/e24091206.
[20] WU Y C, HENRIKSSON A, NOURI J, et al. Beyond benchmarks: Spotting key topical sentences while improving automated essay scoring performance with topic-aware BERT[J]. Electronics, 2023,12(1). DOI:10.3390/electronics12010150.
[21] VASWANI A, SHAZEER N, PARMAR N, et al. Attention is all you need[C]// Proceedings of the 31st International Conference on Neural Information Processing Systems. ACM, 2017:6000-6010.
[22] SHEN D H, WANG G Y, WANG W L, et al. On the use of word embeddings alone to represent natural language sequences[C]// Proceedings of the 2018 International Conference on Learning Representations. ICLR, 2018.
[23] UTO M, XIE Y K, UENO M. Neural automated essay scoring incorporating handcrafted features[C]// Proceedings of the 28th International Conference on Computational Linguistics. ICCL, 2020:6077-6088.
[24] DONG F, ZHANG Y, YANG J. Attention-based recurrent convolutional neural network for automatic essay scoring[C]// Proceedings of the 21st Conference on Computational Natural Language Learning (CoNLL’ 2017). ACL, 2017: 153-162.
[25] CHEN M P, LI X. Relevance-based automated essay scoring via hierarchical recurrent model[C]// 2018 International Conference on Asian Language Processing (IALP). IEEE, 2018:378-383.
[26] CAO Y, JIN H Q, WAN X J, et al. Domain-adaptive neural automated essay scoring[C]// Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 2020:1011-1020.
[27] WANG Y J, WANG C, LI R B, et al. On the use of BERT for automated essay scoring: Joint learning of multi-scale essay representation[J]. arXiv preprint arXiv:2205.03835, 2022.
[28] 知乎. 阿里云宣布开源通义千问70亿参数大模型,将对国内大模型行业产生哪些影响[EB/OL]. [2023-09-22]. https://www.zhihu.com/question/615428959.