论文标题
辅助任务引导的交互式注意模型难以预测
Auxiliary Task Guided Interactive Attention Model for Question Difficulty Prediction
论文作者
论文摘要
在线学习平台进行考试以单调的方式评估学习者,其中数据库中的问题可以分为BLOOM的分类法,因为从基本知识到高级评估的复杂性水平都不同。这些考试中向所有学习者提出的问题非常静态。向每个学习者提出不同难度级别的新问题以提供个性化的学习经验变得重要。在本文中,我们提出了一种具有互动关注机制的多任务方法,以共同预测布鲁姆的分类法和学术问题的难度。我们使用注意力机制来建模预测的Bloom分类法和输入表示之间的相互作用,以帮助进行难度预测。提出的学习方法将有助于学习捕获Bloom的分类学和难度标签之间关系的表示形式。所提出的多任务方法通过利用相关任务之间的关系来学习良好的输入表示形式,并且可以在与任务相关的类似设置中使用。结果表明,所提出的方法的性能比仅在难度预测方面的训练要好。但是,Bloom的标签可能并不总是针对某些数据集提供的。因此,我们将另一个数据集贴上了一个使用微调的模型来预测Bloom的标签,以证明我们的方法对仅具有难度标签的数据集的适用性。
Online learning platforms conduct exams to evaluate the learners in a monotonous way, where the questions in the database may be classified into Bloom's Taxonomy as varying levels in complexity from basic knowledge to advanced evaluation. The questions asked in these exams to all learners are very much static. It becomes important to ask new questions with different difficulty levels to each learner to provide a personalized learning experience. In this paper, we propose a multi-task method with an interactive attention mechanism, Qdiff, for jointly predicting Bloom's Taxonomy and difficulty levels of academic questions. We model the interaction between the predicted bloom taxonomy representations and the input representations using an attention mechanism to aid in difficulty prediction. The proposed learning method would help learn representations that capture the relationship between Bloom's taxonomy and difficulty labels. The proposed multi-task method learns a good input representation by leveraging the relationship between the related tasks and can be used in similar settings where the tasks are related. The results demonstrate that the proposed method performs better than training only on difficulty prediction. However, Bloom's labels may not always be given for some datasets. Hence we soft label another dataset with a model fine-tuned to predict Bloom's labels to demonstrate the applicability of our method to datasets with only difficulty labels.