论文标题
态度调查中的开放与封闭式问题 - 比较,结合和解释自然语言处理
Open vs Closed-ended questions in attitudinal surveys -- comparing, combining, and interpreting using natural language processing
论文作者
论文摘要
为了改善旅行经验,研究人员一直在分析态度在旅行行为建模中的作用。尽管大多数研究人员都使用封闭式调查,但衡量态度的适当方法是有争议的。主题建模可以大大减少从开放式响应中提取信息并消除主观偏见的时间,从而减轻分析师的关注。我们的研究使用主题建模来从开放式问题中提取信息,并将其绩效与封闭式回答进行比较。此外,一些受访者可能更喜欢使用其首选问卷类型回答问题。因此,我们提出了一个建模框架,该框架允许受访者使用其首选问卷类型来回答调查,并使分析师能够使用其选择的建模框架来预测行为。我们使用从美国收集的数据集来证明这一点,该数据集衡量使用自动驾驶汽车进行通勤旅行的意图。向受访者提供了替代的问卷版本(开放和封闭式)。由于我们的目标也比较了替代问卷版本的性能,因此该调查旨在消除陈述,行为框架和选择实验的影响。结果表明使用主题建模从开放式响应中提取信息的适用性;但是,使用封闭问题估计的模型与它们相比表现更好。此外,与当前使用的模型相比,提出的模型的性能更好。此外,我们提出的框架将使受访者可以选择问卷类型来回答,这在使用基于语音的调查时可能对他们特别有益。
To improve the traveling experience, researchers have been analyzing the role of attitudes in travel behavior modeling. Although most researchers use closed-ended surveys, the appropriate method to measure attitudes is debatable. Topic Modeling could significantly reduce the time to extract information from open-ended responses and eliminate subjective bias, thereby alleviating analyst concerns. Our research uses Topic Modeling to extract information from open-ended questions and compare its performance with closed-ended responses. Furthermore, some respondents might prefer answering questions using their preferred questionnaire type. So, we propose a modeling framework that allows respondents to use their preferred questionnaire type to answer the survey and enable analysts to use the modeling frameworks of their choice to predict behavior. We demonstrate this using a dataset collected from the USA that measures the intention to use Autonomous Vehicles for commute trips. Respondents were presented with alternative questionnaire versions (open- and closed- ended). Since our objective was also to compare the performance of alternative questionnaire versions, the survey was designed to eliminate influences resulting from statements, behavioral framework, and the choice experiment. Results indicate the suitability of using Topic Modeling to extract information from open-ended responses; however, the models estimated using the closed-ended questions perform better compared to them. Besides, the proposed model performs better compared to the models used currently. Furthermore, our proposed framework will allow respondents to choose the questionnaire type to answer, which could be particularly beneficial to them when using voice-based surveys.