论文标题
检查算法意识对Wikidata推荐系统的影响
Examining the Impact of Algorithm Awareness on Wikidata's Recommender System Recoin
论文作者
论文摘要
该网络的全球基础架构设计为开放透明的系统,对我们的社会产生了重大影响。但是,忽略这些原则的公司实体的算法系统越来越多地填充了网络。这些算法系统的典型代表是推荐的系统,它们在全球政治和平凡的购物决策中都会影响我们的社会。最近,这种推荐系统对它们如何加强现有甚至产生新种类的偏见受到批评。为此,越来越多地敦促设计师和工程师使推荐系统的功能和目的更加透明。我们的研究涉及算法意识的话语,它重新吸收了算法可见性在界面设计中的作用。我们与105名参与者进行了在线实验。在这些实验中,我们向用户介绍了Recoin用户界面的三种不同设计之一,它们都表现出不同程度的解释性和互动性。我们的发现包括对我们交互式重新设计中对算法系统的理解和信任之间的正相关。但是,我们的结果尚不确定,并表明,对于算法意识的实证研究,理解,公平,准确性和信任的度量尚未详尽。我们的定性见解为进一步措施提供了第一个迹象。例如,我们的研究参与者对理解算法计算的细节不太关心,而不是与算法结果判断谁或什么。
The global infrastructure of the Web, designed as an open and transparent system, has a significant impact on our society. However, algorithmic systems of corporate entities that neglect those principles increasingly populated the Web. Typical representatives of these algorithmic systems are recommender systems that influence our society both on a scale of global politics and during mundane shopping decisions. Recently, such recommender systems have come under critique for how they may strengthen existing or even generate new kinds of biases. To this end, designers and engineers are increasingly urged to make the functioning and purpose of recommender systems more transparent. Our research relates to the discourse of algorithm awareness, that reconsiders the role of algorithm visibility in interface design. We conducted online experiments with 105 participants using MTurk for the recommender system Recoin, a gadget for Wikidata. In these experiments, we presented users with one of a set of three different designs of Recoin's user interface, each of them exhibiting a varying degree of explainability and interactivity. Our findings include a positive correlation between comprehension of and trust in an algorithmic system in our interactive redesign. However, our results are not conclusive yet, and suggest that the measures of comprehension, fairness, accuracy and trust are not yet exhaustive for the empirical study of algorithm awareness. Our qualitative insights provide a first indication for further measures. Our study participants, for example, were less concerned with the details of understanding an algorithmic calculation than with who or what is judging the result of the algorithm.