论文标题
引导程序完成Pinterest的外观
Bootstrapping Complete The Look at Pinterest
论文作者
论文摘要
将理想的服装放在一起是一个涉及创造力和风格直觉的过程。这使自动化是一项特别艰巨的任务。现有的造型产品通常涉及人类专家和一套高度精心策划的时尚产品。在本文中,我们将描述如何在Pinterest上引导完整的外观(CTL)系统。这是一项旨在学习“样式兼容性”的主观任务,以便推荐完成服装的互补项目。特别是,我们希望展示与感兴趣的项目兼容的其他类别的建议。例如,这款鸡尾酒会搭配什么高跟鞋?我们将介绍超过100万个服装和400万个物品的服装数据集,其中一部分将向研究社区提供,并描述用于获取和刷新此数据集的管道。此外,我们将描述如何评估这项主观任务并比较多种培训方法的模型性能。最后,我们将分享从实验到工作原型的课程,以及如何减轻生产环境中的故障模式。我们的工作是用于基于兼容性时尚建议的工业规模解决方案的第一个例子之一。
Putting together an ideal outfit is a process that involves creativity and style intuition. This makes it a particularly difficult task to automate. Existing styling products generally involve human specialists and a highly curated set of fashion items. In this paper, we will describe how we bootstrapped the Complete The Look (CTL) system at Pinterest. This is a technology that aims to learn the subjective task of "style compatibility" in order to recommend complementary items that complete an outfit. In particular, we want to show recommendations from other categories that are compatible with an item of interest. For example, what are some heels that go well with this cocktail dress? We will introduce our outfit dataset of over 1 million outfits and 4 million objects, a subset of which we will make available to the research community, and describe the pipeline used to obtain and refresh this dataset. Furthermore, we will describe how we evaluate this subjective task and compare model performance across multiple training methods. Lastly, we will share our lessons going from experimentation to working prototype, and how to mitigate failure modes in the production environment. Our work represents one of the first examples of an industrial-scale solution for compatibility-based fashion recommendation.