论文标题
通过上下文化混合模型对排名和校准的联合优化
Joint Optimization of Ranking and Calibration with Contextualized Hybrid Model
论文作者
论文摘要
尽管发展了排名优化技术,但点击率预测的主要方法仍然是主要的方法。它可以归因于点丢失的校准能力,因为可以将预测视为点击概率。实际上,通常以排名能力评估CTR预测模型。为了优化排名能力,可以采用排名损失(例如,成对或列表损失),因为它们通常比刻薄的损失更好。先前的研究已直接结合了两种损失,以从两者损失中获得收益,并观察到改善的性能。但是,以前的研究将输出logit的含义打破了点击率,这可能会导致次优的解决方案。为了解决这个问题,我们提出了一种可以共同优化排名和校准能力的方法(简称JRC)。 JRC通过将样本的logit值与不同的标签进行对比,并限制了预测的概率是logit减法的函数,从而提高了排名能力。我们进一步表明,JRC巩固了对逻辑的解释,其中logits在其中建模关节分布。通过这样的解释,我们证明JRC近似优化了上下文化的混合歧视生成目标。公共和工业数据集以及在线A/B测试的实验表明,我们的方法提高了排名和校准能力。自2022年5月以来,JRC已被部署在阿里巴巴的展示广告平台上,并获得了显着改进的绩效。
Despite the development of ranking optimization techniques, pointwise loss remains the dominating approach for click-through rate prediction. It can be attributed to the calibration ability of the pointwise loss since the prediction can be viewed as the click probability. In practice, a CTR prediction model is also commonly assessed with the ranking ability. To optimize the ranking ability, ranking loss (e.g., pairwise or listwise loss) can be adopted as they usually achieve better rankings than pointwise loss. Previous studies have experimented with a direct combination of the two losses to obtain the benefit from both losses and observed an improved performance. However, previous studies break the meaning of output logit as the click-through rate, which may lead to sub-optimal solutions. To address this issue, we propose an approach that can Jointly optimize the Ranking and Calibration abilities (JRC for short). JRC improves the ranking ability by contrasting the logit value for the sample with different labels and constrains the predicted probability to be a function of the logit subtraction. We further show that JRC consolidates the interpretation of logits, where the logits model the joint distribution. With such an interpretation, we prove that JRC approximately optimizes the contextualized hybrid discriminative-generative objective. Experiments on public and industrial datasets and online A/B testing show that our approach improves both ranking and calibration abilities. Since May 2022, JRC has been deployed on the display advertising platform of Alibaba and has obtained significant performance improvements.