论文标题

ganwriting:内容条件的生成样式手写单词图像

GANwriting: Content-Conditioned Generation of Styled Handwritten Word Images

论文作者

Kang, Lei, Riba, Pau, Wang, Yaxing, Rusiñol, Marçal, Fornés, Alicia, Villegas, Mauricio

论文摘要

尽管当前的图像生成方法达到了令人印象深刻的质量水平,但它们仍然无法产生合理的手写单词图像。相反,当手工写作时,在不同的作者之间也会观察到很大的可变性,即使分析同一个人乱码的单词,非自愿变化也是显着的。在这项工作中,我们迈出了一步,即生产现实而多样的人为渲染的手写单词。我们提出了一种新颖的方法,该方法能够通过具有书法样式特征和文本内容来调节生成过程,从而产生可信的手写单词图像。我们的发电机以三个补充学习目标为指导:制作逼真的图像,模仿某种手写样式并传达特定的文本内容。我们的模型不受任何预定义词汇的影响,能够呈现任何输入单词。给定样本作者,它还可以在几次设置中模仿其书法功能。我们在先前的艺术中显着进步,并以定性,定量和人类的评估证明我们合成产生的图像的现实方面。

Although current image generation methods have reached impressive quality levels, they are still unable to produce plausible yet diverse images of handwritten words. On the contrary, when writing by hand, a great variability is observed across different writers, and even when analyzing words scribbled by the same individual, involuntary variations are conspicuous. In this work, we take a step closer to producing realistic and varied artificially rendered handwritten words. We propose a novel method that is able to produce credible handwritten word images by conditioning the generative process with both calligraphic style features and textual content. Our generator is guided by three complementary learning objectives: to produce realistic images, to imitate a certain handwriting style and to convey a specific textual content. Our model is unconstrained to any predefined vocabulary, being able to render whatever input word. Given a sample writer, it is also able to mimic its calligraphic features in a few-shot setup. We significantly advance over prior art and demonstrate with qualitative, quantitative and human-based evaluations the realistic aspect of our synthetically produced images.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源