论文标题
psdoodle:通过交互式草图搜索应用程序屏幕
PSDoodle: Searching for App Screens via Interactive Sketching
论文作者
论文摘要
基于关键字的移动屏幕搜索不会解释屏幕内容,也无法作为所有级别用户的通用工具运行。视觉搜索(例如,图像,草图)是结构化且易于采用的。当前的视觉搜索方法依靠完整的屏幕,因此缓慢而乏味。 PSDODLE采用深层神经网络来识别数字图界面上的部分屏幕元素图纸,并实时显示结果。 PSDoodle是第一个以交互式迭代方式利用部分草图并搜索屏幕的工具。 PSDODLE支持不同的绘图样式,并检索与用户草图查询相关的搜索结果。一个简短的视频演示可在线提供:https://youtu.be/3cvlhfm5py4
Keyword-based mobile screen search does not account for screen content and fails to operate as a universal tool for all levels of users. Visual searching (e.g., image, sketch) is structured and easy to adopt. Current visual search approaches count on a complete screen and are therefore slow and tedious. PSDoodle employs a deep neural network to recognize partial screen element drawings instantly on a digital drawing interface and shows results in real-time. PSDoodle is the first tool that utilizes partial sketches and searches for screens in an interactive iterative way. PSDoodle supports different drawing styles and retrieves search results that are relevant to the user's sketch query. A short video demonstration is available online at: https://youtu.be/3cVLHFm5pY4