论文标题
图像仪:通过梁拆分器摄像机钻机现实的超级分辨率数据集
ImagePairs: Realistic Super Resolution Dataset via Beam Splitter Camera Rig
论文作者
论文摘要
超级分辨率是从同一场景的单个或多个低分辨率图像中恢复高分辨率图像的问题。这是一个不适的问题,因为场景的高频视觉细节在低分辨率图像中完全丢失。为了克服这一点,已经提出了许多机器学习方法,旨在培训模型以恢复新场景中丢失的细节。这种方法包括最近成功地利用深度学习技术来解决超级分辨率问题。如事实证明,数据本身在机器学习过程中起着重要的作用,尤其是饥饿的深度学习方法。因此,为了解决问题,收集数据及其形成的过程与使用的机器学习技术同样重要。本文中,我们提出了一种用于收集真实图像数据集的新数据采集技术,该技术可以用作超级分辨率,消除噪声和质量增强技术的输入。我们使用横梁切开器通过低分辨率摄像头和高分辨率摄像头捕获相同的场景。由于我们还发布了原始图像,因此该大规模数据集可用于其他任务,例如ISP生成。与当前用于这些任务的小规模数据集不同,我们提出的数据集包括11,421对不同场景的低分辨率高分辨率图像。据我们所知,这是超级分辨率,ISP和图像质量增强的最完整数据集。基准测试结果表明,如何成功使用新数据集来显着提高现实世界图像超级分辨率的质量。
Super Resolution is the problem of recovering a high-resolution image from a single or multiple low-resolution images of the same scene. It is an ill-posed problem since high frequency visual details of the scene are completely lost in low-resolution images. To overcome this, many machine learning approaches have been proposed aiming at training a model to recover the lost details in the new scenes. Such approaches include the recent successful effort in utilizing deep learning techniques to solve super resolution problem. As proven, data itself plays a significant role in the machine learning process especially deep learning approaches which are data hungry. Therefore, to solve the problem, the process of gathering data and its formation could be equally as vital as the machine learning technique used. Herein, we are proposing a new data acquisition technique for gathering real image data set which could be used as an input for super resolution, noise cancellation and quality enhancement techniques. We use a beam-splitter to capture the same scene by a low resolution camera and a high resolution camera. Since we also release the raw images, this large-scale dataset could be used for other tasks such as ISP generation. Unlike current small-scale dataset used for these tasks, our proposed dataset includes 11,421 pairs of low-resolution high-resolution images of diverse scenes. To our knowledge this is the most complete dataset for super resolution, ISP and image quality enhancement. The benchmarking result shows how the new dataset can be successfully used to significantly improve the quality of real-world image super resolution.