Abstract
Light field (LF) imaging captures both angular and spatial light distributions, enabling advanced photographic techniques. However, micro-lens array (MLA)- based cameras face a spatial-angular resolution tradeoff due to a single shared sensor. We propose a novel light field framework for resolution enhancement, employing a modular approach. The first module generates a high-resolution, all-in-focus image. The second module, a texture transformer network, enhances the resolution of each light field perspective independently using the output of the first module as a reference image. The final module leverages light field regularity to jointly improve resolution across all LF image perspectives. Our approach demonstrates superior performance to existing methods in both qualitative and quantitative evaluations.
Abstract (translated)
光场（LF）成像同时捕捉到角速度和空间光分布，使得高级摄影技术成为可能。然而，基于微透镜阵列（MLA）的相机由于共享传感器，面临着空间-角速度分辨率权衡。我们提出了一个用于分辨率增强的新型光场框架，采用模块化方法。第一个模块生成一个高分辨率、全焦距的图像。第二个模块，一个纹理转换器网络，通过第一个模块的输出作为参考图像，独立地增强每个光场视角的分辨率。最后一个模块利用光场 regularity 共同提高所有 LF 图像视角的分辨率。我们的方法在质性和量化评价中表现出优越的性能。
URL
https://arxiv.org/abs/2405.02787
