[IPOL announce] new article: Implementing Handheld Burst Super-Resolution

announcements about the IPOL journal announce at list.ipol.im
Sun Jul 16 14:13:56 CEST 2023


A new article is available in IPOL: https://www.ipol.im/pub/art/2023/460/

Jamy Lafenetre, Gabriele Facciolo, and Thomas Eboli,
Implementing Handheld Burst Super-Resolution,
Image Processing On Line, 13 (2023), pp. 227–257.
https://doi.org/10.5201/ipol.2023.460

Abstract
Nowadays, smartphone cameras capture bursts of raw photographs whenever 
the trigger is pressed. These photos are then fused to produce a single 
picture with higher quality. This paper details the implementation of 
the method 'Handheld Multi-Frame Super-Resolution algorithm' by Wronski 
et al. (used in the Google Pixel 3 camera), which performs 
simultaneously multi-image super-resolution demosaicking and denoising 
from a burst of images. Hand tremors during exposure cause subpixel 
motions, which combined with the Bayer color filter array of the sensor 
results in a collection of aliased and shifted raw photographs of the 
same scene. The algorithm efficiently aligns and fuses these signals 
into a single high-resolution one by leveraging the aliasing to 
reconstruct the high-frequencies of the signal up to the Nyquist rate of 
the sensor. This approach yields digitally zoomed images up to a factor 
of 2, which is the limit naturally set by the sensor pixel integration. 
We present an in-depth description of this algorithm, along with 
numerous implementation details we have found to reproduce the results 
of the original paper, whose code is not publicly available.






More information about the announce mailing list