[IPOL announce] new article: Implementing Handheld Burst Super-Resolution
announcements about the IPOL journal
announce at list.ipol.im
Sun Jul 16 14:13:56 CEST 2023
A new article is available in IPOL: https://www.ipol.im/pub/art/2023/460/
Jamy Lafenetre, Gabriele Facciolo, and Thomas Eboli,
Implementing Handheld Burst Super-Resolution,
Image Processing On Line, 13 (2023), pp. 227–257.
https://doi.org/10.5201/ipol.2023.460
Abstract
Nowadays, smartphone cameras capture bursts of raw photographs whenever
the trigger is pressed. These photos are then fused to produce a single
picture with higher quality. This paper details the implementation of
the method 'Handheld Multi-Frame Super-Resolution algorithm' by Wronski
et al. (used in the Google Pixel 3 camera), which performs
simultaneously multi-image super-resolution demosaicking and denoising
from a burst of images. Hand tremors during exposure cause subpixel
motions, which combined with the Bayer color filter array of the sensor
results in a collection of aliased and shifted raw photographs of the
same scene. The algorithm efficiently aligns and fuses these signals
into a single high-resolution one by leveraging the aliasing to
reconstruct the high-frequencies of the signal up to the Nyquist rate of
the sensor. This approach yields digitally zoomed images up to a factor
of 2, which is the limit naturally set by the sensor pixel integration.
We present an in-depth description of this algorithm, along with
numerous implementation details we have found to reproduce the results
of the original paper, whose code is not publicly available.
More information about the announce
mailing list