ISSN 2070-7401 (Print), ISSN 2411-0280 (Online)
Sovremennye problemy distantsionnogo zondirovaniya Zemli iz kosmosa
CURRENT PROBLEMS IN REMOTE SENSING OF THE EARTH FROM SPACE

  

Sovremennye problemy distantsionnogo zondirovaniya Zemli iz kosmosa, 2020, Vol. 17, No. 2, pp. 75-82

Fusion of subpixelly-shifted images to increase spatial resolution of Earth observation systems

N.A. Egoshkin 1 , V.V. Eremeev 1 , A.E. Moskvitin 1 
1 V.F. Utkin Ryazan State Radio Engineering University, Ryazan, Russia
Accepted: 21.02.2020
DOI: 10.21046/2070-7401-2020-17-2-75-82
The general model of fusion of the data obtained from several subpixelly-shifted lines of photodetectors installed in the focal plane of the imager is presented. The purpose is to increase the spatial resolution of obtained images of Earth surface. Due to finite size of the photodetectors, the result of the fusion process is defocused. An algebraic approach for mitigation of this effect by image deconvolution is presented. We consider the case of a uniform sampling obtained during optimal imaging process when fusion process actually comes down to a pixel rearrangement and applying of known filtering techniques. We also investigate the specifics of irregular sampling interpolation which is necessary due to geometrical distortions occurring during the imaging process (with scanning imagers). To solve this problem, a polynomial approximation of computationally complex filter banks is proposed. This simplifies the imaging process by significantly increasing the sampling rate. Also an important case is considered when spatial resolution is increased below theoretical maximum and residual abundance of data is used for signal-to-noise boost, which is especially important for processing of images in thermal infrared spectral range due to typically low signal and high noise present in such data. Strictly optimal image interpolation of non-uniform samples in frequency domain for images with a finite spectrum is presented. The interpolation technique is based on the method of frequency band suppression. A criteria of image noisiness and spatial resolution is introduced in the fusion process, which allows reducing computational cost of filtering in exchange for slight quality decrease of the results. The results of the processing using proposed techniques are presented on the real and modeled datasets.
Keywords: image integration, detail of observation, resolution increase, sharpening, signal to noise ratio
Full text

References:

  1. Andreev R. V., Akimov N. P., Badaev K. V., Gektin Yu. M., Zaitsev A. A., Ryzhakov A. V., Smelyanskii M. B., Sulimanov N. A., Frolov A. G., Mnogozonal’noe skaniruyushchee ustroistvo dlya geostatsionarnogo meteosputnika “Elektro-L” (Multispectral scanning device for geostationary weather satellite “Electro-L”), Raketno-kosmicheskoe priborostroenie i informatsionnye sistemy, 2015, Vol. 2, Issue 3, pp. 33–44.
  2. Egoshkin N. A., Eremeev V. V., Moskvitin A. E., Kompleksirovanie izobrazhenii ot lineek fotopriemnikov v usloviyakh geometricheskikh iskazhenii (Integration of images from the lines of photodetectors in the conditions of geometric distortion), Tsifrovaya obrabotka signalov, 2012, No. 23, pp. 40–44.
  3. Egoshkin N. A., Eremeev V. V., Moskvitin A. E., Kompleksirovanie dannykh distantsionnogo zondirovaniya Zemli ot razlichnykh sʺemochnykh sistem (Integration of Earth Remote Sensing Data from Various Surveying Systems), Sovremennye tekhnologii obrabotki dannykh distantsionnogo zondirovaniya Zemli, V. V. Eremeev (ed.), Moscow: Fizmatlit, 2015, p. 460.
  4. Khurgin Ya. I., Yakovlev V. P., Finitnye funktsii v fizike i tekhnike (Finite functions in science and technics), Moscow: Librokom Publ., 2010, 416 p.
  5. Cheung K. F., A multidimensional extension of Papoulis’ generalized sampling expansion with application in minimum density sampling, Advanced Topics in Shannon Sampling and Interpolation Theory, R. J. Marks II (ed.), 1993, pp. 86–119.
  6. Egoshkin N. A., Eremeev V. V., Increasing satellite imagery resolution by fusion of data from multiple spatially shifted CCDs: a spectral-based approach, Remote Sensing Letters, 2015, Vol. 6, No. 2, pp. 116–124.
  7. Papoulis A., Generalized Sampling Expansion, IEEE Trans. Circuits and Systems, 1977, Vol. 24, pp. 652–654.