Sovremennye problemy distantsionnogo zondirovaniya Zemli iz kosmosa, 2026, V. 23, No. 1, pp. 49-62
Conversion of a series of UAV camera images for joint processing with satellite images
A.G. Tashlinskii 1 , A.A. Belov 1 , G.L. Safina 2 1 Ulyanovsk State Technical University, Ulyanovsk, Russia
2 Moscow State University of Civil Engineering, Moscow, Russia
Accepted: 20.11.2025
DOI: 10.21046/2070-7401-2026-23-1-49-62
The technique for real-time combination of images obtained from a camera mounted on a UAV with simultaneous compensation for their projective distortions and translation into the EPSG:3395 geographic coordinate system is proposed. The technique allows obtaining oversampled spatially combined images and is aimed at their subsequent processing together with satellite images. It is based on the formation of a normalized image from the current image frame based on known roll, pitch and yaw angles of the UAV, alignment of several sequentially obtained normalized images into a single image using original stochastic gradient algorithms and its translation from the local frame coordinate system into global geographic coordinates. The technique has shown high efficiency with relatively low computational complexity and can be implemented both in ground-based automated image processing and on board a UAV. Experimental results are presented on real image sequences. The developed algorithms are implemented in C++ using the open source OpenCV library. The software implementation has also been ported to single-board computers Raspberry Pi 4B 8GB and Radxa Rock 5 model A 16GB. The processing speed on Raspberry is 10 frames per second, on Radxa — up to 16 frames per second.
Keywords: image processing, projective distortion, similarity model, compensation, deformation estimation, adaptation, stochastic estimation
Full textReferences:
- Agapov S. V., Fotogrammetriya skanernykh snimkov (Photogrammetry of scanner images), Moscow, Kartgeotsentr — Geodesizdat, 1996, 176 p. (in Russian).
- Borisov A. N., Myasnikov V. V., Sergeev V. V., Method of automatic coregistration of digital remote sensing images from different sources, Computer Optics, 2024, V. 48, No. 6, pp. 932–943 (in Russian), DOI: 10.18287/2412-6179-CO-1604.
- Morozov V. P., Kurs sferoidicheskoi geodezii (The course of spheroidal geodesy), Moscow: Nedra, 1979, 297 p. (in Russian).
- Platonov A. K., Opredelenie parametrov proektivnogo otobrazheniya v zritel’nom kanale robota: preprint (Projective mapping determination for robot vision: Preprint), Keldysh preprints, 2007, No. 39, 33 p. (in Russian).
- Suetin M. N., Dementiev V. E., Tashlinskii A. G., Magdeev R. G., Methodology for detecting and assessing the dynamics of defects in engineering structures by processing images from an unmanned aerial vehicle, Computer Optics, 2024, V. 48, No. 5, pp. 762–771 (in Russian), DOI: 10.18287/2412-6179-CO-1438.
- Tsypkin Ya. Z., Informatsionnaya teoriya identifikatsii (Information identity theory), Moscow: Nauka, Fizmatlit, 1995, 336 p. (in Russian).
- Cui Z., Zhou P., Wang X. et al., A novel geo-localization method for UAV and satellite images using cross-view consistent attention, Remote Sensing, 2023, V. 15, Iss. 19, Article 4667, DOI: 10.3390/rs15194667.
- Gonzalez R. C., Woods R. E., Digital image processing, 4th ed., New York: Pearson Publisher, 2017, 1192 p.
- Hartley R., Zisserman A., Multiple view geometry in computer vision. New York: Cambridge University Press, 2003, 655 p.
- Hill L. L., Georeferencing: The geographic associations of information, Cambridge, MA: MIT Press, 2006, 260 p., DOI: 10.7551/mitpress/3260.001.0001.
- Iliffe J., Datums and map projections. For remote sensing, GIS and surveying, 2nd ed., London: Whittles Publishing, 2008, 224 p.
- Kazanskiy N., Khabibullin R., Nikonorov A., Khonina S., A comprehensive review of remote sensing and artificial intelligence integration: Advances, applications, and challenges, Sensors, 2025, V. 25, Iss. 19, Article 5965, DOI: 10.3390/s25195965.
- Konecny G., Geoinformation: Remote sensing, photogrammetry and geographic information systems, 2nd ed., Boca Raton: CRC Press, 2014, 472 p.
- Li J., Xie Y., Li C. et al., UAV-assisted wide-area multi-camera space alignment based on spatiotemporal feature map, Remote Sensing, 2021, V. 13, Iss. 6, Article 1117, DOI: 10.3390/rs13061117.
- Magdeev R. G., Tashlinskii A. G., A comparative analysis of the efficiency of the stochastic gradient approach to the identification of objects in binary images, Pattern Recognition and Image Analysis, 2014, V. 24, Iss. 4, pp. 535–541, DOI: 10.1134/S1054661814040130.
- Qiu X., Yang D., Liao S. et al., Image moment extraction based aerial photo selection for UAV high-precision geolocation without GPS, Measurement, 2024, V. 226, Article 114141, DOI: 10.1016/j.measurement.2024.114141.
- Ren K., Ding L., Wan M. et al., Target localization based on cross-view matching between UAV and satellite, Chinese J. Aeronautics, 2022, V. 35, Iss. 9, pp. 333–341, DOI: 10.1016/j.cja.2022.04.002.
- Rizaldy A., Firdaus W., Direct georeferencing: A new standard in photogrammetry for high accuracy mapping, The Intern. Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, 2012, V. XXXIX-B1, pp. 5–9, DOI: 10.5194/isprsarchives-XXXIX-B1-5-2012.
- Snyder J. P., Map projections: A working manual, Washington: U. S. Government Printing Office, 1987, 383 p.
- Strang G., Borre K., Linear algebra, geodesy, and GPS, Wellesley, MA: Wellesley-Cambridge Press, 1997, 624 p.
- Štroner M., Urban R., Seidl J. et al., Photogrammetry using UAV-mounted GNSS RTK: Georeferencing strategies without GCPs, Remote Sensing, 2021, V. 13, Iss. 7, Article 1336, DOI: 10.3390/rs13071336.
- Tashlinskii A. G., Optimization of goal function pseudogradient in the problem of interframe geometrical deformations estimation, In: Pattern Recognition Techniques, Technology and Applications, London, United Kingdom: IntechOpen, 2008, pp. 249–280, DOI: 10.5772/6244.
- Tashlinskii A. G., Safina G. L., Voronov S. V., Pseudogradient optimization of objective function in estimation of geometric interframe image deformations, Pattern Recognition and Image Analysis, 2012, V. 22, Iss. 2, pp. 386–392, DOI: 10.1134/S1054661812020174.
- Tashlinskii A. G., Safina G. L., Ibragimov R. M., Synthesis of stochastic algorithm for image registration by the criterion of maximum mutual information, Computer Optics, 2024, V. 48, No. 1, pp. 109–117, DOI: 10.18287/2412-6179-CO-1332.
- Wang H., Shen Q., Deng Z. et al., Absolute pose estimation of UAV based on large-scale satellite image, Chinese J. Aeronautics, 2024, V. 37, Iss. 6, pp. 219–231, DOI: 10.1016/j.cja.2023.12.028.
- Wolf P. R., DeWitt B. A., Wilkinson B. E., Elements of photogrammetry with applications in GIS, 4th ed. McGraw Hill Professional, 2013, 640 p.
- Zhao H., Zhang B., Wu C. et al., Development of a Coordinate Transformation method for direct georeferencing in map projection frames, ISPRS J. Photogrammetry and Remote Sensing, 2013, V. 77, pp. 94–103, DOI: 10.1016/j.isprsjprs.2012.12.004.
- Zhuang J., Dai M., Chen X., Zheng E., A faster and more effective cross-view matching method of UAV and satellite images for UAV geolocalization, Remote Sensing, 2021, V. 13, Iss. 19, Article 3979, DOI: 10.3390/rs13193979.