ISSN 2070-7401 (Print), ISSN 2411-0280 (Online)
Sovremennye problemy distantsionnogo zondirovaniya Zemli iz kosmosa
CURRENT PROBLEMS IN REMOTE SENSING OF THE EARTH FROM SPACE

  

Sovremennye problemy distantsionnogo zondirovaniya Zemli iz kosmosa, 2016, Vol. 13, No. 3, pp. 9-27

Unified satellite data archive management platform for remote monitoring systems development

A.A. Proshin 1 , E.A. Loupian 1 , I.V. Balashov 1 , A.V. Kashnitskiy 1 , M.A. Bourtsev 1 
1 Space Research Institute RAS, Moscow, Russia
Accepted: 30.05.2016
DOI: 10.21046/2070-7401-2016-13-3-9-27
Fast evolution of Earth remote sensing satellite systems and dramatic growth of incoming data volumes has significantly enlarged the area of their application. At the same time, it has made necessary the development of new satellite data management methods and technologies. One of the most important goals was the creation of a revolutionary platform for very large distributed heterogeneous satellite data archives management with remote data processing and analysis support, which is described in this paper. The paper provides an analysis of modern satellite data access systems evolution trends, states the basic requirements for the system developed and highlights its architecture. After that the main features of system components implementation are described, especially the non-common ones. The main focus is made on the database structures both for satellite data and for the various supplemental information. A brief review of the platform application experience for operational satellite monitoring systems is also given. The conclusion shows the summary comparison of the new platform versus the traditional ones and highlights its essential differences and advantages.
Keywords: satellite data archives, satellite data archive systems, remote sensing, satellite data, information system, Earth remote sensing system, very large data archives
Full text

References:

  1. Antonov A.V., Bourtsev M.A., Efremov V.Yu., Kalashnikov A.V., Kramareva L.S., Krasheninnikova Yu.S., Loupian E.A., Matveev A.M., Proshin A.A., Flitman E.V., Postroenie ob"edinennogo kataloga raspredelennykh arkhivov sputnikovykh dannykh razlichnykh tsentrov (Design of the Union Catalogue of Distributed Satellite Data Archives of Various Centers), Sovremennye problemy distantsionnogo zondirovaniya Zemli iz kosmosa, 2010, Vol. 7, No. 2, pp. 84–89.
  2. Balashov I.V., Bourtsev M.A., Efremov V.Yu., Loupian E.A., Proshin A.A., Tolpin V.A., Postroenie arkhivov rezul'tatov obrabotki sputnikovykh dannykh dlya sistem dinamicheskogo formirovaniya proizvodnykh informatsionnykh produktov (Development of satellite data processing products archives for dynamic derived information products production systems), Sovremennye problemy distantsionnogo zondirovaniya Zemli iz kosmosa, 2008, Vol. 5, No. 1, pp. 26–31.
  3. Balashov I.V., Efremov V.Yu., Mazurov -ml. A.A., Mamaev A.S., Matveev A.M., Proshin A.A., Osobennosti organizatsii kontrolya i upravleniya raspredelennykh sistem distantsionnogo monitoringa (Features of Remote Monitoring Distributed Systems Control and Monitoring), Sovremennye problemy distantsionnogo zondirovaniya Zemli iz kosmosa, 2011, Vol. 8, No. 3, pp. 161–166.
  4. Bartalev S.A., Ershov D.V., Korovin G.N., Kotel'nikov R.V., Loupian E.A., Shchetinskii V.E., Osnovnye vozmozhnosti i struktura informatsionnoi sistemy distantsionnogo monitoringa lesnykh pozharov Federal'nogo agentstva lesnogo khozyaistva (ISDM Rosleskhoz) ( The Main Functionalities and Structure of the Forest Fire Satellite Monitoring Information System of Russian Federal Forestry Agency (ISDM-Rosleshoz)), Sovremennye problemy distantsionnogo zondirovaniya Zemli iz kosmosa, 2010, Vol. 7, No. 2, pp. 97–105.
  5. Bartalev S.A., Ershov D.V., Korovin G.N., Kotel'nikov R.V., Loupian E.A., Shchetinskii V.E., Informatsionnaya sistema distantsionnogo monitoringa lesnykh pozharov Federal'nogo agentstva lesnogo khozyaistva RF (sostoyanie i perspektivy razvitiya) (Forest fires remote monitoring information system of the Russian Federal Agency for Forestry (status and development prospects)), Sovremennye problemy distantsionnogo zondirovaniya Zemli iz kosmosa, 2008, Issue 5, Vol. 2, pp. 419–429.
  6. Bartalev S.A., Ershov D.V., Loupian E.A., Tolpin V.A., Vozmozhnosti ispol'zovaniya sputnikovogo servisa VEGA dlya resheniya razlichnykh zadach monitoringa nazemnykh ekosistem (Possibilities of Satellite Service VEGA Using for Different Tasks of Land Ecosystems Monitoring ), Sovremennye problemy distantsionnogo zondirovaniya Zemli iz kosmosa, 2012, Vol. 9, No. 1, pp. 49–56.
  7. Bourtsev M.A., Antonov V.N., Efremov V.Yu., Kashnitskiy A.V., Kramareva L.S., Loupian E.A., Mazurov A.A., Matveev A.M., Milekhin O.E., Proshin A.A., Solov'ev V.I., Sistema raboty s raspredelennymi arkhivami rezul'tatov obrabotki sputnikovykh dannykh tsentrov priema NITs "Planeta" (Distributed Satellite Data Processing Products Archives Operation System in the SRC “Planeta” Centres), Sovremennye problemy distantsionnogo zondirovaniya Zemli iz kosmosa, 2012, Vol. 9, No. 5, pp. 55–76.
  8. Efremov V.Yu., Girina O.A., Kramareva L.S., Loupian E.A., Manevich A.G., Melnikov D.V., Matveev A.M., Proshin A.A., Sorokin A.A., Flitman E.V., Sozdanie informatsionnogo servisa "Distantsionnyi monitoring aktivnosti vulkanov Kamchatki i Kuril" (Creating an Information Service “Remote Monitoring of Active Volcanoes of Kamchatka and the Kuril Islands”), Sovremennye problemy distantsionnogo zondirovaniya Zemli iz kosmosa, 2012, Vol. 9, No. 5, pp. 155–170.
  9. Efremov V.Yu., Loupian E.A., Mazurov A.A., Proshin A.A., Flitman E.V., Tekhnologiya postroeniya avtomatizirovannykh sistem khraneniya sputnikovykh dannykh (A technology for construction of automated systems for satellite data storage), Sovremennye problemy distantsionnogo zondirovaniya Zemli iz kosmosa, 2004, No. 1, pp. 437–443.
  10. Kashnitskiy A.V., Balashov I.V., Loupian E.A., Tolpin V.A., Uvarov I.A., Sozdanie instrumentov dlya udalennoi obrabotki sputnikovykh dannykh v sovremennykh informatsionnykh sistemakh (Development of software tools for satellite data remote processing in contemporary information systems), Sovremennye problemy distantsionnogo zondirovaniya Zemli iz kosmosa, 2015, Vol. 12, No. 1, pp. 156–170.
  11. Loupian E.A., Balashov I.V., Burtsev M.A., Efremov, Krasheninnikova Yu.S., Mazurov A.A., Matveev A.M. Nazirov R.R., Proshin A.A., Tolpin V.A., Uvarov I.A., Flitman E.V., Sozdanie tekhnologii postroeniya informatsionnykh sistem distantsionnogo monitoringa (Development of technologies for creation of remote monitoring information systems), Sovremennye problemy distantsionnogo zondirovaniya Zemli iz kosmosa, 2015, Vol. 12, No. 5. pp. 53–75.
  12. Loupian E.A., Bartalev S.A., Ershov D.V, Kotel'nikov R.V., Balashov I.V., Burtsev M.A., Egorov V.A., Efremov V.Yu., Zharko V.O., Kovganko K.A , Kolbudaev P.A., Krasheninnikova Yu.S., Proshin A.A., Mazurov A.A., Uvarov I.A., Stytsenko F.V., Sychugov I.G., Flitman E.V., Khvostikov S.A., Shulyak P.P., Organizatsiya raboty so sputnikovymi dannymi v informatsionnoi sisteme distantsionnogo monitoringa lesnykh pozharov Federal'nogo agentstva lesnogo khozyaistva (ISDM-Rosleskhoz) (Satellite data processing management in framework of Forest Fires Remote Monitoring Information System (ISDM-Rosleskhoz) of the Federal Agency for Forestry), Sovremennye problemy distantsionnogo zondirovaniya Zemli iz kosmosa, 2015, Vol. 12, No. 5, pp. 222–250.
  13. Loupian E.A., Bartalev S.A., Tolpin V.A., Zharko V.O., Krasheninnikova Yu.S., Oksyukevich A.Yu., Ispol'zovanie sputnikovogo servisa VEGA v regional'nykh sistemakh distantsionnogo monitoringa (VEGA satellite service applications in regional remote monitoring systems), Sovremennye problemy distantsionnogo zondirovaniya Zemli iz kosmosa, 2014, Vol. 11, No. 3, pp. 215–232.
  14. Loupian E.A., Burtsev M.A., Balashov I.V., Bartalev S.A., Efremov V.Ju., Kashnitskiy A.V., Mazurov A.A., Matveev A.M., Sudneva O.A., Sychugov I.G., Tolpin V.A., Uvarov I.A., Tsentr kollektivnogo pol'zovaniya sistemami arkhivatsii, obrabotki i analiza sputnikovykh dannykh IKI RAN dlya resheniya zadach izucheniya i monitoringa okruzhayushchei sredy (IKI center for collective use of satellite data archiving,processing and analysis systems aimed at solving the problems of environmental study and monitoring), Sovremennye problemy distantsionnogo zondirovaniya Zemli iz kosmosa, 2015, Vol. 12, No. 5, pp. 263–284.
  15. Loupian E.A., Matveev A.A., Uvarov I.A., Bocharova T.Yu., Lavrova O.Yu., Mityagina M.I., Sputnikovyi servis See the Sea – instrument dlya izucheniya razlichnykh yavlenii na poverkhnosti okeana (The Satellite Service See the Sea - a tool for the Study of Oceanic Phenomena and Processes), Sovremennye problemy distantsionnogo zondirovaniya Zemli iz kosmosa, 2012, Vol. 9, No. 2, pp. 251–262.
  16. Loupian E.A., Milekhin O.E., Antonov V.N., Kramareva L.S., Burtsev M.A., Balashov I.V., Tolpin V.A., Solov'ev V.I., Sistema raboty s ob"edinennymi informatsionnymi resursami, poluchaemymi na osnove sputnikovykh dannykh v tsentrakh NITs “PLANETA” (System of operation of joint information resources based on satellite data in the Planeta Research Centers for Space Hydrometeorology), Meteorologiya i gidrologiya, 2014, No. 12, pp. 89–97.
  17. Loupian E.A., Savorskii V.P., Bazovye produkty obrabotki dannykh distantsionnogo zondirovaniya Zemli (Basic products of Earth Remote Sensing Data Processing), Sovremennye problemy distantsionnogo zondirovaniya Zemli iz kosmosa, 2012, Vol. 9, No. 2, pp. 87–97.
  18. Loupian E.A., Savorskii V.P., Shokin Yu.I., Aleksanin A.I., Nazirov R.R., Nedoluzhko I.V., Panova O.Yu., Sovremennye podkhody i tekhnologii organizatsii raboty s dannymi distantsionnogo zondirovaniya Zemli dlya resheniya nauchnykh zadach (Up-to-date Approaches and Technology Arrangement of Earth Observation Data Applications Aimed to Solve Scientific Tasks), Sovremennye problemy distantsionnogo zondirovaniya Zemli iz kosmosa, 2012, Vol. 9, No. 5, pp. 21–44.
  19. Mamaev A.S., Proshin A.A., Flitman E.V., Sozdanie sistemy dokumentirovaniya i kontrolya raspredelennykh informatsionnykh system (Development of documentation and monitoring system for the distributed information systems), Sovremennye problemy distantsionnogo zondirovaniya Zemli iz kosmosa, 2008, Issue 5, Vol. 2, pp. 557–560.
  20. Nosenko Yu.I., Loshkarev P.A., Edinaya territorial'no-raspredelennaya informatsionnaya sistema DZZ – problemy, resheniya, perspektivy (chast' 1) (Joint spatially distributed Earth remote sensing information system - problems, solutions, perspectives (part 1)), Geomatika, 2010, No. 3, pp. 35–43.
  21. Tolpin V.A., Balashov I.V., Efremov V.Yu., Loupian E.A., Proshin A.A., Uvarov I.A., Flitman E.V., Sozdanie interfeisov dlya raboty s dannymi sovremennykh sistem distantsionnogo monitoringa (sistema GEOSMIS) (The GEOSMIS System: Developing Interfaces to Operate Data in Modern Remote Monitoring Systems), Sovremennye problemy distantsionnogo zondirovaniya Zemli iz kosmosa, 2011, Vol. 8, No. 3, pp. 93–108.
  22. Tolpin V.A., Balashov I.V., Loupian E.A., Savin I.Yu., Sputnikovyi servis "Vega" ("VEGA" satellite service), Earth from Space, 2011, Issue 9, pp.32–37.
  23. Acker J.G., Leptoukh G., Online analysis enhances use of NASA earth science data, Eos, Transactions American Geophysical Union, 2007, Vol. 88, No. 2, pp. 14–17.
  24. Budget Activity: National Environmental Satellite, Data and Information Service, 2012, available at: http://www.corporateservices.noaa.gov/nbo/fy13_presidents_budget/7_NESDIS.pdf
  25. Gorelick N., Google Earth Engine, EGU General Assembly Conference, 2013, Abstracts, Vol. 15, pp. 11997.
  26. Mityagina M.I., Lavrova O.Yu., Uvarov I.A., "See the Sea": Multi-user information system for investigating processes and phenomena in coastal zones via satellite remotely sensed data, particularly hyperspectral data, Proc. SPIE, 2014, Vol. 9240, id. 92401C, 8 p. DOI:10.1117/12.2067300.
  27. Moore R.T., Hansen M.C., Google Earth Engine: a new cloud-computing platform for global-scale earth observation data and analysis, AGU Fall Meeting, Abstracts, 2011, Vol. 1, pp. 2.
  28. Ramapriyan H.K., Behnke J., Sofinowski E., Lowe D., Esfandiari M.A., Evolution of the earth observing system (EOS) data and information system (EOSDIS), Standard-Based Data and Information Systems for Earth Observation, 2010, pp. 63–92.
  29. Ramapriyan H.K., Development, Operation and Evolution of EOSDIS – NASA’s major capability for managing Earth science data, CENDI/NFAIS Workshop on Repositories in Science & Technology: Preserving Access to the Record of Science, November 30, 2011.