SIDDIS
Satellite Imagery Downscaling via Deep Image Super-resolution
Synopsis
Present trends in climate and land use change clearly point to an ever increasing flood risk that can lead to severe riverine and coastal flooding across the globe. Leveraging remote sensing imagery is key to estimating and predicting future flood inundation extents. Currently, though, long-term records of flood inundation observations from publicly-accessible imaging products are at a spatio-temporal resolution, whose coarsity significantly curtails their potential for high-accuracy predictions.
The main objective of this project was to develop a computational pipeline that downscales (upsamples & interpolates) low-resolution satellite imagery in the guise of Water Fraction Maps (WFMs) to high-fidelity, high-resolution Flood Inundation Maps (FIMs) by leveraging recent computer vision and signal processing advances related to deep single-image super-resolution models. The project was executed in two phases: (i) summer of 2022 and (i) spring and summer of 2022.
In the first phase of the project, we used synthetic low-resolution WFMs paired with synthetic high-resolution FIMs that were provided to us by the Iowa Flood Center. In its second phase, the project acquired low-resolution WFMs from NASA MODIS and Landsat and paired them to to high-resolution PlanetScope FIMs obtained from small commercial satellites. In the project’s second phase we incorporated Vertical and Horizontal Distance (from bodies of water) Maps derived from corresponding Digital Elevation Maps. We then used a variety of existing downscaling approaches and compared them to deep neural architectures based on Residual Dense Networks and Residual Channel Attention Networks. These networks were modified appropriately to merge our topographic features with their internal downscaled representations.
Via thorough experimental comparisons, we were able to demonstrate the superiority of these deep neural networks and the usefulness of topographic features in enhancing our dowscaling results. Currently, we are in the process of compiling our experimental outcomes and observations and are preparing a publication of our findings.
People
This was a joint, interdisciplinary effort of our ML Research Group and the Hydrology & Remote Sensing (HydroRes) group of Dr. Nikolopoulos.
- Akshay Aravamudan (Computer Engineering)
- Zimeena Rasheed (Mechanical & Civil Engineering)
- Kira E. Scarpignato (Biomedical Engineering)
- Xi Zhang (Electrical Engineering)
- Dr. Efthymios Nikolopoulos (Mechanical & Civil Engineering)
- Dr. Georgios C. Anagnostopoulos (Electrical & Computer Engineering)
During the course of the project, Rasheed and Dr. Nikolopoulos were affiliated with FIT’s Department of Mechanical & Civil Engineering. Currently, they are with the Department of Civil & Environmental Engineering at Rutgers University–New Brunswick. Furthermore, the team included Scarpignato, an undergraduate Biomedical Engineering student at Florida Tech, who assisted with our efforts.
Support
The efforts of our interdisciplinary team were supported through FIT’s College of Engineering & Sciences Institutional Research Incentive (IRI) Program through the following (internal) grants:
Anagnostopoulos (PI) & Nikolopoulos (Co-PI), $6,000, College of Engineering & Sciences, FIT, “Satellite Imagery Downscaling via Deep Image Super-resolution (SIDDIS) - Pilot Effort,” 05/02/2021 – 06/12/2021.
Anagnostopoulos (PI) & Nikolopoulos (Co-PI), $11,675. College of Engineering & Sciences, FIT, “Satellite Imagery Downscaling via Deep Image Super-resolution (SIDDIS) – Real-World Data,” 01/09/2022 – 06/25/2022.
Both phases of the project partially supported doctoral students Aravamudan, Rasheed and Zhang. Additionally, its second phase partially supported Scarpignato.
We also relied on high-performance computing support from Cheyenne (doi:10.5065/D6RX99HX) provided by NCAR’s Computational and Information Systems Laboratory (CISL), sponsored by the National Science Foundation.
Outcomes
This project gave us the opportunity to collaborate with the Iowa Flood Center (IFC) and its director and member of the National Academy of Engineering, Prof. Witek Krajewski. It also presented itself as an opportunity to involve and engage Scarpignato, an undergraduate Biomedical Engineering student, into a valuable research experience.
In December 2021, we orally presented our initial downscaling results at the 2021 Fall Meeting of the American Geophysical Union (AGU21).
Finally, as mentioned earlier, we are in the process of preparing a manuscript for publication, which will outline our approach and results.