Academic Journal
Feature Guided Masked Autoencoder for Self-Supervised Learning in Remote Sensing
| Title: | Feature Guided Masked Autoencoder for Self-Supervised Learning in Remote Sensing |
|---|---|
| Authors: | Yi Wang, Hugo Hernandez Hernandez, Conrad M Albrecht, Xiao Xiang Zhu |
| Source: | IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, Vol 18, Pp 321-336 (2025) |
| Publisher Information: | IEEE, 2025. |
| Publication Year: | 2025 |
| Collection: | LCC:Ocean engineering LCC:Geophysics. Cosmic physics |
| Subject Terms: | Earth observation, geospatial foundation models, masked autoencoder (MAE), remote sensing (RS), self-supervised learning, Ocean engineering, TC1501-1800, Geophysics. Cosmic physics, QC801-809 |
| More Details: | Self-supervised learning guided by masked image modeling, such as masked autoencoder (MAE), has attracted wide attention for pretraining vision transformers in remote sensing. However, MAE tends to excessively focus on pixel details, limiting the model's capacity for semantic understanding, particularly for noisy synthetic aperture radar (SAR) images. In this article, we explore spectral and spatial remote sensing image features as improved MAE-reconstruction targets. We first conduct a study on reconstructing various image features, all performing comparably well or better than raw pixels. Based on such observations, we propose feature guided MAE (FG-MAE): reconstructing a combination of histograms of oriented gradients (HOG) and normalized difference indices (NDI) for multispectral images, and reconstructing HOG for SAR images. Experimental results on three downstream tasks illustrate the effectiveness of FG-MAE with a particular boost for SAR imagery (e.g., up to 5% better than MAE on EuroSAT-SAR). Furthermore, we demonstrate the well-inherited scalability of FG-MAE and release a first series of pretrained vision transformers for medium-resolution SAR and multispectral images. |
| Document Type: | article |
| File Description: | electronic resource |
| Language: | English |
| ISSN: | 1939-1404 2151-1535 |
| Relation: | https://ieeexplore.ieee.org/document/10766851/; https://doaj.org/toc/1939-1404; https://doaj.org/toc/2151-1535 |
| DOI: | 10.1109/JSTARS.2024.3493237 |
| Access URL: | https://doaj.org/article/ad141a7704a940acb0a37173d5a8ed62 |
| Accession Number: | edsdoj.141a7704a940acb0a37173d5a8ed62 |
| Database: | Directory of Open Access Journals |
| ISSN: | 19391404 21511535 |
|---|---|
| DOI: | 10.1109/JSTARS.2024.3493237 |
| Published in: | IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing |
| Language: | English |