TY - JOUR
T1 - An omni-scale global–local aware network for shadow extraction in remote sensing imagery
AU - Xie, Yakun
AU - Feng, Dejun
AU - Chen, Hongyu
AU - Liao, Ziyang
AU - Zhu, Jun
AU - Li, Chuangnong
AU - Wook Baik, Sung
N1 - Funding Information:
This paper was supported by the National Natural Science Foundation of China (Grant Nos. U2034202, 41871289, and 42171397), the Sichuan Science and Technology Program (Grant Nos. 2020JDTD0003), and the China Scholarship Council. The authors would like to thank Shuang Luo, Huifang Li, and Huangfeng Shen from Wuhan University, Wuhan, China, for their kind provision of the shadow extraction dataset. The authors would like to thank the anonymous reviewers for their constructive and valuable suggestions on the earlier drafts of this manuscript.
Publisher Copyright:
© 2022 International Society for Photogrammetry and Remote Sensing, Inc. (ISPRS)
PY - 2022/11
Y1 - 2022/11
N2 - Shadows not only reduce image quality but also interfere with image interpretation, and accurate shadow extraction is the key to improving remote sensing image utilization. However, complex features lead to shadow extraction difficulties in remote sensing imagery. In this paper, an omni-scale global–local aware network (OGLANet) is proposed by analyzing the typical characteristics of shadows in remote sensing images. First, we establish a global–local aware module (GLAM) for fully extracting shadow features to solve the problem regarding the insufficient ability to control global and local network features. Second, the detailed and semantic information of shadows exists on different scales. We propose a dense feature fusion module (DFFM) between the encoder and decoder so that the detailed information can be restored in the decoding stage while retaining the semantic information. Finally, to solve the extreme scale differences of shadows, an omni-scale aggregation module (OAM) is established; this module can obtain more refined results in the prediction stage. To prove the effectiveness of our method, we compare it with state-of-the-art (SOTA) deep learning models proposed in recent studies on the same dataset. The results show that our method achieves higher accuracy and that the proposed OGLANet exhibits higher robustness and transferability than other methods.
AB - Shadows not only reduce image quality but also interfere with image interpretation, and accurate shadow extraction is the key to improving remote sensing image utilization. However, complex features lead to shadow extraction difficulties in remote sensing imagery. In this paper, an omni-scale global–local aware network (OGLANet) is proposed by analyzing the typical characteristics of shadows in remote sensing images. First, we establish a global–local aware module (GLAM) for fully extracting shadow features to solve the problem regarding the insufficient ability to control global and local network features. Second, the detailed and semantic information of shadows exists on different scales. We propose a dense feature fusion module (DFFM) between the encoder and decoder so that the detailed information can be restored in the decoding stage while retaining the semantic information. Finally, to solve the extreme scale differences of shadows, an omni-scale aggregation module (OAM) is established; this module can obtain more refined results in the prediction stage. To prove the effectiveness of our method, we compare it with state-of-the-art (SOTA) deep learning models proposed in recent studies on the same dataset. The results show that our method achieves higher accuracy and that the proposed OGLANet exhibits higher robustness and transferability than other methods.
KW - Convolutional neural network
KW - Omni-scale global–local aware network
KW - Remote sensing imagery
KW - Shadow extraction
UR - http://www.scopus.com/inward/record.url?scp=85137614064&partnerID=8YFLogxK
U2 - 10.1016/j.isprsjprs.2022.09.004
DO - 10.1016/j.isprsjprs.2022.09.004
M3 - Article
AN - SCOPUS:85137614064
SN - 0924-2716
VL - 193
SP - 29
EP - 44
JO - ISPRS Journal of Photogrammetry and Remote Sensing
JF - ISPRS Journal of Photogrammetry and Remote Sensing
ER -