| Citation: | Liu L L,Xie R L,Ji J C. Semantic segmentation algorithms of aerial images via context-aware attention guidance[J]. Journal of Beijing University of Aeronautics and Astronautics,2026,52(11):3918-3928 (in Chinese) |
Semantic segmentation algorithms for aerial images have significant research and application value in fields such as land use classification, environmental monitoring, resource surveying, and urban planning. To address the challenges posed by high-resolution aerial images—such as complex spatial relationships among objects, varying target scales, large intra-class variations, and high inter-class similarities—this paper proposes a context attention-guided semantic segmentation algorithm. In order to improve the network's ability to represent features, a collaborative attention module is added to the encoder stage of the model. This module pulls features from both spatial and channel dimensions. To efficiently extract both semantic information and detailed features, a global-local feature fusion module is built in the decoder stage using concurrent global and local branches. Furthermore, a crisscross semantic interaction module is employed to fuse multi-level features, improving the model’s ability to distinguish object boundaries. Experimental results demonstrate that the proposed algorithm achieves a mean intersection-over-union(MIoU)of 71.0% on the UAVID dataset, significantly outperforming state-of-the-art algorithms in both accuracy and inference speed.
| [1] |
Zhong H F, Sun H M, Han D N, et al. Lake water body extraction of optical remote sensing images based on semantic segmentation[J]. Applied Intelligence, 2022, 52(15): 17974-17989.
|
| [2] |
Yuan Q Q, Shen H F, Li T W, et al. Deep learning in environmental remote sensing: achievements and challenges[J]. Remote Sensing of Environment, 2020, 241: 111716.
|
| [3] |
Zhang Q L, Seto K C. Mapping urbanization dynamics at regional and global scales using multi-temporal DMSP/OLS nighttime light data[J]. Remote Sensing of Environment, 2011, 115(9): 2320-2329.
|
| [4] |
Long J, Shelhamer E, Darrell T. Fully convolutional networks for semantic segmentation[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Piscataway: IEEE Press, 2015: 3431-3440.
|
| [5] |
Noh H, Hong S, Han B. Learning deconvolution network for semantic segmentation[C]//Proceedings of the IEEE International Conference on Computer Vision. Piscataway: IEEE Press, 2016: 1520-1528.
|
| [6] |
Badrinarayanan V, Kendall A, Cipolla R. SegNet: a deep convolutional encoder-decoder architecture for image segmentation[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017, 39(12): 2481-2495.
|
| [7] |
Ronneberger O, Fischer P, Brox T. U-Net: convolutional networks for biomedical image segmentation[M]//Medical Image Computing and Computer-Assisted Intervention-MICCAI. Berlin: Springer, 2015: 234-241.
|
| [8] |
Liu W, Rabinovich A, Berg A C. ParseNet: looking wider to see better[EB/OL]. (2015-06-15)[2025-06-02]. https://arxiv.org/abs/1506.04579.
|
| [9] |
Zhao H S, Shi J P, Qi X J, et al. Pyramid scene parsing network[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Piscataway: IEEE Press, 2017: 6230-6239.
|
| [10] |
Chen L C, Papandreou G, Kokkinos I, et al. Semantic image segmentation with deep convolutional nets and fully connected CRFs[EB/OL]. (2014-12-22)[2025-06-02]. https://arxiv.org/abs/1412.7062.
|
| [11] |
Schwing A G, Urtasun R. Fully connected deep structured networks[EB/OL]. (2015-03-09)[2025-06-02]. https://arxiv.org/abs/1503.02351.
|
| [12] |
Zheng S, Jayasumana S, Romera-paredes B, et al. Conditional random fields as recurrent neural networks[C]//Proceedings of the IEEE International Conference on Computer Vision. Piscataway: IEEE Press, 2016: 1529-1537.
|
| [13] |
Lin G S, Shen C H, Van Den Hengel A, et al. Efficient piecewise training of deep structured models for semantic segmentation[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Piscataway: IEEE Press, 2016: 3194-3203.
|
| [14] |
Lyu Y, Vosselman G, Xia G S, et al. UAVid: a semantic segmentation dataset for UAV imagery[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2020, 165: 108-119.
|
| [15] |
Yang M Y, Kumaar S, Lyu Y, et al. Real-time semantic segmentation with context aggregation network[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2021, 178: 124-134.
|
| [16] |
Fu J, Liu J, Tian H J, et al. Dual attention network for scene segmentation[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. Piscataway: IEEE Press, 2020: 3141-3149.
|
| [17] |
Oršić M, Šegvić S. Efficient semantic segmentation with pyramidal fusion[J]. Pattern Recognition, 2021, 110: 107611.
|
| [18] |
Yu C Q, Wang J B, Peng C, et al. BiSeNet: bilateral segmentation network for real-time semantic segmentation[C]//Proceedings of the European Conference on Computer Vision-ECCV. Berlin: Springer, 2018: 334-349.
|
| [19] |
Li R, Zheng S Y, Zhang C, et al. Multiattention network for semantic segmentation of fine-resolution remote sensing images[J]. IEEE Transactions on Geoscience and Remote Sensing, 2022, 60: 5607713.
|
| [20] |
Li R, Zheng S Y, Zhang C, et al. ABCNet: attentive bilateral contextual network for efficient semantic segmentation of Fine-Resolution remotely sensed imagery[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2021, 181: 84-98.
|
| [21] |
Xie E Z, Wang W H, Yu Z D, et al. SegFormer: simple and efficient design for semantic segmentation with transformers[J]. Advances in neural information processing systems, 2021, 34: 12077-12090.
|
| [22] |
Wang L B, Li R, Wang D Z, et al. Transformer meets convolution: a bilateral awareness network for semantic segmentation of very fine resolution urban scene images[J]. Remote Sensing, 2021, 13(16): 3065.
|
| [23] |
Srinivas A, Lin T Y, Parmar N, et al. Bottleneck transformers for visual recognition[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. Piscataway: IEEE Press, 2021: 16514-16524.
|
| [24] |
Xu W J, Xu Y F, Chang T, et al. Co-scale conv-attentional image transformers[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision. Piscataway: IEEE Press, 2022: 9961-9970.
|
| [25] |
Strudel R, Garcia R, Laptev I, et al. Segmenter: transformer for semantic segmentation[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision. Piscataway: IEEE Press, 2022: 7242-7252.
|
| [26] |
Poudel R P K, Liwicki S, Cipolla R. Fast-SCNN: fast semantic segmentation network[EB/OL]. (2019-02-12)[2025-06-03]. https://arxiv.org/abs/1902.04502.
|
| [27] |
Hu P, Perazzi F, Heilbron F C, et al. Real-time semantic segmentation with fast attention[J]. IEEE Robotics and Automation Letters, 2021, 6(1): 263-270.
|
| [28] |
Zhuang J T, Yang J L, Gu L, et al. ShelfNet for fast semantic segmentation[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision Workshop. Piscataway: IEEE Press, 2020: 847-856.
|