| Citation: | Liang L M，Li Y L，Liu Y Q，et al. Cross-layer high-efficiency phase-aware Transformer for colorectal polyp image segmentation algorithm[J]. Journal of Beijing University of Aeronautics and Astronautics，2026，52（7）：2281-2292 （in Chinese）
|
This paper proposes a cross-layer efficient phase-aware Transformer segmentation algorithm for colorectal polyps in order to address the issues of irregular shape of the lesion region, fuzzy edge contour, and high similarity with normal region, which result in the loss of detail information and mis-segmentation of the lesion region. Firstly, the pyramid vision Transformer encoder is used to extract the global semantic information and spatial details of the input feature map layer by layer, and to analyze the colorectal polyp lesion features at multiple scales; secondly, the polarized self-attention module is used to regressively predict the lesion features, and to deepen the correlation of the semantic information of the features;thirdly, the high-efficiency phase-aware module is designed to extract the global and local information to precisely. The final one is the cross-layer fusion and propagation module, which enhances the rate of advanced feature reuse by integrating the edge details. Experiments were conducted on five datasets: CVC-ClinicDB, Kvasir-SEG, ETIS-LaribPolypDB, CVC-ConlonDB, and CVC-T, achieving Dice coefficients of 0.940, 0.923, 0.801, 0.810, and 0.896, respectively. This demonstrates superior segmentation performance over existing networks such as CaraNet and MSRAFormer. Both colorectal polyp images with fuzzy edges and complicated spatial organization exhibit great segmentation accuracy, according to the evaluation results.
| [1] |
Liang H, Cheng Z M, Zhong H Q, et al. A region-based convolutional network for nuclei detection and segmentation in microscopy images[J]. Biomedical Signal Processing and Control, 2022, 71: 103276.
|
| [2] |
Banik D, Roy K, Bhattacharjee D, et al. Polyp-Net: a multimodel fusion network for polyp segmentation[J]. IEEE Transactions on Instrumentation and Measurement, 2021, 70: 4000512.
|
| [3] |
Jha D, Smedsrud P H, Johansen D, et al. A comprehensive study on colorectal polyp segmentation with ResUNet++, conditional random field and test-time augmentation[J]. IEEE Journal of Biomedical and Health Informatics, 2021, 25(6): 2029-2040.
|
| [4] |
关少亚, 张诚, 孟偲, 等. 基于相位对称性的血管超声图像分割算法[J]. 北京航空航天大学学报, 2023, 49(10): 2645-2650.
Guan S Y, Zhang C, Meng S, et al. Vascular ultrasound image segmentation algorithm based on phase symmetry[J]. Journal of Beijing University of Aeronautics and Astronautics, 2023, 49(10): 2645-2650(in Chinese).
|
| [5] |
Zhou L S, Liang L M, Sheng X Q. GA-Net: ghost convolution adaptive fusion skin lesion segmentation network[J]. Computers in Biology and Medicine, 2023, 164: 107273.
|
| [6] |
Shao D G, Xu C R, Xiang Y, et al. Ultrasound image segmentation with multilevel threshold based on differential search algorithm[J]. IET Image Processing, 2019, 13(6): 998-1005.
|
| [7] |
Eriyanti N A, Sigit R, Harsono T. Classification of colon polyp on endoscopic image using support vector machine[C]//Proceedings of the International Electronics Symposium. Piscataway: IEEE Press, 2021: 244-250.
|
| [8] |
Senthilkumaran N, Vaithegi S. Image segmentation by using thresholding techniques for medical images[J]. Computer Science & Engineering, 2016, 6(1): 1-13.
|
| [9] |
Yue G H, Han W W, Jiang B, et al. Boundary constraint network with cross layer feature integration for polyp segmentation[J]. IEEE Journal of Biomedical and Health Informatics, 2022, 26(8): 4090-4099.
|
| [10] |
Näppi J, Yoshida H. Automated detection of polyps with CT colonography evaluation of volumetric features for reduction of false-positive findings[J]. Academic Radiology, 2002, 9(4): 386-397.
|
| [11] |
Jerebko A K, Franaszek M, Summers R M. Radon transform based polyp segmentation method for CT colonography computer aided diagnosis[C]//Proceedings of the Society of Photo-Optical Instrumentation Engineers Conference on Medical Imaging: Physiology and Function-Methods, Systems, and Applications. Bellingham: SPIE, 2002, 225: 257-258.
|
| [12] |
Yao J H, Miller M, Franaszek M, et al. Colonic polyp segmentation in CT colonography-based on fuzzy clustering and deformable models[J]. IEEE Transactions on Medical Imaging, 2004, 23(11): 1344-1352.
|
| [13] |
Wu H S, Zhao Z B, Zhong J F, et al. PolypSeg: a lightweight context-aware network for real-time polyp segmentation[J]. IEEE Transactions on Cybernetics, 2023, 53(4): 2610-2621.
|
| [14] |
Long J, Shelhamer E, Darrell T. Fully convolutional networks for semantic segmentation[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Piscataway: IEEE Press, 2015: 3431-3440.
|
| [15] |
Ronneberger O, Fischer P, Brox T. U-Net: convolutional networks for biomedical image segmentation[C]//Proceedings of the 18th International Conference on Medical Image Computing and Computer-Assisted Intervention. Berlin: Springer, 2015: 234-241.
|
| [16] |
Ali S M F, Khan M T, Haider S U, et al. Depth-wise separable atrous convolution for polyps segmentation in gastro[C]//Proceedings of the MediaEval. [S.l.:s.n.]: 2020.
|
| [17] |
Khan M A, Khan M A, Ahmed F, et al. Gastrointestinal diseases segmentation and classification based on duo-deep architectures[J]. Pattern Recognition Letters, 2020, 131: 193-204.
|
| [18] |
Vaswani A, Shazeer N, Parmar N, et al. Attention is all you need[C]//Proceedings of the 31st International Conference on Neural Information Processing Systems. New York: ACM, 2017: 6000-6010.
|
| [19] |
Peng Z L, Huang W, Gu S Z, et al. Conformer: local features coupling global representations for visual recognition[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision. Piscataway: IEEE Press, 2022: 357-366.
|
| [20] |
Wang J F, Huang Q M, Tang F L, et al. Stepwise feature fusion: local guides global[C]//Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention. Berlin: Springer, 2022: 110-120.
|
| [21] |
Wang W H, Xie E Z, Li X, et al. PVTv2: improved baselines with pyramid vision Transformer[J]. Computational Visual Media, 2022, 8(3): 415-424.
|
| [22] |
Liu H J, Liu F Q, FAN X Y, et al. Polarized self-attention: towards high-quality pixel-wise regression[EB/OL]. (2021-07-08)[2024-05-01]. https://arxiv.org/abs/2107.00782.
|
| [23] |
Woo S, Park J, Lee J Y, et al. CBAM: convolutional block attention module[C]//Proceedings of the European Conference on Computer Vision. Berlin: Springer, 2018: 3-19.
|
| [24] |
Wang Q L, Wu B G, Zhu P F, et al. ECA-Net: efficient channel attention for deep convolutional neural networks[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. Piscataway: IEEE Press, 2020: 11531-11539.
|
| [25] |
Tang Y H, Han K, Guo J Y, et al. An image patch is a wave: phase-aware vision MLP[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. Piscataway: IEEE Press, 2022: 10925-10934.
|
| [26] |
Zhou T, Zhou Y, Gong C, et al. Feature aggregation and propagation network for camouflaged object detection[J]. IEEE Transactions on Image Processing, 2022, 31: 7036-7047.
|
| [27] |
Bernal J, Sánchez F J, Fernández-esparrach G, et al. WM-DOVA maps for accurate polyp highlighting in colonoscopy: validation vs. saliency maps from physicians[J]. Computerized Medical Imaging and Graphics, 2015, 43: 99-111.
|
| [28] |
Dutta A, Zisserman A. The VIA annotation software for images, audio and video[C]//Proceedings of the 27th ACM International Conference on Multimedia. New York: ACM, 2019: 2276-2279.
|
| [29] |
Tajbakhsh N, Gurudu S R, Liang J M. Automated polyp detection in colonoscopy videos using shape and context information[J]. IEEE Transactions on Medical Imaging, 2016, 35(2): 630-644.
|
| [30] |
Silva J, Histace A, Romain O, et al. Toward embedded detection of polyps in WCE images for early diagnosis of colorectal cancer[J]. International Journal of Computer Assisted Radiology and Surgery, 2014, 9(2): 283-293.
|
| [31] |
Lou A G, Guan S Y, Ko H, et al. CaraNet: context axial reverse attention network for segmentation of small medical objects[C]// Proceedings of the Conference on Medical Imaging-Image Processing. Bellingham: SPIE, 2022, 12032: 81-92.
|
| [32] |
Dong B, Wang W H, Fan D P, et al. Polyp-PVT: polyp segmentation with pyramid vision transformers[EB/OL]. (2024-02-19)[2024-05-01]. https://arxiv.org/abs/2108.06932.
|
| [33] |
Shi W T, Xu J, Gao P. SSformer: a lightweight Transformer for semantic segmentation[C]//Proceedings of the IEEE 24th International Workshop on Multimedia Signal Processing. Piscataway: IEEE Press, 2022: 1-5.
|
| [34] |
Wu C, Long C, Li S J, et al. MSRAformer: multiscale spatial reverse attention network for polyp segmentation[J]. Computers in Biology and Medicine, 2022, 151: 106274.
|
Figures(11) / Tables(8)
Copyright © Journal of Beijing University of Aeronautics and Astronautics
Address: Editorial Department of Journal of Beijing University of Aeronautics and Astronautics, 37 Xueyuan Road, Haidian District, Beijing Post Code: 100191 Email: jbuaa@buaa.edu.cn
Supported by:
Beijing Renhe Information Technology Co., Ltd.
DownLoad:
