基于对抗和迁移学习的灾害天气卫星云图分类

doi:10.13700/j.bh.1001-5965.2020.0459

北京航空航天大学学报 ›› 2021, Vol. 47 ›› Issue (3): 585-595.doi: 10.13700/j.bh.1001-5965.2020.0459

基于对抗和迁移学习的灾害天气卫星云图分类

张敏靖¹, 白琮^1,2, 张敬林³, 郑建炜^1,2

1. 浙江工业大学计算机科学与技术学院, 杭州 310023;
2. 浙江省可视媒体智能处理技术研究重点实验室, 杭州 310023;
3. 南京信息工程大学大气科学学院, 南京 210044

收稿日期:2020-08-25 发布日期:2021-04-08
通讯作者: 白琮 E-mail:congbai@zjut.edu.cn
作者简介:张敏靖,女,硕士研究生。主要研究方向:计算机视觉与多媒体信息处理;白琮,男,博士,副教授,博士生导师。主要研究方向:计算机视觉与多媒体信息处理;张敬林,男,博士,教授,博士生导师。主要研究方向:计算机视觉与遥感信息处理;郑建炜,男,博士,副教授,博士生导师。主要研究方向:计算机视觉与遥感信息处理。
基金资助:
国家重点研发计划（2018YFE0126100）；国家自然科学基金（41775008，61976192，61702275）；浙江新苗人才计划（2020R403059）

Classification of satellite cloud images of disaster weather based on adversarial and transfer learning

ZHANG Minjing¹, BAI Cong^1,2, ZHANG Jinglin³, ZHENG Jianwei^1,2

1. College of Computer Science and Technology, Zhejiang University of Technology, Hangzhou 310023, China;
2. Key Laboratory of Visual Media Intelligent Processing Technology of Zhejiang Province, Hangzhou 310023, China;
3. School of Atmospheric Science, Nanjing University of Information Science and Technology, Nanjing 210044, China

Received:2020-08-25 Published:2021-04-08
Supported by:
National Key R & D Program of China(2018YFE0126100);National Natural Science Foundation of China (41775008, 61976192, 61702275)； Zhejiang Xinmiao Talent Projects (2020R403059)

摘要/Abstract

摘要： 针对卫星云图中的灾害天气数据存在严重不平衡问题，提出一个结合生成对抗学习（GAN）和迁移学习（TL）的卷积神经网络（CNN）框架以解决上述问题进而提高基于卫星云图的灾害天气分类精度。该框架主要包含基于GAN的数据均衡化模块和基于迁移学习的CNN分类模块。上述2个模块分别从数据和算法层面解决数据的类间不平衡问题，分别得到一个相对均衡的数据集和一个可在不同类别数据上提取相对均衡特征的分类模型，最终实现对卫星云图的分类，提高其中灾害天气的卫星云图类别分类准确率。与此同时所提方法在自建的大规模卫星云图数据上进行了测试，消融性和综合实验结果证明了所提数据均衡方法和迁移学习方法是有效的，且所提框架模型对各个灾害天气类别的分类精度都有显著提升。

关键词: 灾害天气, 卫星影像, 图片分类, 生成对抗网络, 类间不平衡

Abstract: Weather can be forecasted based on clouds. However, how to use deep learning technology to achieve automatic weather forecasting, especially the automatic recognition of disaster weather, is still an unexplored field. Hence, it is necessary to carry out research on the basic problem in the field of automatic identification: the classification of satellite cloud images. Satellite cloud images have serious data imbalance problems. That is, cloud image data related to severe weather accounts for a very small proportion of all cloud image data. Therefore, this paper proposes a framework combining Generative Adversarial Network (GAN) and Transfer Learning (TL) based Convolutional Neural Network (CNN) to solve the problem of low accuracy of disaster weather classification based on satellite cloud images. The framework is mainly divided into a data balancing module based on GAN and a CNN classification module based on transfer learning. The above two modules solve the data imbalance problem from the data and algorithm level respectively, and obtain a relatively balanced dataset and a classification model that can extract relatively balanced features on different types of data. Eventually, the classification of satellite cloud images is achieved and the accuracy of the classification of satellite cloud images in disaster weather is improved. The method proposed in this paper has been tested on self-built large-scale satellite cloud image data. The ablative properties and comprehensive experimental results prove that the proposed data balancing method and transfer learning method are effective, and the proposed framework model has significantly improved the classification accuracy of various disaster weather categories.

Key words: disaster weather, satellite image, image classification, generative adversarial networks, data imbalance

中图分类号:

TB553

张敏靖, 白琮, 张敬林, 郑建炜. 基于对抗和迁移学习的灾害天气卫星云图分类[J]. 北京航空航天大学学报, 2021, 47(3): 585-595.

ZHANG Minjing, BAI Cong, ZHANG Jinglin, ZHENG Jianwei. Classification of satellite cloud images of disaster weather based on adversarial and transfer learning[J]. Journal of Beijing University of Aeronautics and Astronautics, 2021, 47(3): 585-595.

参考文献

[1] PARMESAN C,ROOT T L,WILLIG M R.Impacts of extreme weather and climate on terrestrial biota[J].Bulletin of the American Meteorological Society,2000,81(3):443-450.
[2] 王会军.把脉极端天气气候事件,构建预测方法[J].大气科学学报,2019,42(1):1.WANG H J.Take the pulse of extreme weather and climate events and construct prediction methods[J].Journal of Atmospheric Sciences,2019,42(1):1(in Chinese).
[3] JOHNSON J M,KHOSHGOFTAAR T M.Survey on deep learning with class imbalance[J].Journal of Big Data,2019,6(1):27.
[4] KRIZHEVSKY A,SUTSKEVER I,HINTON G E.Imagenet classification with deep convolutional neural networks[C]//Advances in Neural Information Processing Systems.2012:1097-1105.
[5] DENG J,DONG W,SOCHER R,et al.Imagenet:A large-scale hierarchical image database[C]//2009 IEEE Conference on Computer Vision and Pattern Recognition.Piscataway:IEEE Press,2009:248-255.
[6] SAIYEDA A,MIR M A.Cloud computing for deep learning analytics:A survey of current trends and challenges[J].International Journal of Advanced Research in Computer Science,2017,8(2):68-72.
[7] LEEVY J L,KHOSHGOFTAAR T M,BAUDER R A,et al.A survey on addressing high-class imbalance in big data[J].Journal of Big Data,2018,5(1):42.
[8] GOODFELLOW I,POUGET-ABADIE J,MIRZA M,et al.Generative adversarial nets[C]//Advances in Neural Information Processing Systems.2014:2672-2680.
[9] RADFORD A,METZ L,CHINTALA S.Unsupervised representation learning with deep convolutional generative adversarial networks[EB/OL].(2016-01-07)[2020-07-23].https://arxiv.org/abs/151/06434v2.
[10] KARRAS T,LAINE S,AITTALA M,et al.Analyzing and improving the image quality of stylegan[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.Piscataway:IEEE Press,2020:8110-8119.
[11] HENSMAN P,MASKO D.The impact of imbalanced training data for convolutional neural networks[EB/OL].[2020-07-23].http://diva-portal.org/smash/get/diva2:811111/FULLTEXT01.pdf.
[12] WANG S,LIU W,WU J,et al.Training deep neural networks on imbalanced data sets[C]//2016 International Joint Conference on Neural Networks(IJCNN).Piscataway:IEEE Press,2016:4368-4374.
[13] HE K,ZHANG X,REN S,et al,Deep Residual Learning for Image Recognition[C]//Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Piscataway:IEEE Press,2016:770-778.
[14] LEE H,PARK M,KIM J.Plankton classification on imbalanced large scale database via convolutional neural networks with transfer learning[C]//2016 IEEE International Conference on Image Processing (ICIP).Piscataway:IEEE Press,2016:3713-3717.
[15] KANG B,XIE S,ROHRBACH M,et al.Decoupling representation and classifier for long-tailed recognition[EB/OL].(2020-02-19)[2020-07-23].https://arxiv.org/abs/1910.09217?context=cs.CV.

基于对抗和迁移学习的灾害天气卫星云图分类

Classification of satellite cloud images of disaster weather based on adversarial and transfer learning

RichHTML

PDF (PC)

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 5

编辑推荐

Metrics

本文评价

[1]	李燕萍, 曹盼, 石杨, 张燕. 融合句嵌入的VAACGAN多对多语音转换[J]. 北京航空航天大学学报, 2021, 47(3): 500-508.
[2]	江民民, 李大朋, 邱昕, 慕福奇, 柴旭荣, 孙志浩. 基于CGAN的避扰通信决策网络离线式训练方法[J]. 北京航空航天大学学报, 2020, 46(7): 1412-1421.
[3]	杨思晨, 王华锋, 王月海, 李锦涛, 王赟豪. 深度学习机制与小波融合的超分辨率重建算法[J]. 北京航空航天大学学报, 2020, 46(1): 189-197.
[4]	张克明, 蔡远文, 任元. 基于生成对抗网络的航天异常事件检测方法[J]. 北京航空航天大学学报, 2019, 45(7): 1329-1336.
[5]	魏宏喜, 张越. 基于生成对抗网络的零样本图像分类[J]. 北京航空航天大学学报, 2019, 45(12): 2345-2350.