基于水下机器人的海产品智能检测与自主抓取系统

doi:10.13700/j.bh.1001-5965.2019.0377

北京航空航天大学学报 ›› 2019, Vol. 45 ›› Issue (12): 2393-2402.doi: 10.13700/j.bh.1001-5965.2019.0377

基于水下机器人的海产品智能检测与自主抓取系统

徐凤强, 董鹏, 王辉兵, 付先平

大连海事大学信息科学技术学院, 大连 116026

收稿日期:2019-07-09 出版日期:2019-12-20 发布日期:2019-12-31
通讯作者: 付先平 E-mail:fxp@dlmu.edu.cn
作者简介:徐凤强男,博士研究生。主要研究方向:数字图像处理、水下目标检测、计算机视觉;董鹏男,硕士研究生。主要研究方向:数字图像处理、计算机视觉;王辉兵男,博士。主要研究方向:计算机视觉、机器学习;付先平男,博士,教授,博士生导师。主要研究方向:多媒体技术、驾驶行为、模式识别、数字图像处理和视频图像低码率编码。
基金资助:
国家自然科学基金（61272368，61370142）；中央高校基本科研业务费专项资金（3132016352）；交通运输部应用基础研究项目（2015329225300）；大连市科技创新项目（2018J12GX037）

Intelligent detection and autonomous capture system of seafood based on underwater robot

XU Fengqiang, DONG Peng, WANG Huibing, FU Xianping

Information Science and Technology College, Dalian Maritime University, Dalian 116026, China

Received:2019-07-09 Online:2019-12-20 Published:2019-12-31
Supported by:
National Natural Science Foundation of China (61272368,61370142); the Fundamental Research Funds for the Central Universities (3132016352); the Fundamental Research of Ministry of Transport of P. R. China (2015329225300); Dalian Science and Technology Innovation (2018J12GX037)

摘要/Abstract

摘要： 针对水下机器人实现自主抓取过程中缺乏引导系统的问题，提出了一种依托水下机器人的海产品智能检测与自主抓取系统，用来解决水下目标的智能检测问题，并引导水下机器人进行海产品的自主抓取。将卷积神经网络检测算法应用到水下场景，利用水下图像数据集训练特定的网络模型DSOD检测海产品。建立短基线定位系统定位水下作业的机器人。通过分析相机成像坐标系与定位系统坐标系之间的关系，提出了一种计算海产品实际位置的坐标转换方法，计算海产品的实际位置。设计了一种基于反馈机制的多信号分析方法，引导机器人在水下移动并抓捕海产品。为了验证所提系统的有效性，搭建了一款水下抓捕机器人，并成功将所提算法应用到机器人，在真实海洋环境中进行海产品的自主抓取实验。

关键词: 水下抓捕机器人, 智能检测, 水下目标定位, 短基线定位系统, 自主抓取

Abstract: Currently, underwater robot faces the tough challenges of lacking intelligent detection and autonomous capture system to guide. Therefore, autonomous capture is hard to be achieved. Toward this end, this paper proposes an intelligent detection and autonomous capture system to achieve intelligent detection of marine target and guide the underwater robot to autonomously capture seafood. First, we employ convolutional neural network to perform object detection task in underwater scene and train the DSOD with underwater dataset to accurately detect marine objects. What's more, the short baseline positioning system is built to locate the underwater robot. To calculate the position of the object relative to robot, this paper proposes a coordinate transforming method to transform the target's location from camera coordinates system to underwater positioning coordinates. Furthermore, this paper designs a multi-signal analysis method based on feedback mechanism to command the robot to move ahead to the seafood until grasping them. To verify the effectiveness of the system, we develop an underwater picking robot and successfully apply the proposed methods to the robot to autonomously detect and capture the marine object.

Key words: underwater picking robot, intelligent detection, marine target positioning, short baseline positioning system, autonomous capture

中图分类号:

徐凤强, 董鹏, 王辉兵, 付先平. 基于水下机器人的海产品智能检测与自主抓取系统[J]. 北京航空航天大学学报, 2019, 45(12): 2393-2402.

XU Fengqiang, DONG Peng, WANG Huibing, FU Xianping. Intelligent detection and autonomous capture system of seafood based on underwater robot[J]. JOURNAL OF BEIJING UNIVERSITY OF AERONAUTICS AND A, 2019, 45(12): 2393-2402.

参考文献

[1] SHEN Z,LIU Z,LI J,et al.DSOD:Learning deeply supervised object detectors from scratch[C]//IEEE International Conference on Computer Vision(ICCV).Piscataway,NJ:IEEE Press,2017:1937-1945.
[2] VICKERY K.Acoustic positioning systems.A practical overview of current systems[C]//Proceedings of the 1998 Workshop on Autonomous Underwater Vehicles.Piscataway,NJ:IEEE Press,1998:5-17.
[3] GIRSHICK R,DONAHUE J,DARRELL T,et al.Rich feature hierarchies for accurate object detection and semantic segmentation[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.Piscataway,NJ:IEEE Press,2014:580-587.
[4] GIRSHICK R.Fast R-CNN[C]//Proceedings of the IEEE International Conference on Computer Vision.Piscataway,NJ:IEEE Press,2015:1440-1448.
[5] REN S,HE K,GIRSHICK R,et al.Faster R-CNN:Towards real-time object detection with region proposal networks[C]//Proceedings of the 29th International Conference on Neural Information Processing Systems.Cambridge:MIT Press,2015:91-99.
[6] HE K,GKIOXARI G,DOLLÁR P,et al.Mask R-CNN[C]//Proceedings of the IEEE International Conference on Computer Vision.Piscataway,NJ:IEEE Press,2017:2961-2969.
[7] DAI J,LI Y,HE K,et al.R-FCN:Object detection via region-based fully convolutional networks[C]//Proceedings of the 30th International Conference on Neural Information Processing Systems.Cambridge:MIT Press,2016:379-387.
[8] REDMON J,DIVVALA S,GIRSHICK R,et al.You only look once:Unified,realtime object detection[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.Piscataway,NJ:IEEE Press,2016:779-788.
[9] LIU W,ANGUELOV D,ERHAN D,et al.SSD:Single shot multibox detector[C]//European Conference on Computer Vision.Berlin:Springer,2016:21-37.
[10] FU C Y,LIU W,RANGA A,et al.DSSD:Deconvolutional single shot detector[EB/OL].(2017-01-23)[2019-07-01].https://arxiv.org/abs/1701.06659.
[11] SUN X,SHI J,LIU L,et al.Transferring deep knowledge for object recognition in low-quality underwater videos[J].Neurocomputing,2018,275:897-908.
[12] 杨放琼,谭青,彭高明.基于长基线系统深海采矿ROV精确定位[J].海洋工程,2006(3):95-99.YANG F Q,TAN Q,PENG G M.Accurate positioning for ROV in deep-sea mining based on LBL acoustic system[J].The Ocean Engineering,2006(3):95-99(in Chinese).
[13] SMITH S M,KRONEN D.Experimental results of an inexpensive short baseline acoustic positioning system for AUV navigation[C]//Proceedings of IEEE Oceans'97.Piscataway,NJ:IEEE Press,1997,1:714-720.
[14] MANDIC' F,RENDULIC I,MISKOVIC N,et al.Underwater object tracking using sonar and USBL measurements[J].Journal of Sensors,2016,2016:1-10.
[15] MARANI G,CHOI S K,YUH J.Experimental study on autonomous manipulation for underwater intervention vehicles[C]//The Seventeenth International Offshore and Polar Engineering Conference,2007:1088-1094.
[16] ZANNATHA J M I,LIMON R C,SANCHEZ A D G,et al.Monocular visual self-localization for humanoid soccer robots[C]//21st International Conference on Electrical Communications and Computers.Piscataway,NJ:IEEE Press,2011:100-107.
[17] LEE P M,JEON B H,HONG S W,et al.System design of an ROV with manipulators and adaptive control of it[C]//Proceedings of the 2000 International Symposium on Underwater Technology.Piscataway,NJ:IEEE Press,2000:431-436.
[18] ZHANG M,ZHANG L,LI Y.A three-dimensional locating method for underwater robot based on sensors fusion[C]//2009 International Conference on Mechatronics and Automation.Piscataway,NJ:IEEE Press,2009:1207-1212.
[19] REDMON J,FARHADI A.YoLov3:An incremental improvement[EB/OL].(2018-04-08)[2019-07-02].https://arxiv.org/abs/1804.02767.

基于水下机器人的海产品智能检测与自主抓取系统

Intelligent detection and autonomous capture system of seafood based on underwater robot

PDF (PC)

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

本文评价

[1]	黎洁, 冯燃生, 杨阳朝, 孙伟, 李奇越. QoE驱动的VR视频自适应采集与传输[J]. 北京航空航天大学学报, 2019, 45(12): 2385-2392.
[2]	杨彬, 李和平, 曾慧. 基于视频的三维人体姿态估计[J]. 北京航空航天大学学报, 2019, 45(12): 2463-2469.
[3]	吴志山, 张帅, 牛玉贞. 基于多尺度失真感知特征的重定向图像质量评估[J]. 北京航空航天大学学报, 2019, 45(12): 2487-2494.
[4]	潘海侠, 徐嘉璐, 李锦涛, 王赟豪, 王华锋. 基于CNN的多尺寸航拍图像定位方法的研究与实现[J]. 北京航空航天大学学报, 2019, 45(11): 2170-2176.
[5]	陈金鹤, 汪正中, 马玉杰. 倾转旋翼机低速回避区研究[J]. 北京航空航天大学学报, 2019, 45(11): 2184-2192.
[6]	上官士鹏, 朱翔, 陈睿, 马英起, 李赛, 韩建伟. 0.13 μm部分耗尽SOI工艺反相器链SET脉宽传播[J]. 北京航空航天大学学报, 2019, 45(11): 2193-2198.
[7]	薛倩, 刘婧, 马敏, 王化祥. 基于原始对偶内点法的EST图像重建[J]. 北京航空航天大学学报, 2019, 45(10): 1973-1981.
[8]	耿珂, 黄智刚, 苏雨, 石培辰, 高强, 熊华钢. 基于地面基站的定位系统构建和方案[J]. 北京航空航天大学学报, 2019, 45(10): 2051-2057.
[9]	张冬, 陈勇, 胡孟权, 付向恒. 边条/鸭翼对前掠翼和后掠翼气动特性的影响[J]. 北京航空航天大学学报, 2019, 45(10): 2058-2068.
[10]	张畅, 谢荣建, 张添, 鲁得浦, 吴亦农, 洪芳军. 液氮温区平板蒸发器环路热管实验研究[J]. 北京航空航天大学学报, 2019, 45(6): 1211-1217.
[11]	杨斌, 史开元, 袁廷璧, 肖德铭, 王侃, 李振海. 金属材料微裂纹取向与超声波和频非线性效应[J]. 北京航空航天大学学报, 2019, 45(4): 695-704.
[12]	余华峰, 刘宏康, 陈树生, 阎超. 类X-51A飞行器非定常湍流精细模拟[J]. 北京航空航天大学学报, 2019, 45(3): 624-632.
[13]	刘伟, 杜佳鸿, 贾素玲, 蒲菊华. 能量有效的无线传感器网络分簇路由协议[J]. 北京航空航天大学学报, 2019, 45(1): 50-56.
[14]	辛灿伟, 胡岸勇, 刘凯, 苗俊刚. 采用矢量调制器实时消除模拟相关偏置[J]. 北京航空航天大学学报, 2018, 44(12): 2489-2495.
[15]	辛灿伟, 胡岸勇, 刘凯, 苗俊刚. 相控阵近场初始相位快速实时校准方法[J]. 北京航空航天大学学报, 2018, 44(12): 2496-2502.