Cotton recognition based on transfer learning

doi:10.3969/j.issn.1004-1524.2020.08.16

›› 2020, Vol. 32 ›› Issue (8): 1457-1465.DOI: 10.3969/j.issn.1004-1524.2020.08.16

• Biosystems Engineering • Previous Articles Next Articles

Cotton recognition based on transfer learning

WANG Jian^1,2, TIAN Guangbao^1,2, ZHOU Qin^1,2

1. The State Key Laboratory of Mechanical Transmission, Chongqing University, Chongqing 400044, China;
2. College of Mechanical Engineering, Chongqing University, Chongqing 400044, China

Received:2020-01-16 Online:2020-08-25 Published:2020-08-28

Abstract

Abstract: An important way to improve the efficiency of the intelligent cotton picker is to realize the identification of single cotton, overlapped cottons, blocked cottons to avoid false picking and missed picking. The conventional feature extraction method is difficult to achieve satisfactory results for the identification of different types of cotton. Methods based on transfer learning and feature extraction based on transfer learning combined with extreme learning machine (ELM) was proposed. Firstly, the classification layer of AlexNet, GoogleNet and ResNet-50 models was changed and the relevant parameters were set, and the trained transfer model was used to identify the cotton validation set; secondly, the trained transfer model was used to extract the characteristics of cotton data set, and then the characteristics of the training set were used to train the ELM model to calculate the accuracy of the ELM model with different hidden layer neurons. The recognition rates of AlexNet, GoogleNet and ResNet-50 transfer models were 92.03%, 93.19% and 93.68%, respectively. The accuracy of the method of feature extraction combined with ELM was 1.97, 1.34 and 1.55 percentage points higher than that of the corresponding transfer model. The results showed that the transfer model could obtain higher accuracy for small sample cotton recognition. The method based on feature extraction and ELM could further improve the accuracy.

Key words: cotton, recognition, transfer learning, extreme learning machine, feature extraction

CLC Number:

S562
S24

WANG Jian, TIAN Guangbao, ZHOU Qin. Cotton recognition based on transfer learning[J]. , 2020, 32(8): 1457-1465.

References

[1] 张山鹰. 新疆机采棉发展现状及发展方向的思考[J]. 农业工程, 2012, 2(7): 1-6.
ZHANG S Y. Consideration about status quo and development direction of machine pick up cotton in Sinkiang Province[J]. Agricultural Engineering, 2012, 2(7): 1-6.(in Chinese with English abstract)
[2] 王献锋, 丁军, 朱义海. 基于性能改善深度信念网络的棉花病虫害预测方法[J]. 浙江农业学报, 2018, 30(10): 1790-1797.
WANG X F, DING J, ZHU Y H. A forecasting method of cotton diseases and insect pests based on deep belief network with improved performance[J]. Acta Agriculturae Zhejiangensis, 2018, 30(10): 1790-1797.(in Chinese with English abstract)
[3] 王巧华, 翁富炯, 张洪洲, 等. 机采棉中残地膜静电吸附法分级去除[J]. 农业机械学报, 2019, 50(6): 140-147.
WANG Q H, WENG F J, ZHANG H Z, et al. Grading removal of residual plastic film in machine-harvested cotton using electrostatic adsorption method[J]. Transactions of the Chinese Society for Agricultural Machinery, 2019, 50(6): 140-147.(in Chinese with English abstract)
[4] 田景山, 张煦怡, 张旺锋. 新疆近年机采棉发展过程中的棉纤维品质变化[J]. 中国棉花, 2017, 44(12): 27-31, 34.
TIAN J S, ZHANG X Y, ZHANG W F. Change of fiber quality along with the development of machine-harvested cotton in Xinjiang[J]. China Cotton, 2017, 44(12): 27-31, 34.(in Chinese with English abstract)
[5] LI C, THIBODEAUX D, KNOWLTON A R, et al. Effect of cleaning treatment and cotton cultivar on cotton fiber and textile yarn quality[J]. Applied Engineering in Agriculture, 2012, 28(6): 833-840.
[6] KRIFA M. Fiber length distribution in cotton processing: dominant features and interaction effects[J]. Textile Research Journal, 2006, 76(5): 426-435.
[7] 刘坤, 费树岷, 汪木兰, 等. 基于改进随机Hough变换的棉桃识别技术[J]. 农业机械学报, 2010, 41(8): 160-165.
LIU K, FEI S M, WANG M L, et al. Cotton recognition based on randomized hough transform[J]. Transactions of the Chinese Society for Agricultural Machinery, 2010, 41(8): 160-165.(in Chinese with English abstract)
[8] 王勇, 沈明霞, 姬长英. 基于色差信息的田间成熟棉花识别[J]. 浙江农业学报, 2007, 19(5): 385-388.
WANG Y, SHEN M X, JI C Y. Study on the recognition of mature cotton based on the chromatic aberration in natural outdoor scenes[J]. Acta Agriculturae Zhejiangensis, 2007, 19(5): 385-388.(in Chinese with English abstract)
[9] 刘坤, 费树岷, 汪木兰. 采棉机器人中棉花成熟度的识别[J]. 工业仪表与自动化装置, 2012(6): 3-5.
LIU K, FEI S M, WANG M L. Cotton recognition in the cotton picking robot[J]. Industrial Instrumentation & Automation, 2012(6): 3-5.(in Chinese with English abstract)
[10] 关胤. 基于残差网络迁移学习的花卉识别系统[J]. 计算机工程与应用, 2019, 55(1): 174-179.
GUAN Y. Flower species recognition system based on residual network transfer learning[J]. Computer Engineering and Applications, 2019, 55(1): 174-179.(in Chinese with English abstract)
[11] KRIZHEVSKY A, SUTSKEVER I, HINTON G E. Imagenet classification with deep convolutional neural networks[C]//Advances in Neural Information Processing Systems. 2012: 1097-1105.
[12] SZEGEDY C, LIU W, JIA Y Q, et al. Going deeper with convolutions[C]//2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Boston, MA, USA. IEEE, 2015: 1-9.
[13] HE K M, ZHANG X Y, REN S Q, et al. Deep residual learning for image recognition[C]//2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Las Vegas, NV, USA. IEEE, 2016: 770-778.
[14] 王彦翔, 张艳, 杨成娅, 等. 基于深度学习的农作物病害图像识别技术进展[J]. 浙江农业学报, 2019, 31(4): 669-676.
WANG Y X, ZHANG Y, YANG C Y, et al. Advances in new nondestructive detection and identification techniques of crop diseases based on deep learning[J]. Acta Agriculturae Zhejiangensis, 2019, 31(4): 669-676.(in Chinese with English abstract)
[15] 曹凤莲. 基于深度学习的植物叶片识别方法研究[D]. 重庆: 重庆大学, 2017.
CAO F L. The study of plant leaf identification based on deep learning method[D]. Chongqing: Chongqing University, 2017.(in Chinese with English abstract)
[16] 海潮. 基于深度学习的红枣缺陷识别技术研究[D]. 郑州: 郑州大学, 2019.
HAI C. The research on deep learning for jujube defects recognition technology[D]. Zhengzhou: Zhengzhou University, 2019.(in Chinese with English abstract)
[17] 廉小亲,成开元,安飒,等.基于深度学习和迁移学习的水果图像分类[J].测控技术,2019,38(6):15-18.
LIAN X Q, CHENG K Y, AN S, et al. Fruit image classification based on deep learning and transfer learing[J]. Measurement & Control Technology, 2019, 38(6):15-18(in Chinese with English abstract)
[18] PAN S J, YANG Q. A survey on transfer learning[J]. IEEE Transactions on Knowledge and Data Engineering, 2010, 22(10): 1345-1359.
[19] CUI Y, SONG Y, SUN C, et al. Large scale fine-grained categorization and domain-specific transfer learning[C]//2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Salt Lake City, UT, USA: IEEE, 2018: 4109-4118.
[20] 张建华, 孔繁涛, 吴建寨, 等. 基于改进VGG卷积神经网络的棉花病害识别模型[J]. 中国农业大学学报, 2018, 23(11): 161-171.
ZHANG J H, KONG F T, WU J Z, et al. Cotton disease identification model based on improved VGG convolution neural network[J]. Journal of China Agricultural University, 2018, 23(11): 161-171.(in Chinese with English abstract)
[21] 郑一力, 张露. 基于迁移学习的卷积神经网络植物叶片图像识别方法[J]. 农业机械学报, 2018, 49(增刊): 354-359.
ZHENG Y L, ZHANG L. Plant leaf image recognition method based on transfer learning with convolutional neural networks[J]. Transactions of the Chinese Society for Agricultural Machinery, 2018, 49(Suppl.): 354-359.(in Chinese with English abstract)
[22] 王艳玲, 张宏立, 刘庆飞, 等. 基于迁移学习的番茄叶片病害图像分类[J]. 中国农业大学学报, 2019, 24(6): 124-130.
WANG Y L, ZHANG H L, LIU Q F, et al. Image classification of tomato leaf diseases based on transfer learning[J]. Journal of China Agricultural University, 2019, 24(6): 124-130.(in Chinese with English abstract)
[23] 张雪芹, 陈嘉豪, 诸葛晶晶, 等. 基于深度学习的快速植物图像识别[J]. 华东理工大学学报(自然科学版), 2018, 44(6): 887-895.
ZHANG X Q, CHEN J H, ZHUGE J J, et al. Deep learning based fast plant image recognition[J]. Journal of East China University of Science and Technology(Natural Science Edition), 2018, 44(6): 887-895.(in Chinese with English abstract)
[24] 王平. 基于迁移学习的烟草叶片病情害识别[J]. 变频器世界, 2018(10): 77-80.
WANG P. Identification of tobacco leaf disease based on transfer learning[J]. The World of Inverters, 2018(10): 77-80.(in Chinese with English abstract)
[25] 袁文翠, 孔雪. 基于迁移学习的图像识别研究[J]. 微型电脑应用, 2018, 34(7): 10-12.
YUAN W C, KONG X. A study of image recognition based on transfer learning[J]. Microcomputer Applications, 2018, 34(7): 10-12.(in Chinese with English abstract)
[26] 杨东旭, 赖惠成, 班俊硕, 等. 基于改进DCNN结合迁移学习的图像分类方法[J]. 新疆大学学报(自然科学版), 2018, 35(2): 195-202.
YANG D X, LAI H C, BAN J S, et al. Image classification method based on improved DCNN combined transfer learning[J]. Journal of Xinjiang University(Natural Science Edition), 2018, 35(2): 195-202.(in Chinese with English abstract)
[27] 高旋, 赵亚凤, 熊强, 等. 基于迁移学习的树种识别[J]. 森林工程, 2019, 35(5): 68-75.
GAO X, ZHAO Y F, XIONG Q, et al. Identification of tree species based on transfer learning[J]. Forest Engineering, 2019, 35(5): 68-75.(in Chinese with English abstract)
[28] 柴帅, 李壮举. 基于迁移学习的番茄病虫害检测[J]. 计算机工程与设计, 2019, 40(6): 1701-1705.
CHAI S, LI Z J. Detection of tomato pests and diseases based on transfer learning[J]. Computer Engineering and Design, 2019, 40(6): 1701-1705.(in Chinese with English abstract)
[29] 冯海林, 胡明越, 杨垠晖, 等. 基于树木整体图像和集成迁移学习的树种识别[J]. 农业机械学报, 2019, 50(8): 235-242.
FENG H L, HU M Y, YANG Y H, et al. Tree species recognition based on overall tree image and ensemble of transfer learning[J]. Transactions of the Chinese Society for Agricultural Machinery, 2019, 50(8): 235-242.(in Chinese with English abstract)
[30] 张雪松, 庄严, 闫飞, 等. 基于迁移学习的类别级物体识别与检测研究与进展[J]. 自动化学报, 2019, 45(7): 1224-1243.
ZHANG X S, ZHUANG Y, YAN F, et al. Status and development of transfer learning based category-level object recognition and detection[J]. Acta Automatica Sinica, 2019, 45(7): 1224-1243.(in Chinese with English abstract)
[31] HUANG G B, ZHU Q Y, SIEW C K. Extreme learning machine: a new learning scheme of feedforward neural networks: a new learning scheme of feedforward neural networks[C]//2004 IEEE International Joint Conference on Neural Networks. Budapest, 2004.

Cotton recognition based on transfer learning

RichHTML

PDF (PC)

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

Comments

[1]	SHI Jing, LIU Dongyang, ZHANG Fenghua. Physiological response and salt tolerance mechanism of cotton seedlings to salt stress [J]. , 2020, 32(7): 1141-1148.
[2]	LI Yuancheng, SUN Hong, WU Yifei, YAO Xiaohong, SHEN Qi, TANG Jiangwu. Nutritional components and antioxidant activity of solid-state fermented cottonseed kernel [J]. , 2020, 32(4): 610-615.
[3]	ZHONG Weizhen, LIU Xinlei, YANG Kunlong, LI Fengguo. Research on multi-target leaf segmentation and recognition algorithm under complex background based on Mask-RCNN [J]. , 2020, 32(11): 2059-2066.
[4]	LIU Shanshan, WEI Xin, SHENG Furui, QIAO Qinghua. Variations of cotton rhizosphere microbial community in different growth stages [J]. , 2019, 31(8): 1361-1371.
[5]	MENG Qinglong, ZHANG Yan, SHANG Jing. Nondestructive recognition of surface defect on kiwifruits using hyperspectral imaging technology [J]. , 2019, 31(8): 1372-1378.
[6]	LIU Zhi, HE Zheng, MIAO Fangfang, JIA Biao. Method and experiment for estimating emergence rate of water and fertilizer integrated maize based on drone technology [J]. , 2019, 31(6): 977-985.
[7]	LIANG Changjiang, WU Xuemei, WANG Fang, SONG Zhujun, ZHANG Fugui. Research on recognition algorithm of field mulch film based on unmanned aerial vehicle [J]. , 2019, 31(6): 1005-1011.
[8]	LI Qi, ZHAO Jie, YANG Liu, WANG Jun, GAO Yixing. Cucumber leaf lesion identification based on GA-BP neural network and feature vector optimization combination [J]. , 2019, 31(3): 487-495.
[9]	YAN Jianwei, SU Xiaodong, ZHAO Yuan, LIU Jinping. Wheat germ sheath recognition based on image features [J]. , 2019, 31(2): 326-332.
[10]	ZHANG Xiying, LIU Jiangna, ZHANG Tingjun, ZHAO Zhansheng. Canonical correlation and path analysis on earliness and yield traits of sea-island cotton [J]. , 2018, 30(8): 1295-1302.
[11]	LIU Quanfeng, LIU Yongzhen, CAO Jinfeng, YANG Zhenli, ZHAI Yuzhu, LAI Deqiang, SUN Yi, LIU Zhenzhen. Effects of controlled release nitrogen fertilizer on yield and nitrogen use efficiency of cotton in fluvo-aquic soil of Bohai Sea Ring Area [J]. , 2018, 30(2): 275-279.
[12]	DENG Xiaolei, PAN Jingjing, ZHU Shuijin, CHEN Jinhong. Effect of extreme high temperature on boll yield traits, fiber quality and cottonseed kernel nutrient quality of iaaM transgenic germplasm of cotton in bolling stage [J]. , 2018, 30(11): 1805-1810.
[13]	WANG Xianfeng, DING Jun, ZHU Yihai. A forecasting method of cotton diseases and insect pests based on deep belief network with improved performance [J]. , 2018, 30(10): 1790-1797.
[14]	ZHAO Xueguan, WANG Xiu, LI Cuiling, GAO Yuanyuan, WANG Songlin, FENG Qingchun. Tomato seed varieties recognition based on principal component analysis and LVQ neural network [J]. , 2017, 29(8): 1375-1383.
[15]	LIU Yujiao, QIU Boyin, WANG Xiyan, XU Xiaojian, ZHU Shuijin, CHEN Jinhong. Advance of research on microRNA function in cotton (Gossypium hirsutum) [J]. , 2017, 29(6): 1050-1056.