Fruit variety recognition based on parallel convolutional neural network

doi:10.3969/j.issn.1004-1524.2022.11.22

Acta Agriculturae Zhejiangensis ›› 2022, Vol. 34 ›› Issue (11): 2533-2541.DOI: 10.3969/j.issn.1004-1524.2022.11.22

• Biosystems Engineering • Previous Articles Next Articles

Fruit variety recognition based on parallel convolutional neural network

LI Chao(), LI Feng(), HUANG Weijia

College of Electronic Information, Jiangsu University of Science and Technology, Zhenjiang 212000, Jiangsu, China

Received:2020-11-16 Online:2022-11-25 Published:2022-11-29
Contact: LI Feng

Abstract

Abstract:

In order to solve the defects of traditional fruit image recognition algorithms in feature extraction and the low recognition accuracy of traditional convolutional neural networks, a parallel convolutional neural network was proposed to extract fruit features. ELU activation function was introduced instead of ReLU activation function in the proposed model. Besides, a combination of maximum class spacing loss function and the traditional SoftmaxWithLoss loss function was designed to improve the recognition accuracy of similar varieties. The data of 8 fruit varieties in Fruit-360 data set was selected in the present study, and enhanced by the boundary equilibrium generative adversarial network (BEGAN) combined with the traditional data augmentation to generate a large number of high-quality data for model training. It was shown that the average recognition accuracy of 8 fruit varieties reached 98.85% and exhibited good recognition effect.

Key words: image recognition, deep learning, boundary equilibrium generative adversarial network, convolution neural network

CLC Number:

S126
TP391

LI Chao, LI Feng, HUANG Weijia. Fruit variety recognition based on parallel convolutional neural network[J]. Acta Agriculturae Zhejiangensis, 2022, 34(11): 2533-2541.

Figures/Tables 15

References 18

[1]	吕秋霞, 张景鸿. 基于神经网络的水果自动分类系统设计[J]. 安徽农业科学, 2009, 37(35): 17392-17394.
	LYU Q X, ZHANG J H. Design of a fruit automatic classification system based on neural network[J]. Journal of Anhui Agricultural Sciences, 2009, 37(35): 17392-17394. (in Chinese with English abstract)
[2]	陈源, 张长江. 水果自动识别的BP神经网络方法[J]. 微型机与应用, 2010, 29(22): 40-43.
	CHEN Y, ZHANG C J. Automatic recognition for fruit based on BP neural network[J]. Microcomputer & Its Applications, 2010, 29(22): 40-43. (in Chinese with English abstract)
[3]	王水平, 唐振民, 范春年, 等. 基于SVM的水果分类算法研究[J]. 武汉理工大学学报, 2010, 32(16): 44-47.
	WANG S P, TANG Z M, FAN C N, et al. Recognition algorithm of fruits based on SVM[J]. Journal of Wuhan University of Technology, 2010, 32(16): 44-47. (in Chinese with English abstract)
[4]	董立岩, 苑森淼, 刘光远, 等. 基于贝叶斯分类器的图像分类[J]. 吉林大学学报(理学版), 2007, 45(2): 249-253.
	DONG L Y, YUAN S M, LIU G Y, et al. Image classification based on Bayesian classifier[J]. Journal of Jilin University (Science Edition), 2007, 45(2): 249-253. (in Chinese with English abstract)
[5]	余肖生, 周宁, 张芳芳. 基于KNN的图像自动分类模型研究[J]. 中国图书馆学报, 2007, 33(1): 74-76.
	YU X S, ZHOU N, ZHANG F F. A KNN-based model for automatic image categorization[J]. Journal of Library Science in China, 2007, 33(1): 74-76. (in Chinese with English abstract)
[6]	DENG L M, LUAN T, MA W J. Research on maize varieties recognition system based on image processing[J]. Applied Mechanics and Materials, 2013, 397/398/399/400: 2335-2339.
[7]	王彦翔, 张艳, 杨成娅, 等. 基于深度学习的农作物病害图像识别技术进展[J]. 浙江农业学报, 2019, 31(4): 669-676. DOI
	WANG Y X, ZHANG Y, YANG C Y, et al. Advances in new nondestructive detection and identification techniques of crop diseases based on deep learning[J]. Acta Agriculturae Zhejiangensis, 2019, 31(4): 669-676. (in Chinese with English abstract) DOI
[8]	SZEGEDY C, LIU W, JIA Y Q, et al. Going deeper with convolutions[C]// 2015 IEEE Conference on Computer Vision and Pattern Recognition. Boston, MA, USA: IEEE, 2015: 1-9.
[9]	SIMONYAN K, ZISSERMAN A. Very deep convolutional networks for large-scale image recognition[EB/OL].(2004-09-04)[2020-11-16]. http://arxiv.org/pdf/1409.1556v6.pdf.
[10]	HE K M, ZHANG X Y, REN S Q, et al. Deep residual learning for image recognition[C]// 2016 IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas, NV, USA: IEEE, 2016: 770-778.
[11]	程荣花, 马飞, 梁亚红. 形状相似水果自动化识别研究[J]. 山东农业科学, 2015, 47(8): 116-118.
	CHENG R H, MA F, LIANG Y H. Research on automatic recognition of shape similar fruits[J]. Shandong Agricultural Sciences, 2015, 47(8): 116-118. (in Chinese with English abstract)
[12]	曾平平, 李林升. 基于卷积神经网络的水果图像分类识别研究[J]. 机械设计与研究, 2019, 35(1): 23-26.
	ZENG P P, LI L S. Classification and recognition of common fruit images based on convolutional neural network[J]. Machine Design & Research, 2019, 35(1): 23-26. (in Chinese with English abstract)
[13]	徐岩, 刘林, 李中远, 等. 基于卷积神经网络的玉米品种识别[J]. 江苏农业学报, 2020, 36(1): 18-23.
	XU Y, LIU L, LI Z Y, et al. Recognition of maize varieties based on convolutional neural network[J]. Jiangsu Journal of Agricultural Sciences, 2020, 36(1): 18-23. (in Chinese with English abstract)
[14]	许伟栋, 赵忠盖. 基于卷积神经网络和支持向量机算法的马铃薯表面缺陷检测[J]. 江苏农业学报, 2018, 34(6): 1378-1385.
	XU W D, ZHAO Z G. Potato surface defects detection based on convolution neural networks and support vector machine algorithm[J]. Jiangsu Journal of Agricultural Sciences, 2018, 34(6): 1378-1385. (in Chinese with English abstract)
[15]	HUANG B, CHEN W H, WU X M, et al. High-quality face image generated with conditional boundary equilibrium generative adversarial networks[J]. Pattern Recognition Letters, 2018, 111: 72-79. DOI URL
[16]	白玉, 姜东民, 裴加军, 等. 改进的ELU卷积神经网络在SAR图像舰船检测中的应用[J]. 测绘通报, 2018(1): 125-128.
	BAI Y, JIANG D M, PEI J J, et al. Application of an improved ELU convolution neural network in the SAR image ship detection[J]. Bulletin of Surveying and Mapping, 2018(1): 125-128. (in Chinese with English abstract)
[17]	LEBEDEV V, LEMPITSKY V. Speeding up convolutional neural networks: a survey[J]. Bulletin of the Polish Academy of Sciences: Technical Sciences, 2018, 66(6): 799-811.
[18]	周飞燕, 金林鹏, 董军. 卷积神经网络研究综述[J]. 计算机学报, 2017, 40(6): 1229-1251.
	ZHOU F Y, JIN L P, DONG J. Review of convolutional neural network[J]. Chinese Journal of Computers, 2017, 40(6): 1229-1251. (in Chinese with English abstract)

类别 Category	传统数据增强 Traditional data enhancement	基于BEGAN的数据增强 Data enhancement via BEGAN
布瑞本苹果	93.25	95.51
Apple Braeburn
红雪苹果	93.40	95.49
Apple Crimson Snow
金色苹果2	93.26	96.13
Apple Golden2
金色苹果3	93.34	95.48
Apple Golden3
樱桃1 Cherry1	93.58	95.46
樱桃2 Cherry2	94.01	96.21
Rainer樱桃	94.12	95.45
Cherry Rainer
蜡黑樱桃	93.11	95.56
Cherry Wax Black

类别 Category	传统数据增强 Traditional data enhancement	基于BEGAN的数据增强 Data enhancement via BEGAN
布瑞本苹果	93.25	95.51
Apple Braeburn
红雪苹果	93.40	95.49
Apple Crimson Snow
金色苹果2	93.26	96.13
Apple Golden2
金色苹果3	93.34	95.48
Apple Golden3
樱桃1 Cherry1	93.58	95.46
樱桃2 Cherry2	94.01	96.21
Rainer樱桃	94.12	95.45
Cherry Rainer
蜡黑樱桃	93.11	95.56
Cherry Wax Black

类别 Category	旧损失函数 Old loss function	新损失函数 New loss function
布瑞本苹果Apple Braeburn	98.30	98.31
红雪苹果Apple Crimson Snow	97.59	99.50
金色苹果2 Apple Golden2	97.15	98.90
金色苹果3 Apple Golden3	97.80	97.85
樱桃1 Cherry1	98.41	99.45
樱桃2 Cherry2	97.73	98.79
Rainer樱桃Cherry Rainer	98.10	99.15
蜡黑樱桃Cherry Wax Black	97.86	98.86

类别 Category	旧损失函数 Old loss function	新损失函数 New loss function
布瑞本苹果Apple Braeburn	98.30	98.31
红雪苹果Apple Crimson Snow	97.59	99.50
金色苹果2 Apple Golden2	97.15	98.90
金色苹果3 Apple Golden3	97.80	97.85
樱桃1 Cherry1	98.41	99.45
樱桃2 Cherry2	97.73	98.79
Rainer樱桃Cherry Rainer	98.10	99.15
蜡黑樱桃Cherry Wax Black	97.86	98.86

模型 Model	准确率 Accuracy
舍去a通道的单只CNN Single CNN without channel a	97.10
特征加强+BP神经网络^[5] Feature enhancement+BP neural network	98.60
形状相似的水果自动识别研究^[11] Automatic recognition of fruits with similar shape	93.00
特征提取+单只CNN^[13] Feature extraction+single CNN	95.49
本文模型Proposed model	98.85

Fruit variety recognition based on parallel convolutional neural network

RichHTML

PDF (PC)

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 15

References 18

Related Articles 15

Recommended Articles

Metrics

Comments

[1]	LYU Yinchun, DUAN Enze, ZHU Yixing, ZHENG Xia, BAI Zongchun. Real-time detection of overturned meat ducks based on YOLOv8-Swin Transformer model [J]. Acta Agriculturae Zhejiangensis, 2025, 37(7): 1556-1566.
[2]	ZHENG Hang, FENG Haodong, XUE Xianglei, YE Yunxiang, YU Jianlin, YU Guohong. Study on navigation line extraction algorithm for leaf vegetable ridges based on instance segmentations [J]. Acta Agriculturae Zhejiangensis, 2025, 37(3): 701-711.
[3]	CHENG Jiayu, CHEN Miaojin, LI Tong, SUN Qinan, ZHANG Xiaobin, ZHAO Yiying, ZHU Yihang, GU Qing. Detection of peach trees in unmanned aerial vehicle (UAV) images based on improved Faster-RCNN network [J]. Acta Agriculturae Zhejiangensis, 2024, 36(8): 1909-1919.
[4]	PAN Pan, ZHANG Jianhua, ZHENG Xiaoming, ZHOU Guomin, HU Lin, FENG Quan, CHAI Xiujuan. Research progress of deep learning in intelligent identification of disease resistance of crops and their related species [J]. Acta Agriculturae Zhejiangensis, 2023, 35(8): 1993-2012.
[5]	BAI Weiwei, ZHAO Xueni, LUO Bin, ZHAO Wei, HUANG Shuo, ZHANG Han. Study of YOLOv5-based germination detection method for wheat seeds [J]. Acta Agriculturae Zhejiangensis, 2023, 35(2): 445-454.
[6]	ZHU Shisong, MA Wanli, ZHAO Lishan, ZHENG Yanmei, ZHENG Xianbo, LU Bibo. Apple leaf image segmentation algorithm based on improved LinkNet [J]. Acta Agriculturae Zhejiangensis, 2023, 35(1): 202-214.
[7]	CHEN Daohuai, WANG Hangjun. Detection of forest pests based on improved YOLOv4 [J]. Acta Agriculturae Zhejiangensis, 2022, 34(6): 1306-1315.
[8]	LIN Xiaoteng, SUN Qian, ZHENG Shuhe. Design and experiment of energy-saving lighting system for plant factory based on OpenCV [J]. Acta Agriculturae Zhejiangensis, 2022, 34(3): 626-635.
[9]	ZHANG Qingqing, LIU Lianzhong, NING Jingming, WU Guodong, JIANG Zhaohui, LI Mengjie, LI Dongliang. Tea buds recognition under complex scenes based on optimized YOLOV3 model [J]. Acta Agriculturae Zhejiangensis, 2021, 33(9): 1740-1747.
[10]	BAO Lie, WANG Mantao, LIU Jiangchuan, WEN Bo, MING Yue. Estimation method of wheat yield based on convolution neural network [J]. Acta Agriculturae Zhejiangensis, 2020, 32(12): 2244-2252.
[11]	JIANG Fengqian, LI Yang, YU Dawei, SUN Min, ZHANG Enbao. Soybean disease detection system based on convolutional neural network under Caffe framework [J]. , 2019, 31(7): 1177-1183.
[12]	LIU Zhi, HE Zheng, MIAO Fangfang, JIA Biao. Method and experiment for estimating emergence rate of water and fertilizer integrated maize based on drone technology [J]. , 2019, 31(6): 977-985.
[13]	WANG Yanxiang, ZHANG Yan, YANG Chengya, MENG Qinglong, SHANG Jing. Advances in new nondestructive detection and identification techniques of crop diseases based on deep learning [J]. , 2019, 31(4): 669-676.
[14]	JIN Xiu, LU Jie, FU Yunzhi, WANG Shuai, XU Gaojian, LI Shaowen. A classification method for hyperspectral imaging of Fusarium head blight disease symptom based on deep convolutional neural network [J]. , 2019, 31(2): 315-325.
[15]	YANG Guoliang, XU Nan, KANG Lele, GONG Man, HONG Zhiyang. Identification of navel orange lesions leaves based on parametric exponential non-linear residual neural network [J]. , 2018, 30(6): 1073-1081.