Apple stem/calyx recognition based on fringe projection

doi:10.3969/j.issn.1004-1524.2021.08.17

Acta Agriculturae Zhejiangensis ›› 2021, Vol. 33 ›› Issue (8): 1497-1504.DOI: 10.3969/j.issn.1004-1524.2021.08.17

• Biosystems Engineering • Previous Articles Next Articles

Apple stem/calyx recognition based on fringe projection

CAI Jiaxu¹(), WANG Fei¹, XI Dongdong¹, LIU Lu¹^,², WANG Yuwei¹^,²^,^*()

1. School of Engineering, Anhui Agricultural University, Hefei 230036, China
2. Anhui Province Engineering Laboratory of Intelligent Agricultural Machinery and Equipment, Hefei 230036, China

Received:2021-02-24 Online:2021-08-25 Published:2021-08-27
Contact: WANG Yuwei

Abstract

Abstract:

To avoid the interference of apple stem/calyx area on its surface defect detection, an apple stem/calyx recognition method is proposed in the present assay. Firstly, by taking use of phase-shifting fringe projection technology, the deflection phases of the reference plane under multiple angles are simulated with mathematical transformation. Secondly, the phase-height images under multiple angles are obtained by subtracting the deflection phases from the absolute phase of the apple. Based on the concavity characteristic of the stem/calyx, the phase-height images are filled with morphological grayscale algorithm to obtain the phase filled images. Finally, the phase difference images are computed by subtracting the phase-height images from the phase filled images, then the stem/calyx area can be accurately located through threshold segmentation. The experimental results demonstrate that the proposed method can effectively recognize the stem/calyx area of apple at different positions, and has good robustness and applicability with the recognition accuracy of 97.33%.

Key words: fringe projection, apple, phase, morphology

CLC Number:

TP391

CAI Jiaxu, WANG Fei, XI Dongdong, LIU Lu, WANG Yuwei. Apple stem/calyx recognition based on fringe projection[J]. Acta Agriculturae Zhejiangensis, 2021, 33(8): 1497-1504.

Figures/Tables 7

Fig.1 Photograph of fringe projection system

Fig.2 Principle of measurement system

Fig.3 Schematic of filling operation of grayscale morphology

Fig.4 Schematic of stem/calyx area filling a, c indicated the phase height image of apples, and the corresponding centerline profile, respectively; b, d indicated the phase filled image of apples, and the corresponding centerline profile, respectively; e, f indicated the phase difference image of apples, and the corresponding centerline profile, respectively.

Fig.5 Schematic of phase filling under multiple angles

Fig.6 Stem and calyx recognition results a, Original apple images; b, Phase height images; c, Phase difference images with edge; d, Recognition results.

Table 1 Statistical results of stem/calyx recognition accuracy

样本类别 Category	样本数 Sample size	正确样本数 Correct sample size	正确率 Correct rate/%
(1)	162	157	96.91
(2)	38	38	100
(3)	65	64	98.46
(4)	35	33	94.29
合计Total	300	292	97.33

References 21

[1]	郑燕, 张吉国, 史建民. 我国水果加工业发展现状、问题及对策[J]. 山东农业科学, 2014, 46(4):121-124.
	ZHENG Y, ZHANG J G, SHI J M. Development status, problems and countermeasures of fruit processing industry in China[J]. Shandong Agricultural Sciences, 2014, 46(4):121-124.(in Chinese with English abstract)
[2]	李龙, 彭彦昆, 李永玉, 等. 基于纹理和梯度特征的苹果伤痕与果梗/花萼在线识别[J]. 农业机械学报, 2018, 49(11):328-335.
	LI L, PENG Y K, LI Y Y, et al. Online identification of apple scarring and stems/calyxes based on texture and edge gradient features[J]. Transactions of the Chinese Society for Agricultural Machinery, 2018, 49(11):328-335.(in Chinese with English abstract)
[3]	GARCIA F, CERVANTES J, LÓPEZ A , et al. Fruit classification by extracting color chromaticity, shape and texture features: towards an application for supermarkets[J]. IEEE Latin America Transactions, 2016, 14(7):3434-3443. DOI URL
[4]	ZHANG B H, HUANG W Q, LI J B, et al. Principles, developments and applications of computer vision for external quality inspection of fruits and vegetables: a review[J]. Food Research International, 2014, 62:326-343. DOI URL
[5]	王福娟. 机器视觉技术在农产品分级分选中的应用[J]. 农机化研究, 2011, 33(5):249-252.
	WANG F J. Application of computer vision technique in farm produce classification and selection[J]. Journal of Agricultural Mechanization Research, 2011, 33(5):249-252.(in Chinese with English abstract)
[6]	张驰, 陈立平, 黄文倩, 等. 基于编码点阵结构光的苹果果梗/花萼在线识别[J]. 农业机械学报, 2015, 46(7):1-9.
	ZHANG C, CHEN L P, HUANG W Q, et al. On-line identification of apple stem-end/calyx based on coded spot-array structured light[J]. Transactions of the Chinese Society for Agricultural Machinery, 2015, 46(7):1-9.(in Chinese with English abstract)
[7]	田有文, 程怡, 王小奇, 等. 基于高光谱成像的苹果虫伤缺陷与果梗/花萼识别方法[J]. 农业工程学报, 2015, 31(4):325-331.
	TIAN Y W, CHENG Y, WANG X Q, et al. Recognition method of insect damage and stem/calyx on apple based on hyperspectral imaging[J]. Transactions of the Chinese Society of Agricultural Engineering, 2015, 31(4):325-331.(in Chinese with English abstract)
[8]	刘海彬, 高迎旺, 卢劲竹, 等. 基于激光散斑的梨缺陷与果梗/花萼的识别[J]. 农业工程学报, 2015, 31(4):319-324.
	LIU H B, GAO Y W, LU J Z, et al. Pear defect and stem/calyx discrimination using laser speckle[J]. Transactions of the Chinese Society of Agricultural Engineering, 2015, 31(4):319-324.(in Chinese with English abstract)
[9]	UNAY D, GOSSELIN B, KLEYNEN O, et al. Automatic grading of Bi-colored apples by multispectral machine vision[J]. Computers and Electronics in Agriculture, 2011, 75(1):204-212. DOI URL
[10]	UNAY D, GOSSELIN B. Stem and calyx recognition on ‘Jonagold’ apples by pattern recognition[J]. Journal of Food Engineering, 2007, 78(2):597-605. DOI URL
[11]	THROOP J A, ANESHANSLEY D J, ANGER W C, et al. Quality evaluation of apples based on surface defects: development of an automated inspection system[J]. Postharvest Biology and Technology, 2005, 36(3):281-290. DOI URL
[12]	LEEMANS V, DESTAIN M F. A real-time grading method of apples based on features extracted from defects[J]. Journal of Food Engineering, 2004, 61(1):83-89. DOI URL
[13]	ZHANG D, LILLYWHITE K D, LEE D J, et al. Automated apple stem end and calyx detection using evolution-constructed features[J]. Journal of Food Engineering, 2013, 119(3):411-418. DOI URL
[14]	LU Y Z, LI R, LU R F. Structured-illumination reflectance imaging (SIRI) for enhanced detection of fresh bruises in apples[J]. Postharvest Biology and Technology, 2016, 117:89-93. DOI URL
[15]	LU Y Z, LU R F. Structured-illumination reflectance imaging coupled with phase analysis techniques for surface profiling of apples[J]. Journal of Food Engineering, 2018, 232:11-20. DOI URL
[16]	YANG Q. Finding stalk and calyx of apples using structured lighting[J]. Computers and Electronics in Agriculture, 1993, 8(1):31-42. DOI URL
[17]	ZHANG B H, HUANG W Q, WANG C P, et al. Computer vision recognition of stem and calyxin apples using near-infrared linear-array structured light and 3D reconstruction[J]. Biosystems Engineering, 2015, 139:25-34. DOI URL
[18]	殷永凯, 张宗华, 刘晓利, 等. 条纹投影轮廓术系统模型与标定综述[J]. 红外与激光工程, 2020, 49(3):127-144.
	YIN Y K, ZHANG Z H, LIU X L, et al. Review of the system model and calibration for fringe projection profilometry[J]. Infrared and Laser Engineering, 2020, 49(3):127-144.(in Chinese with English abstract)
[19]	ZUO C, FENG S J, HUANG L, et al. Phase shifting algorithms for fringe projection profilometry: a review[J]. Optics and Lasers in Engineering, 2018, 109:23-59. DOI URL
[20]	ZUO C, HUANG L, ZHANG M L, et al. Temporal phase unwrapping algorithms for fringe projection profilometry: a comparative review[J]. Optics and Lasers in Engineering, 2016, 85:84-103. DOI URL
[21]	VINCENT L. Morphological grayscale reconstruction in image analysis: applications and efficient algorithms[J]. IEEE Transactions on Image Processing, 1993, 2(2):176-201. DOI URL

Apple stem/calyx recognition based on fringe projection

RichHTML

PDF (PC)

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 7

References 21

Related Articles 15

Recommended Articles

Metrics

Comments

[1]	XIE Fang, XIA Yingxia, SU Qiangjun, UWITUGABIYE Vestine, CHEN Zhaohe, ZHOU Gang. Observation of ultramicroscopic characteristics of three morphology of mycelium for Ophiocordyceps sinensis [J]. Acta Agriculturae Zhejiangensis, 2021, 33(5): 855-860.
[2]	CHEN Suo, HE Beibei, CHEN Qiwu, LI Li. Isolation and phylogenetic analysis of Tremella sanguinea and its fungal host [J]. Acta Agriculturae Zhejiangensis, 2021, 33(3): 447-453.
[3]	YANG Yiwei, XIAO Hua, CHEN Hu, XIAO Niejia, GUO Cheng. Structural characteristics of soil mite communities under different modes of rose-based agroforestry in Karst area [J]. Acta Agriculturae Zhejiangensis, 2021, 33(1): 112-121.
[4]	QIN Ling, ZHANG Xin, RONG Chunxiao, MO Chuanyuan, FAN Lu, YAN Jie, MENG Ying, ZHANG Manrang. Identification and expression analysis of polyamine oxidase (PAO) gene family in apple [J]. , 2020, 32(2): 262-273.
[5]	MA Ruifang, MA Jinchuan, MA Junwei, ZHOU Dayun, WANG Qiang, DING Chaohong. Growth dynamic and nutrient uptake law of common bean cultivar Liyun 2 [J]. , 2020, 32(1): 80-85.
[6]	ZHANG Hanqing, LIU Ruiling, WU Weijie, DENG Shanggui, GAO Haiyan, CHEN Hangjun. Effect of apple polyphenols on quality and browning of fresh-cut lotus root [J]. , 2019, 31(9): 1549-1554.
[7]	LI Lu, HAN Qiang, WU Weijie, FANG Xiangjun, GAO Haiyan. Optimization of drying process of blueberry-apple reconstituted fruit cake and its influence on quality [J]. , 2019, 31(5): 816-822.
[8]	YU Chun, XU Dong, HUANG Wei, LEI Minghong, WAN Peng. Effects of lunar phase and temperature on population dynamics of adult Pectinophora gossypiella Saunders [J]. , 2019, 31(2): 260-267.
[9]	ZHOU Huiming, ZHANG Yanzhen, CHAI Hongmei, YANG Rongqing, TAN Ying, ZHANG Pingping, BAI Yuying, ZHAO Yilian, JIN Yujie. Identification and culture conditions of a wild-type Termitomyces aurantiacus strain from Lincang [J]. , 2019, 31(10): 1655-1662.
[10]	LI Zengwei, WANG Na, LEI Chan, ZENG Yue, FU Zhenzhen, HE Li, LIU Shuliang, ZHOU Kang, AO Xiaolin, CHEN Shujuan. Preparation of magnetic molecularly imprinted polymer and detection of chloramphenicol in foods [J]. , 2018, 30(6): 1063-1072.
[11]	TONG Jing, LI Suyan, SUN Xiangyang, LIU Kefeng, WANG Hongwei, YANG Meiyan. Effects of phosphorus fertilizing on growth and root morphology of Salvia splendens var. Chengxiang Gongzhu [J]. , 2018, 30(3): 386-392.
[12]	FU Zhenzhen, ZENG Yue, LI Zengwei, HE Li, ZHOU Kang, LIU Shuliang, ZOU Likou, AO Xiaolin, CHEN Shujuan. Determination of tetracycline antibiotics residues in milk by molecularly imprinted solid phase extraction-high performance liquid chromatography [J]. , 2018, 30(2): 314-322.
[13]	ZHANG Lizhi, FAN Sheng, AN Na, ZUO Xiya, GAO Cai, ZHANG Dong, HAN Mingyu. Identification and expression analysis of PAL gene family in apple [J]. , 2018, 30(12): 2031-2043.
[14]	LYU Zhihang, XU Weihui, WANG Zhigang, WANG Chunlong, LIU Zeping, CHEN Wenjing, SHI Yiran. Isolation, identification, and inhibition charateristics of a Fusarium oxysporum f. sp. niveum inhibiting strain [J]. , 2018, 30(12): 2065-2071.
[15]	ZHONG Rui, JIANG Yaozhang, MA Xiaoping, ZUO Zhicai, HUANG Xiaoli, DENG Junliang, SHEN Liuhong, YU Shumin. Isolation, identification and drug sensitive test of Trichosporon loubieri from beef cattle [J]. , 2018, 30(1): 26-35.