Apple stem/calyx recognition based on fringe projection

doi:10.3969/j.issn.1004-1524.2021.08.17

Acta Agriculturae Zhejiangensis ›› 2021, Vol. 33 ›› Issue (8): 1497-1504.DOI: 10.3969/j.issn.1004-1524.2021.08.17

• Biosystems Engineering • Previous Articles Next Articles

Apple stem/calyx recognition based on fringe projection

CAI Jiaxu¹(), WANG Fei¹, XI Dongdong¹, LIU Lu¹^,², WANG Yuwei¹^,²^,^*()

1. School of Engineering, Anhui Agricultural University, Hefei 230036, China
2. Anhui Province Engineering Laboratory of Intelligent Agricultural Machinery and Equipment, Hefei 230036, China

Received:2021-02-24 Online:2021-08-25 Published:2021-08-27
Contact: WANG Yuwei

Abstract

Abstract:

To avoid the interference of apple stem/calyx area on its surface defect detection, an apple stem/calyx recognition method is proposed in the present assay. Firstly, by taking use of phase-shifting fringe projection technology, the deflection phases of the reference plane under multiple angles are simulated with mathematical transformation. Secondly, the phase-height images under multiple angles are obtained by subtracting the deflection phases from the absolute phase of the apple. Based on the concavity characteristic of the stem/calyx, the phase-height images are filled with morphological grayscale algorithm to obtain the phase filled images. Finally, the phase difference images are computed by subtracting the phase-height images from the phase filled images, then the stem/calyx area can be accurately located through threshold segmentation. The experimental results demonstrate that the proposed method can effectively recognize the stem/calyx area of apple at different positions, and has good robustness and applicability with the recognition accuracy of 97.33%.

Key words: fringe projection, apple, phase, morphology

CLC Number:

TP391

CAI Jiaxu, WANG Fei, XI Dongdong, LIU Lu, WANG Yuwei. Apple stem/calyx recognition based on fringe projection[J]. Acta Agriculturae Zhejiangensis, 2021, 33(8): 1497-1504.

Figures/Tables 7

Fig.1 Photograph of fringe projection system

Fig.2 Principle of measurement system

Fig.3 Schematic of filling operation of grayscale morphology

Fig.4 Schematic of stem/calyx area filling a, c indicated the phase height image of apples, and the corresponding centerline profile, respectively; b, d indicated the phase filled image of apples, and the corresponding centerline profile, respectively; e, f indicated the phase difference image of apples, and the corresponding centerline profile, respectively.

Fig.5 Schematic of phase filling under multiple angles

Fig.6 Stem and calyx recognition results a, Original apple images; b, Phase height images; c, Phase difference images with edge; d, Recognition results.

Table 1 Statistical results of stem/calyx recognition accuracy

样本类别 Category	样本数 Sample size	正确样本数 Correct sample size	正确率 Correct rate/%
(1)	162	157	96.91
(2)	38	38	100
(3)	65	64	98.46
(4)	35	33	94.29
合计Total	300	292	97.33

References 21

[1]	郑燕, 张吉国, 史建民. 我国水果加工业发展现状、问题及对策[J]. 山东农业科学, 2014, 46(4):121-124.
	ZHENG Y, ZHANG J G, SHI J M. Development status, problems and countermeasures of fruit processing industry in China[J]. Shandong Agricultural Sciences, 2014, 46(4):121-124.(in Chinese with English abstract)
[2]	李龙, 彭彦昆, 李永玉, 等. 基于纹理和梯度特征的苹果伤痕与果梗/花萼在线识别[J]. 农业机械学报, 2018, 49(11):328-335.
	LI L, PENG Y K, LI Y Y, et al. Online identification of apple scarring and stems/calyxes based on texture and edge gradient features[J]. Transactions of the Chinese Society for Agricultural Machinery, 2018, 49(11):328-335.(in Chinese with English abstract)
[3]	GARCIA F, CERVANTES J, LÓPEZ A , et al. Fruit classification by extracting color chromaticity, shape and texture features: towards an application for supermarkets[J]. IEEE Latin America Transactions, 2016, 14(7):3434-3443. DOI URL
[4]	ZHANG B H, HUANG W Q, LI J B, et al. Principles, developments and applications of computer vision for external quality inspection of fruits and vegetables: a review[J]. Food Research International, 2014, 62:326-343. DOI URL
[5]	王福娟. 机器视觉技术在农产品分级分选中的应用[J]. 农机化研究, 2011, 33(5):249-252.
	WANG F J. Application of computer vision technique in farm produce classification and selection[J]. Journal of Agricultural Mechanization Research, 2011, 33(5):249-252.(in Chinese with English abstract)
[6]	张驰, 陈立平, 黄文倩, 等. 基于编码点阵结构光的苹果果梗/花萼在线识别[J]. 农业机械学报, 2015, 46(7):1-9.
	ZHANG C, CHEN L P, HUANG W Q, et al. On-line identification of apple stem-end/calyx based on coded spot-array structured light[J]. Transactions of the Chinese Society for Agricultural Machinery, 2015, 46(7):1-9.(in Chinese with English abstract)
[7]	田有文, 程怡, 王小奇, 等. 基于高光谱成像的苹果虫伤缺陷与果梗/花萼识别方法[J]. 农业工程学报, 2015, 31(4):325-331.
	TIAN Y W, CHENG Y, WANG X Q, et al. Recognition method of insect damage and stem/calyx on apple based on hyperspectral imaging[J]. Transactions of the Chinese Society of Agricultural Engineering, 2015, 31(4):325-331.(in Chinese with English abstract)
[8]	刘海彬, 高迎旺, 卢劲竹, 等. 基于激光散斑的梨缺陷与果梗/花萼的识别[J]. 农业工程学报, 2015, 31(4):319-324.
	LIU H B, GAO Y W, LU J Z, et al. Pear defect and stem/calyx discrimination using laser speckle[J]. Transactions of the Chinese Society of Agricultural Engineering, 2015, 31(4):319-324.(in Chinese with English abstract)
[9]	UNAY D, GOSSELIN B, KLEYNEN O, et al. Automatic grading of Bi-colored apples by multispectral machine vision[J]. Computers and Electronics in Agriculture, 2011, 75(1):204-212. DOI URL
[10]	UNAY D, GOSSELIN B. Stem and calyx recognition on ‘Jonagold’ apples by pattern recognition[J]. Journal of Food Engineering, 2007, 78(2):597-605. DOI URL
[11]	THROOP J A, ANESHANSLEY D J, ANGER W C, et al. Quality evaluation of apples based on surface defects: development of an automated inspection system[J]. Postharvest Biology and Technology, 2005, 36(3):281-290. DOI URL
[12]	LEEMANS V, DESTAIN M F. A real-time grading method of apples based on features extracted from defects[J]. Journal of Food Engineering, 2004, 61(1):83-89. DOI URL
[13]	ZHANG D, LILLYWHITE K D, LEE D J, et al. Automated apple stem end and calyx detection using evolution-constructed features[J]. Journal of Food Engineering, 2013, 119(3):411-418. DOI URL
[14]	LU Y Z, LI R, LU R F. Structured-illumination reflectance imaging (SIRI) for enhanced detection of fresh bruises in apples[J]. Postharvest Biology and Technology, 2016, 117:89-93. DOI URL
[15]	LU Y Z, LU R F. Structured-illumination reflectance imaging coupled with phase analysis techniques for surface profiling of apples[J]. Journal of Food Engineering, 2018, 232:11-20. DOI URL
[16]	YANG Q. Finding stalk and calyx of apples using structured lighting[J]. Computers and Electronics in Agriculture, 1993, 8(1):31-42. DOI URL
[17]	ZHANG B H, HUANG W Q, WANG C P, et al. Computer vision recognition of stem and calyxin apples using near-infrared linear-array structured light and 3D reconstruction[J]. Biosystems Engineering, 2015, 139:25-34. DOI URL
[18]	殷永凯, 张宗华, 刘晓利, 等. 条纹投影轮廓术系统模型与标定综述[J]. 红外与激光工程, 2020, 49(3):127-144.
	YIN Y K, ZHANG Z H, LIU X L, et al. Review of the system model and calibration for fringe projection profilometry[J]. Infrared and Laser Engineering, 2020, 49(3):127-144.(in Chinese with English abstract)
[19]	ZUO C, FENG S J, HUANG L, et al. Phase shifting algorithms for fringe projection profilometry: a review[J]. Optics and Lasers in Engineering, 2018, 109:23-59. DOI URL
[20]	ZUO C, HUANG L, ZHANG M L, et al. Temporal phase unwrapping algorithms for fringe projection profilometry: a comparative review[J]. Optics and Lasers in Engineering, 2016, 85:84-103. DOI URL
[21]	VINCENT L. Morphological grayscale reconstruction in image analysis: applications and efficient algorithms[J]. IEEE Transactions on Image Processing, 1993, 2(2):176-201. DOI URL

Apple stem/calyx recognition based on fringe projection

RichHTML

PDF (PC)

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 7

References 21

Related Articles 15

Recommended Articles

Metrics

Comments

[1]	CHEN Min, ZHANG Qiaoyan, WANG Xiajun, WANG Shunli, ZHENG Weiran. Determination of arbutin in plant-derived products by solid phase extraction-high performance liquid chromatography [J]. Acta Agriculturae Zhejiangensis, 2025, 37(8): 1776-1784.
[2]	ZHANG Chuni, XU Jidong, GAO Qin, SHAN Ying, FANG Weihuan, LI Xiaoliang. The molecular mechanism of inhibition of butyric acid to inhibit porcine epidemic diarrhea virus replication in vitro [J]. Acta Agriculturae Zhejiangensis, 2025, 37(3): 579-590.
[3]	SHEN Lan, YANG Xiaofang, ZHANG Guofang. Identification and fungicide sensitivity of the pathogen causing root rot on strawberry [J]. Acta Agriculturae Zhejiangensis, 2025, 37(2): 417-425.
[4]	WANG Miaomiao, QIN Jiaze, GUO Jiaqi, YU Tiancheng. Studies on flowering characteristics and breeding system of Dendrobium moschatum [J]. Acta Agriculturae Zhejiangensis, 2025, 37(1): 103-114.
[5]	LIAO Zhenfeng, SONG Xijiao, SHEN Mengmeng, XIAO Bin, ZHOU Yuan. Morphological characteristics of Aquilegia pollen grains from six species under different sample preparation methods [J]. Acta Agriculturae Zhejiangensis, 2025, 37(1): 67-77.
[6]	MIN Jiangyan, TANG Zhuolei, YANG Xue, HUANG Xiaoyan, HUANG Kaifeng, HE Peiyun. Effect of different drought-rewatering modes on growth and yield of Tartary buckwheat [J]. Acta Agriculturae Zhejiangensis, 2024, 36(9): 2000-2009.
[7]	GUO Weiliang, WU Jian, ZHANG Xingyilong, WU Kejing, XIE Jiajia, FENG Hailin. Preparation of high-value furan platform compounds from Zizania latifolia stem [J]. Acta Agriculturae Zhejiangensis, 2024, 36(4): 870-880.
[8]	WANG Miaomiao, QIN Jiaze. Volatile components in flowers of 5 rare and endangered orchids [J]. Acta Agriculturae Zhejiangensis, 2024, 36(12): 2727-2738.
[9]	LU Lanfei, ZHAO Xueping, MA Zheng, FANG Nan, LUO Yuqin, WANG Xiaomei, YE Hui, LEI Yuan, WANG Qiang, ZHANG Changpeng. Determination of 2, 4-epibrassinolide residues in Dendrobium officinale by solid phase extraction-high performance liquid chromatography-mass spectrometry [J]. Acta Agriculturae Zhejiangensis, 2023, 35(8): 1896-1903.
[10]	CUI Yuzhao, YAN Dongyun, WANG Wenhao, TAN Huiting, SUN Wei. Effects of different calcium preparations on postharvest storage quality of Yanfu 3 apple fruit [J]. Acta Agriculturae Zhejiangensis, 2023, 35(7): 1582-1590.
[11]	WANG Xiaoyan, HAN Yanchao, WU Weijie, DENG Shanggui, CHEN Hangjun, FANG Xiangjun, GAO Haiyan. Effects of different drying methods on quality and volatile flavor of pineapple [J]. Acta Agriculturae Zhejiangensis, 2023, 35(5): 1168-1177.
[12]	ZHU Shisong, MA Wanli, ZHAO Lishan, ZHENG Yanmei, ZHENG Xianbo, LU Bibo. Apple leaf image segmentation algorithm based on improved LinkNet [J]. Acta Agriculturae Zhejiangensis, 2023, 35(1): 202-214.
[13]	ZHU Shijun, JIN Shuquan, YAO Hongyan, XU Zhihao, LUO Youjun, CHEN Ruoxia. Effects of different basal fertilizers and topdressing fertilizers on growth, yield and quality of pineapple [J]. Acta Agriculturae Zhejiangensis, 2022, 34(6): 1217-1226.
[14]	ZHANG Biyun, CHENG Ping, LI Hong, WU Shengli, ZHANG Zhigang. Sap flow change rules of apple tree under different irrigation amounts and its influencing factors [J]. Acta Agriculturae Zhejiangensis, 2022, 34(4): 736-745.
[15]	WU Tao, WEI Yuming, JIANG Xiaofan, HUANG Jie, YANG Farong, CHEN Guoshun, CAI Yuan, JIAO Ting, ZHAO Shenguo. Effects of Chenopodium quinoa in diets on growth performance, slaughter performance, organ index and intestinal morphology of Luhua chickens [J]. Acta Agriculturae Zhejiangensis, 2022, 34(2): 255-265.