Instance Mask Growing on Leaf
Chuang Yang (Northwestern Polytechnical University), Haozhao Ma (Northwestern Polytechnical University), Qi Wang (Northwestern Polytechnical University)*
The 34th British Machine Vision Conference
Abstract
Contour-based instance segmentation methods represent masks through a series of points. However, the point number is fixed once the model is trained, which limits the model's flexibility in dealing with various instances. We follow this issue and present an idea to predict an appropriate number of points dynamically according to instance shapes. Concretely, we observe that the leaf locates coarse margins via major veins and grows minor veins to refine twisty parts, which helps cover any masks accurately. Meanwhile, major and minor veins share the same growth mode, which makes it possible to generate minor veins dynamically according to the trained major vein mode. Considering the superiorities above, we propose VeinMask to formulate the instance segmentation problem as the simulation of the vein growth process and to predict the major and minor veins in polar coordinates for instance segmenting. Besides, centroidness is introduced for instance segmentation tasks to help suppress low-quality instances. Furthermore, a surroundings cross-correlation sensitive (SCCS) module is designed to enhance the feature expression by utilizing the surroundings of each pixel. Additionally, a Residual IoU (RIoU) loss is formulated to supervise the regression tasks of major and minor veins effectively. Experiments demonstrate the effectiveness of VeinMask. Particularly, our method outperforms existing one-stage contour-based methods on the COCO dataset with almost half the trained point number. Code is available at: \url{https://github.com/omtcyang/veinmask}.Video
Citation
@inproceedings{Yang_2023_BMVC,
author = {Chuang Yang and Haozhao Ma and Qi Wang},
title = {Instance Mask Growing on Leaf},
booktitle = {34th British Machine Vision Conference 2023, {BMVC} 2023, Aberdeen, UK, November 20-24, 2023},
publisher = {BMVA},
year = {2023},
url = {https://papers.bmvc2023.org/0004.pdf}
}
Copyright © 2023
The British Machine Vision Conference is organised by