Premium
A vision system for canning with fish sensing using rule‐based matching and segmentation
Author(s) -
Zhang Yi,
You Mengbo,
Miyoshi Tasuku,
Akashi Takuya
Publication year - 2020
Publication title -
ieej transactions on electrical and electronic engineering
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.254
H-Index - 30
eISSN - 1931-4981
pISSN - 1931-4973
DOI - 10.1002/tee.23139
Subject(s) - matching (statistics) , artificial intelligence , segmentation , computer science , factory (object oriented programming) , computer vision , fish <actinopterygii> , robot , graph , similarity (geometry) , machine vision , pattern recognition (psychology) , image (mathematics) , mathematics , statistics , theoretical computer science , fishery , biology , programming language
We develop a machine vision system as a key component of a robot‐assisted packaging system, which can guide the robot arms to pack the roast sauries into cans. For gripping strategy generation, the system is required not only to be able to detect the roast saury area but also estimate the geometric parameters. Besides, according to different canning requirements, it is also necessary to distinguish the type of fish parts. Facing these challenges, we propose a novel rule‐based matching method combined with an improved efficient graph‐based image segmentation (EGIS) method for sensing the fish part. Specifically, the matching method applies our originally designed rule‐based similarity under a genetic algorithm framework combined with deterministic crowding technique, which is used to sensing one type of fish parts. On the other hand, we improve the EGIS by introducing a shape restriction to deal with leftover fish parts. The experiments are implemented for two different types of fish part in the real factory environment. The result of our method achieved a mean location accuracy of 93.5% with a practical average processing time of 2.6 s per image. © 2020 Institute of Electrical Engineers of Japan. Published by John Wiley & Sons, Inc.