z-logo
open-access-imgOpen Access
Semantic and context features integration for robust object tracking
Author(s) -
Yao Jinzhen,
Zhang Jianlin,
Wang Zhixing,
Shao Linsong
Publication year - 2022
Publication title -
iet image processing
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.401
H-Index - 45
eISSN - 1751-9667
pISSN - 1751-9659
DOI - 10.1049/ipr2.12407
Subject(s) - artificial intelligence , computer science , video tracking , computer vision , similarity (geometry) , context (archaeology) , object (grammar) , tracking (education) , feature (linguistics) , pattern recognition (psychology) , frame (networking) , scale (ratio) , image (mathematics) , geography , pedagogy , linguistics , philosophy , cartography , archaeology , psychology , telecommunications
Siamese network‐based object tracking learns features of a target object marked in the first frame and that of the object in subsequent frames simultaneously and then measures similarity between two features to recognize and locate the object. Owing to their efficiency and high accuracy, Siamese networks have attracted much attention recently. However, tracking accuracy decreases significantly when there are scale changes, occlusion, and pose variations due to the way that Siamese networks estimate feature similarity. To address this issue, the authors propose a tracking algorithm, named Semantic and context features integration for robust object tracking that integrates local and global features of the object. Local features provide context information for tracking parts of the object, while global features contain semantic information for tracking the object. The authors meticulously design local and global classification and regression heads and integrate them into one uniform framework to achieve integration tracking. This method effectively alleviates low accuracy in complex scenes such as scale changes, deformation, and occlusion. Numerous experiments demonstrate that this method achieves state‐of‐art (SOTA) performance with 45 FPS on a single RTX2060 Super GPU on public tracking datasets, including VOT2016, VOT2019, OTB100, GOT‐10k, and LaSOT, and its effectiveness and efficiency is confirmed.

The content you want is available to Zendy users.

Already have an account? Click here to sign in.
Having issues? You can contact us here