Local-Global Context Aware Transformer for Language-Guided Video Segmentation

2024-06-13 Vistors:10

作者:Liang Chen, Wang Wenguan, Yang Yi

来源:IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE :45 :8 :10055 - 10069 出版时间:AUG 2023

In this article, a local-global context aware Transformer (Locater) is devised to capture both short- and long-term context and encourage visual-linguistic alignment in language-guided video segmentation. By incorporating an extra memory into the Transformer architecture, Locater persistently preserves global video content while dynamically gathering local temporal context and segmentation history. Locater won 1st place in Referring Video Object Segmentation Track of 3rd Large-scale Video Object Segmentation Challenge at CVPR 2021 and achieved state-of-the-art performance on three public datasets.

Contact US
Email : fit@zju.edu.cn
Tel:86-571-87951772
FAX : 0086-571-87951077
Addr:No. 38 ZheDa Road