Harmonizing Base and Novel Classes: A Class-Contrastive Approach for
Generalized Few-Shot Segmentation
Harmonizing Base and Novel Classes: A Class-Contrastive Approach for Generalized Few-Shot Segmentation
Weide Liu Zhonghua Wu Yang Zhao Yuming Fang Chuan-Sheng Foo Jun Cheng Guosheng Lin

Abstract
Current methods for few-shot segmentation (FSSeg) have mainly focused onimproving the performance of novel classes while neglecting the performance ofbase classes. To overcome this limitation, the task of generalized few-shotsemantic segmentation (GFSSeg) has been introduced, aiming to predictsegmentation masks for both base and novel classes. However, the currentprototype-based methods do not explicitly consider the relationship betweenbase and novel classes when updating prototypes, leading to a limitedperformance in identifying true categories. To address this challenge, wepropose a class contrastive loss and a class relationship loss to regulateprototype updates and encourage a large distance between prototypes fromdifferent classes, thus distinguishing the classes from each other whilemaintaining the performance of the base classes. Our proposed approach achievesnew state-of-the-art performance for the generalized few-shot segmentation taskon PASCAL VOC and MS COCO datasets.
Code Repositories
Benchmarks
| Benchmark | Methodology | Metrics |
|---|---|---|
| generalized-few-shot-semantic-segmentation-on-2 | CCA (ResNet-50) | Mean Base and Novel: 27.86 Mean IoU: 37.48 |
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.