Xin Deng WenYu Zhang Qing Ding XinMing Zhang

Abstract
In point cloud analysis, point-based methods have rapidly developed in recentyears. These methods have recently focused on concise MLP structures, such asPointNeXt, which have demonstrated competitiveness with Convolutional andTransformer structures. However, standard MLPs are limited in their ability toextract local features effectively. To address this limitation, we propose aVector-oriented Point Set Abstraction that can aggregate neighboring featuresthrough higher-dimensional vectors. To facilitate network optimization, weconstruct a transformation from scalar to vector using independent angles basedon 3D vector rotations. Finally, we develop a PointVector model that followsthe structure of PointNeXt. Our experimental results demonstrate thatPointVector achieves state-of-the-art performance 72.3% mIOU on theS3DIS Area 5 and 78.4% mIOU on the S3DIS (6-fold cross-validation)with only 58% model parameters of PointNeXt. We hope our work willhelp the exploration of concise and effective feature representations. The codewill be released soon.
Code Repositories
Benchmarks
| Benchmark | Methodology | Metrics |
|---|---|---|
| 3d-part-segmentation-on-shapenet-part | PointVector-S(C=64) | Instance Average IoU: 86.9 |
| 3d-point-cloud-classification-on-modelnet40 | PointVector-S | Mean Accuracy: 91 Overall Accuracy: 93.5 |
| 3d-point-cloud-classification-on-scanobjectnn | PointVector-S | Mean Accuracy: 86.2 Overall Accuracy: 87.8 |
| 3d-semantic-segmentation-on-opentrench3d | PointVector-XL | Model Size: 24.1M mAcc: 84.1 mIoU: 76.5 |
| semantic-segmentation-on-s3dis | PointVector-XL | Mean IoU: 78.4 Params (M): 24.1 mAcc: 86.1 oAcc: 91.9 |
| semantic-segmentation-on-s3dis-area5 | PointVector-XL | mAcc: 78.1 mIoU: 72.3 oAcc: 91 |
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.