Counting Crowds in Bad Weather

1National Taiwan University, 2Stanford University, 3University of California, Merced, 4Google Research
* indicates equal contribution

ICCV 2023

Abstract

Crowd counting has recently attracted significant attention in the field of computer vision due to its wide applications to image understanding. Numerous methods have been proposed and achieved state-of-the-art performance for real-world tasks.

However, existing approaches do not perform well under adverse weather such as haze, rain, and snow since the visual appearances of crowds in such scenes are drastically different from those images in clear weather of typical datasets.

In this paper, we propose a method for robust crowd counting in adverse weather scenarios. Instead of using a two-stage approach that involves image restoration and crowd counting modules, our model learns effective features and adaptive queries to account for large appearance variations. With these weather queries, the proposed model can learn the weather information according to the degradation of the input image and optimize with the crowd counting module simultaneously.

Experimental results show that the proposed algorithm is effective in counting crowds under different weather types on benchmark datasets.

Limitation of SOTA methods

Performance of State-of-the-art crowd counting methods under adverse and clear weather on the JHU-Crowd++ [1] dataset using mean absolute error (MAE). The MAN method [2] achieves low MAE in clear scenes but high MAE in adverse weather. On the other hand, the two-stage method, based on Unified [3] and MAN [2], performs slightly better in adverse weather but slightly worse in clear scenes. Overall, the proposed AWCC-Net performs favorably in both scenarios.

Introduction

Architecture

Experiment

BibTeX

@article{huang2023counting,
    author    = {Zhi-Kai Huang and Wei-Ting Chen and Yuan-Chun Chiang and Sy-Yen Kuo and Ming-Hsuan Yang},
    title     = {Counting Crowds in Bad Weather},
    journal   = {ICCV},
    year      = {2023},
}