CountFormer: Multi-View Crowd Counting Transformer
Multi-view counting (MVC) methods have shown their superiority over single-view counterparts, particularly in situations characterized by heavy occlusion and severe perspective distortions. However, hand-crafted heuristic features and identical camera layout requirements in conventional MVC methods...
Tallennettuna:
| Päätekijät: | , , , , , , |
|---|---|
| Aineistotyyppi: | Artikkeli |
| Julkaistu: |
2024
|
| Aiheet: | |
| Linkit: | https://arxiv.org/abs/2407.02047 http://arxiv.org/abs/2407.02047 |
| Tagit: |
Ei tageja, Lisää ensimmäinen tagi!
|
| _version_ | 1879175855122415616 |
|---|---|
| author | Mo, Hong Zhang, Xiong Tan, Jianchao Yang, Cheng Gu, Qiong Hang, Bo Ren, Wenqi |
| author_browse | Gu, Qiong Hang, Bo Mo, Hong Ren, Wenqi Tan, Jianchao Yang, Cheng Zhang, Xiong |
| author_facet | Mo, Hong Zhang, Xiong Tan, Jianchao Yang, Cheng Gu, Qiong Hang, Bo Ren, Wenqi |
| author_sort | Mo, Hong |
| building | arXiv |
| collection | Acceso abierto |
| description | Multi-view counting (MVC) methods have shown their superiority over single-view counterparts, particularly in situations characterized by heavy occlusion and severe perspective distortions. However, hand-crafted heuristic features and identical camera layout requirements in conventional MVC methods limit their applicability and scalability in real-world scenarios.In this work, we propose a concise 3D MVC framework called \textbf{CountFormer}to elevate multi-view image-level features to a scene-level volume representation and estimate the 3D density map based on the volume features. By incorporating a camera encoding strategy, CountFormer successfully embeds camera parameters into the volume query and image-level features, enabling it to handle various camera layouts with significant differences.Furthermore, we introduce a feature lifting module capitalized on the attention mechanism to transform image-level features into a 3D volume representation for each camera view. Subsequently, the multi-view volume aggregation module attentively aggregates various multi-view volumes to create a comprehensive scene-level volume representation, allowing CountFormer to handle images captured by arbitrary dynamic camera layouts. The proposed method performs favorably against the state-of-the-art approaches across various widely used datasets, demonstrating its greater suitability for real-world deployment compared to conventional MVC frameworks. |
| first_indexed | 2026-10-16T00:35:42Z |
| format | Article |
| fullrecord | <oai_dc:dc xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/oai_dc/ https://www.openarchives.org/OAI/2.0/oai_dc.xsd"><identifier>arxiv-2407.02047</identifier><datestamp>2024-07-03</datestamp>
<dc:title>CountFormer: Multi-View Crowd Counting Transformer</dc:title>
<dc:creator>Mo, Hong</dc:creator>
<dc:creator>Zhang, Xiong</dc:creator>
<dc:creator>Tan, Jianchao</dc:creator>
<dc:creator>Yang, Cheng</dc:creator>
<dc:creator>Gu, Qiong</dc:creator>
<dc:creator>Hang, Bo</dc:creator>
<dc:creator>Ren, Wenqi</dc:creator>
<dc:subject>Computer Vision and Pattern Recognition</dc:subject>
<dc:description>Multi-view counting (MVC) methods have shown their superiority over single-view counterparts, particularly in situations characterized by heavy occlusion and severe perspective distortions. However, hand-crafted heuristic features and identical camera layout requirements in conventional MVC methods limit their applicability and scalability in real-world scenarios.In this work, we propose a concise 3D MVC framework called \textbf{CountFormer}to elevate multi-view image-level features to a scene-level volume representation and estimate the 3D density map based on the volume features. By incorporating a camera encoding strategy, CountFormer successfully embeds camera parameters into the volume query and image-level features, enabling it to handle various camera layouts with significant differences.Furthermore, we introduce a feature lifting module capitalized on the attention mechanism to transform image-level features into a 3D volume representation for each camera view. Subsequently, the multi-view volume aggregation module attentively aggregates various multi-view volumes to create a comprehensive scene-level volume representation, allowing CountFormer to handle images captured by arbitrary dynamic camera layouts. The proposed method performs favorably against the state-of-the-art approaches across various widely used datasets, demonstrating its greater suitability for real-world deployment compared to conventional MVC frameworks. </dc:description>
<dc:description>Accepted By ECCV2024</dc:description>
<dc:date>2024-07-02</dc:date>
<dc:type>text</dc:type>
<dc:identifier>https://arxiv.org/abs/2407.02047</dc:identifier>
<dc:identifier>http://arxiv.org/abs/2407.02047</dc:identifier>
</oai_dc:dc> |
| id | arxiv-2407.02047 |
| institution | arXiv |
| last_indexed | 2026-10-16T00:35:42Z |
| publishDate | 2024 |
| publishDateRange | 2024 |
| publishDateSort | 2024 |
| record_format | oai_dc |
| spelling | arxiv-2407.020472024-07-03 CountFormer: Multi-View Crowd Counting Transformer Mo, Hong Zhang, Xiong Tan, Jianchao Yang, Cheng Gu, Qiong Hang, Bo Ren, Wenqi Computer Vision and Pattern Recognition Multi-view counting (MVC) methods have shown their superiority over single-view counterparts, particularly in situations characterized by heavy occlusion and severe perspective distortions. However, hand-crafted heuristic features and identical camera layout requirements in conventional MVC methods limit their applicability and scalability in real-world scenarios.In this work, we propose a concise 3D MVC framework called \textbf{CountFormer}to elevate multi-view image-level features to a scene-level volume representation and estimate the 3D density map based on the volume features. By incorporating a camera encoding strategy, CountFormer successfully embeds camera parameters into the volume query and image-level features, enabling it to handle various camera layouts with significant differences.Furthermore, we introduce a feature lifting module capitalized on the attention mechanism to transform image-level features into a 3D volume representation for each camera view. Subsequently, the multi-view volume aggregation module attentively aggregates various multi-view volumes to create a comprehensive scene-level volume representation, allowing CountFormer to handle images captured by arbitrary dynamic camera layouts. The proposed method performs favorably against the state-of-the-art approaches across various widely used datasets, demonstrating its greater suitability for real-world deployment compared to conventional MVC frameworks. Accepted By ECCV2024 2024-07-02 text https://arxiv.org/abs/2407.02047 http://arxiv.org/abs/2407.02047 |
| spellingShingle | Computer Vision and Pattern Recognition Mo, Hong Zhang, Xiong Tan, Jianchao Yang, Cheng Gu, Qiong Hang, Bo Ren, Wenqi CountFormer: Multi-View Crowd Counting Transformer |
| title | CountFormer: Multi-View Crowd Counting Transformer |
| title_full | CountFormer: Multi-View Crowd Counting Transformer |
| title_fullStr | CountFormer: Multi-View Crowd Counting Transformer |
| title_full_unstemmed | CountFormer: Multi-View Crowd Counting Transformer |
| title_short | CountFormer: Multi-View Crowd Counting Transformer |
| title_sort | countformer multi view crowd counting transformer |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2407.02047 http://arxiv.org/abs/2407.02047 |
| work_keys_str_mv | AT mohong countformermultiviewcrowdcountingtransformer AT zhangxiong countformermultiviewcrowdcountingtransformer AT tanjianchao countformermultiviewcrowdcountingtransformer AT yangcheng countformermultiviewcrowdcountingtransformer AT guqiong countformermultiviewcrowdcountingtransformer AT hangbo countformermultiviewcrowdcountingtransformer AT renwenqi countformermultiviewcrowdcountingtransformer |