Hybrid Graph Neural Networks for Crowd Counting

Crowd counting is an important yet challenging task due to the large scale and density variation. Recent investigations have shown that distilling rich relations among multi-scale features and exploiting useful information from the auxiliary task, i.e., localization, are vital for this task. Neverth...

Celý popis

Uloženo v:
Podrobná bibliografie
Hlavní autoři: Luo, Ao, Yang, Fan, Li, Xin, Nie, Dong, Jiao, Zhicheng, Zhou, Shangchen, Cheng, Hong
Médium: Článek
Vydáno: 2020
Témata:
On-line přístup:https://arxiv.org/abs/2002.00092
http://arxiv.org/abs/2002.00092
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
_version_ 1879172092269690880
author Luo, Ao
Yang, Fan
Li, Xin
Nie, Dong
Jiao, Zhicheng
Zhou, Shangchen
Cheng, Hong
author_browse Cheng, Hong
Jiao, Zhicheng
Li, Xin
Luo, Ao
Nie, Dong
Yang, Fan
Zhou, Shangchen
author_facet Luo, Ao
Yang, Fan
Li, Xin
Nie, Dong
Jiao, Zhicheng
Zhou, Shangchen
Cheng, Hong
author_sort Luo, Ao
building arXiv
collection Acceso abierto
description Crowd counting is an important yet challenging task due to the large scale and density variation. Recent investigations have shown that distilling rich relations among multi-scale features and exploiting useful information from the auxiliary task, i.e., localization, are vital for this task. Nevertheless, how to comprehensively leverage these relations within a unified network architecture is still a challenging problem. In this paper, we present a novel network structure called Hybrid Graph Neural Network (HyGnn) which targets to relieve the problem by interweaving the multi-scale features for crowd density as well as its auxiliary task (localization) together and performing joint reasoning over a graph. Specifically, HyGnn integrates a hybrid graph to jointly represent the task-specific feature maps of different scales as nodes, and two types of relations as edges:(i) multi-scale relations for capturing the feature dependencies across scales and (ii) mutual beneficial relations building bridges for the cooperation between counting and localization. Thus, through message passing, HyGnn can distill rich relations between the nodes to obtain more powerful representations, leading to robust and accurate results. Our HyGnn performs significantly well on four challenging datasets: ShanghaiTech Part A, ShanghaiTech Part B, UCF_CC_50 and UCF_QNRF, outperforming the state-of-the-art approaches by a large margin.
first_indexed 2026-10-15T23:35:51Z
format Article
fullrecord <oai_dc:dc xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/oai_dc/ https://www.openarchives.org/OAI/2.0/oai_dc.xsd"><identifier>arxiv-2002.00092</identifier><datestamp>2020-02-04</datestamp> <dc:title>Hybrid Graph Neural Networks for Crowd Counting</dc:title> <dc:creator>Luo, Ao</dc:creator> <dc:creator>Yang, Fan</dc:creator> <dc:creator>Li, Xin</dc:creator> <dc:creator>Nie, Dong</dc:creator> <dc:creator>Jiao, Zhicheng</dc:creator> <dc:creator>Zhou, Shangchen</dc:creator> <dc:creator>Cheng, Hong</dc:creator> <dc:subject>Computer Vision and Pattern Recognition</dc:subject> <dc:description>Crowd counting is an important yet challenging task due to the large scale and density variation. Recent investigations have shown that distilling rich relations among multi-scale features and exploiting useful information from the auxiliary task, i.e., localization, are vital for this task. Nevertheless, how to comprehensively leverage these relations within a unified network architecture is still a challenging problem. In this paper, we present a novel network structure called Hybrid Graph Neural Network (HyGnn) which targets to relieve the problem by interweaving the multi-scale features for crowd density as well as its auxiliary task (localization) together and performing joint reasoning over a graph. Specifically, HyGnn integrates a hybrid graph to jointly represent the task-specific feature maps of different scales as nodes, and two types of relations as edges:(i) multi-scale relations for capturing the feature dependencies across scales and (ii) mutual beneficial relations building bridges for the cooperation between counting and localization. Thus, through message passing, HyGnn can distill rich relations between the nodes to obtain more powerful representations, leading to robust and accurate results. Our HyGnn performs significantly well on four challenging datasets: ShanghaiTech Part A, ShanghaiTech Part B, UCF_CC_50 and UCF_QNRF, outperforming the state-of-the-art approaches by a large margin. </dc:description> <dc:description>To appear in AAAI 2020</dc:description> <dc:date>2020-01-31</dc:date> <dc:type>text</dc:type> <dc:identifier>https://arxiv.org/abs/2002.00092</dc:identifier> <dc:identifier>http://arxiv.org/abs/2002.00092</dc:identifier> </oai_dc:dc>
id arxiv-2002.00092
institution arXiv
last_indexed 2026-10-15T23:35:51Z
publishDate 2020
publishDateRange 2020
publishDateSort 2020
record_format oai_dc
spelling arxiv-2002.000922020-02-04 Hybrid Graph Neural Networks for Crowd Counting Luo, Ao Yang, Fan Li, Xin Nie, Dong Jiao, Zhicheng Zhou, Shangchen Cheng, Hong Computer Vision and Pattern Recognition Crowd counting is an important yet challenging task due to the large scale and density variation. Recent investigations have shown that distilling rich relations among multi-scale features and exploiting useful information from the auxiliary task, i.e., localization, are vital for this task. Nevertheless, how to comprehensively leverage these relations within a unified network architecture is still a challenging problem. In this paper, we present a novel network structure called Hybrid Graph Neural Network (HyGnn) which targets to relieve the problem by interweaving the multi-scale features for crowd density as well as its auxiliary task (localization) together and performing joint reasoning over a graph. Specifically, HyGnn integrates a hybrid graph to jointly represent the task-specific feature maps of different scales as nodes, and two types of relations as edges:(i) multi-scale relations for capturing the feature dependencies across scales and (ii) mutual beneficial relations building bridges for the cooperation between counting and localization. Thus, through message passing, HyGnn can distill rich relations between the nodes to obtain more powerful representations, leading to robust and accurate results. Our HyGnn performs significantly well on four challenging datasets: ShanghaiTech Part A, ShanghaiTech Part B, UCF_CC_50 and UCF_QNRF, outperforming the state-of-the-art approaches by a large margin. To appear in AAAI 2020 2020-01-31 text https://arxiv.org/abs/2002.00092 http://arxiv.org/abs/2002.00092
spellingShingle Computer Vision and Pattern Recognition
Luo, Ao
Yang, Fan
Li, Xin
Nie, Dong
Jiao, Zhicheng
Zhou, Shangchen
Cheng, Hong
Hybrid Graph Neural Networks for Crowd Counting
title Hybrid Graph Neural Networks for Crowd Counting
title_full Hybrid Graph Neural Networks for Crowd Counting
title_fullStr Hybrid Graph Neural Networks for Crowd Counting
title_full_unstemmed Hybrid Graph Neural Networks for Crowd Counting
title_short Hybrid Graph Neural Networks for Crowd Counting
title_sort hybrid graph neural networks for crowd counting
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2002.00092
http://arxiv.org/abs/2002.00092
work_keys_str_mv AT luoao hybridgraphneuralnetworksforcrowdcounting
AT yangfan hybridgraphneuralnetworksforcrowdcounting
AT lixin hybridgraphneuralnetworksforcrowdcounting
AT niedong hybridgraphneuralnetworksforcrowdcounting
AT jiaozhicheng hybridgraphneuralnetworksforcrowdcounting
AT zhoushangchen hybridgraphneuralnetworksforcrowdcounting
AT chenghong hybridgraphneuralnetworksforcrowdcounting