IntelligentCrowd: Mobile Crowdsensing via Multi-Agent Reinforcement Learning
The prosperity of smart mobile devices has made mobile crowdsensing (MCS) a promising paradigm for completing complex sensing and computation tasks. In the past, great efforts have been made on the design of incentive mechanisms and task allocation strategies from MCS platform's perspective to motiv...
محفوظ في:
| المؤلفون الرئيسيون: | , |
|---|---|
| التنسيق: | مقال |
| منشور في: |
2018
|
| الموضوعات: | |
| الوصول للمادة أونلاين: | https://arxiv.org/abs/1809.07830 http://arxiv.org/abs/1809.07830 |
| الوسوم: |
لا توجد وسوم, كن أول من يضع وسما على هذه التسجيلة!
|
| _version_ | 1879172649653895168 |
|---|---|
| author | Chen, Yize Wang, Hao |
| author_browse | Chen, Yize Wang, Hao |
| author_facet | Chen, Yize Wang, Hao |
| author_sort | Chen, Yize |
| building | arXiv |
| collection | Acceso abierto |
| description | The prosperity of smart mobile devices has made mobile crowdsensing (MCS) a promising paradigm for completing complex sensing and computation tasks. In the past, great efforts have been made on the design of incentive mechanisms and task allocation strategies from MCS platform's perspective to motivate mobile users' participation. However, in practice, MCS participants face many uncertainties coming from their sensing environment as well as other participants' strategies, and how do they interact with each other and make sensing decisions is not well understood. In this paper, we take MCS participants' perspective to derive an online sensing policy to maximize their payoffs via MCS participation. Specifically, we model the interactions of mobile users and sensing environments as a multi-agent Markov decision process. Each participant cannot observe others' decisions, but needs to decide her effort level in sensing tasks only based on local information, e.g., its own record of sensed signals' quality. To cope with the stochastic sensing environment, we develop an intelligent crowdsensing algorithm IntelligentCrowd by leveraging the power of multi-agent reinforcement learning (MARL). Our algorithm leads to the optimal sensing policy for each user to maximize the expected payoff against stochastic sensing environments, and can be implemented at individual participant's level in a distributed fashion. Numerical simulations demonstrate that IntelligentCrowd significantly improves users' payoffs in sequential MCS tasks under various sensing dynamics. |
| first_indexed | 2026-10-15T23:44:41Z |
| format | Article |
| fullrecord | <oai_dc:dc xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/oai_dc/ https://www.openarchives.org/OAI/2.0/oai_dc.xsd"><identifier>arxiv-1809.07830</identifier><datestamp>2020-11-26</datestamp>
<dc:title>IntelligentCrowd: Mobile Crowdsensing via Multi-Agent Reinforcement Learning</dc:title>
<dc:creator>Chen, Yize</dc:creator>
<dc:creator>Wang, Hao</dc:creator>
<dc:subject>Multiagent Systems</dc:subject>
<dc:subject>Machine Learning</dc:subject>
<dc:description>The prosperity of smart mobile devices has made mobile crowdsensing (MCS) a promising paradigm for completing complex sensing and computation tasks. In the past, great efforts have been made on the design of incentive mechanisms and task allocation strategies from MCS platform's perspective to motivate mobile users' participation. However, in practice, MCS participants face many uncertainties coming from their sensing environment as well as other participants' strategies, and how do they interact with each other and make sensing decisions is not well understood. In this paper, we take MCS participants' perspective to derive an online sensing policy to maximize their payoffs via MCS participation. Specifically, we model the interactions of mobile users and sensing environments as a multi-agent Markov decision process. Each participant cannot observe others' decisions, but needs to decide her effort level in sensing tasks only based on local information, e.g., its own record of sensed signals' quality. To cope with the stochastic sensing environment, we develop an intelligent crowdsensing algorithm IntelligentCrowd by leveraging the power of multi-agent reinforcement learning (MARL). Our algorithm leads to the optimal sensing policy for each user to maximize the expected payoff against stochastic sensing environments, and can be implemented at individual participant's level in a distributed fashion. Numerical simulations demonstrate that IntelligentCrowd significantly improves users' payoffs in sequential MCS tasks under various sensing dynamics. </dc:description>
<dc:description>Accepted paper at 2020 IEEE Transactions on Emerging Topics in Computational Intelligence</dc:description>
<dc:date>2018-09-20</dc:date>
<dc:date>2020-11-25</dc:date>
<dc:type>text</dc:type>
<dc:identifier>https://arxiv.org/abs/1809.07830</dc:identifier>
<dc:identifier>http://arxiv.org/abs/1809.07830</dc:identifier>
</oai_dc:dc> |
| id | arxiv-1809.07830 |
| institution | arXiv |
| last_indexed | 2026-10-15T23:44:41Z |
| publishDate | 2018 |
| publishDateRange | 2018 |
| publishDateSort | 2018 |
| record_format | oai_dc |
| spelling | arxiv-1809.078302020-11-26 IntelligentCrowd: Mobile Crowdsensing via Multi-Agent Reinforcement Learning Chen, Yize Wang, Hao Multiagent Systems Machine Learning The prosperity of smart mobile devices has made mobile crowdsensing (MCS) a promising paradigm for completing complex sensing and computation tasks. In the past, great efforts have been made on the design of incentive mechanisms and task allocation strategies from MCS platform's perspective to motivate mobile users' participation. However, in practice, MCS participants face many uncertainties coming from their sensing environment as well as other participants' strategies, and how do they interact with each other and make sensing decisions is not well understood. In this paper, we take MCS participants' perspective to derive an online sensing policy to maximize their payoffs via MCS participation. Specifically, we model the interactions of mobile users and sensing environments as a multi-agent Markov decision process. Each participant cannot observe others' decisions, but needs to decide her effort level in sensing tasks only based on local information, e.g., its own record of sensed signals' quality. To cope with the stochastic sensing environment, we develop an intelligent crowdsensing algorithm IntelligentCrowd by leveraging the power of multi-agent reinforcement learning (MARL). Our algorithm leads to the optimal sensing policy for each user to maximize the expected payoff against stochastic sensing environments, and can be implemented at individual participant's level in a distributed fashion. Numerical simulations demonstrate that IntelligentCrowd significantly improves users' payoffs in sequential MCS tasks under various sensing dynamics. Accepted paper at 2020 IEEE Transactions on Emerging Topics in Computational Intelligence 2018-09-20 2020-11-25 text https://arxiv.org/abs/1809.07830 http://arxiv.org/abs/1809.07830 |
| spellingShingle | Multiagent Systems Machine Learning Chen, Yize Wang, Hao IntelligentCrowd: Mobile Crowdsensing via Multi-Agent Reinforcement Learning |
| title | IntelligentCrowd: Mobile Crowdsensing via Multi-Agent Reinforcement Learning |
| title_full | IntelligentCrowd: Mobile Crowdsensing via Multi-Agent Reinforcement Learning |
| title_fullStr | IntelligentCrowd: Mobile Crowdsensing via Multi-Agent Reinforcement Learning |
| title_full_unstemmed | IntelligentCrowd: Mobile Crowdsensing via Multi-Agent Reinforcement Learning |
| title_short | IntelligentCrowd: Mobile Crowdsensing via Multi-Agent Reinforcement Learning |
| title_sort | intelligentcrowd mobile crowdsensing via multi agent reinforcement learning |
| topic | Multiagent Systems Machine Learning |
| url | https://arxiv.org/abs/1809.07830 http://arxiv.org/abs/1809.07830 |
| work_keys_str_mv | AT chenyize intelligentcrowdmobilecrowdsensingviamultiagentreinforcementlearning AT wanghao intelligentcrowdmobilecrowdsensingviamultiagentreinforcementlearning |