Local Wealth Redistribution Promotes Cooperation in Multiagent Systems

ABSTRACT

Designing mechanisms that leverage cooperation between agents has been a long-lasting goal in Multiagent Systems. The task is especially challenging when agents are selfish, lack common goals and face social dilemmas, i.e., situations in which individual interest conflicts with social welfare. Past works explored mechanisms that explain cooperation in biological and social systems, providing important clues for the aim of designing cooperative artificial societies. In particular, several works show that cooperation is able to emerge when specific network structures underlie agents' interactions. Notwithstanding, social dilemmas in which defection is highly tempting still pose challenges concerning the effective sustainability of cooperation. Here we propose a new redistribution mechanism that can be applied in structured populations of agents. Importantly, we show that, when implemented locally (\textiti.e., agents share a fraction of their wealth surplus with their nearest neighbors), redistribution excels in promoting cooperation under regimes where, before, defection prevailed.

References

1. Stéphane Airiau, Sandip Sen, and Daniel Villatoro . 2014. Emergence of conventions through social learning. Autonomous Agents and Multi-Agent Systems Vol. 28, 5 (2014), 779--804.
2. Ian F Akyildiz, Weilian Su, Yogesh Sankarasubramaniam, and Erdal Cayirci . 2002. Wireless sensor networks: a survey. Computer Networks, Vol. 38, 4 (2002), 393--422.
3. Réka Albert and Albert-László Barabási . 2002. Statistical mechanics of complex networks. Reviews of Modern Physics Vol. 74, 1 (2002), 47.
4. Josep Ll Arcos, Marc Esteva, Pablo Noriega, Juan A Rodr'ıguez-Aguilar, and Carles Sierra . 2005. Engineering open environments with electronic institutions. Engineering Applications of Artificial Intelligence, Vol. 18, 2 (2005), 191--204.
5. Juan C Burguillo-Rial . 2009. A memetic framework for describing and simulating spatial prisoner's dilemma with coalition formation. In Proceedings of AAAI'09. AAAI Press, 441--448.
6. Ulle Endriss and Nicolas Maudet . 2003. Welfare engineering in multiagent systems. In International Workshop on Engineering Societies in the Agents World. Springer, 93--106.
7. Eithan Ephrati and Jeffrey S Rosenschein . 1996. Deriving consensus in multiagent systems. Artificial Intelligence Vol. 87, 1--2 (1996), 21--74.
8. Marc Esteva, Bruno Rosell, Juan A Rodriguez-Aguilar, and Josep Ll Arcos . 2004. AMELI: An agent-based middleware for electronic institutions Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems. IEEE Computer Society, 236--243.
9. Michal Feldman and John Chuang . 2005. Overcoming free-riding behavior in peer-to-peer systems. ACM SIGecom Exchanges, Vol. 5, 4 (2005), 41--50.
10. Michael R Genesereth, Matthew L Ginsberg, and Jeffrey S Rosenschein . 1986. Cooperation without communication. In Proceedings of AAAI'86. AAAI Press.
11. Philippe Golle, Kevin Leyton-Brown, Ilya Mironov, and Mark Lillibridge . 2001. Incentives for sharing in peer-to-peer networks. Electronic Commerce. Springer, 75--87.
12. Nathan Griffiths . 2008. Tags and image scoring for robust cooperation. In Proceedings of the 2008 International Conference on Autonomous Agents and Multi-agent Systems. International Foundation for Autonomous Agents and Multiagent Systems, 575--582.
13. William D Hamilton . 1964. The genetical evolution of social behaviour. Journal of Theoretical Biology Vol. 7, 1 (1964), 17--52.
14. TA Han . 2016. Emergence of Social Punishment and Cooperation through Prior Commitments Proceedings of AAAI'16. AAAI Press, 2494--2500.
15. TA Han, Lu'ıs Moniz Pereira, Luis A Martinez-Vaquero, and Tom Lenaerts . 2017. Centralized vs. Personalized Commitments and their influence on Cooperation in Group Interactions Proceedings of AAAI'17. AAAI Press.
16. Chien-Ju Ho, Yu Zhang, Jennifer Vaughan, and Mihaela Van Der Schaar . 2012. Towards social norm design for crowdsourcing markets AAAI'12 Technical Report WS-12-08. AAAI Press.
17. Lisa-Maria Hofmann, Nilanjan Chakraborty, and Katia Sycara . 2011. The evolution of cooperation in self-interested agent societies: a critical study Proceedings of the 2011 International Conference on Autonomous Agents and Multi-agent Systems. International Foundation for Autonomous Agents and Multiagent Systems, 685--692.
18. Genki Ichinose, Yoshiki Satotani, and Hiroki Sayama . 2017. How mutation alters fitness of cooperation in networked evolutionary games. arXiv preprint arXiv:1706.03013 (2017).
19. Nicholas R Jennings, Katia Sycara, and Michael Wooldridge . 1998. A roadmap of agent research and development. Autonomous Agents and Multi-agent Systems Vol. 1, 1 (1998), 7--38.
20. David Burth Kurka and Jeremy Pitt . 2016. Distributed distributive justice. In Self-Adaptive and Self-Organizing Systems (SASO), 2016 IEEE 10th International Conference on. IEEE, 80--89.
21. Michael W Macy and Andreas Flache . 2002. Learning dynamics in social dilemmas. Proceedings of the National Academy of Sciences Vol. 99 (2002), 7229--7236.
22. Martin A Nowak . 2006. Five rules for the evolution of cooperation. Science, Vol. 314, 5805 (2006), 1560--1563.
23. Martin A Nowak . 2012. Evolving cooperation. Journal of Theoretical Biology Vol. 299 (2012), 1--8.
24. Martin A Nowak and Robert M May . 1992. Evolutionary games and spatial chaos. Nature, Vol. 359, 6398 (1992), 826--829.
25. Martin A Nowak and Karl Sigmund . 2005. Evolution of indirect reciprocity. Nature (2005).
26. Hisashi Ohtsuki, Christoph Hauert, Erez Lieberman, and Martin A Nowak . 2006. A simple rule for the evolution of cooperation on graphs. Nature, Vol. 441, 7092 (2006), 502.
27. Elinor Ostrom . 2015. Governing the commons. Cambridge University Press.
28. Liviu Panait and Sean Luke . 2005. Cooperative multi-agent learning: The state of the art. Autonomous Agents and Multi-agent Systems Vol. 11, 3 (2005), 387--434.
29. Ana Peleteiro, Juan C Burguillo, and Siang Yew Chong . 2014. Exploring indirect reciprocity in complex networks using coalitions and rewiring Proceedings of the 2014 International Conference on Autonomous Agents and Multi-agent Systems. International Foundation for Autonomous Agents and Multiagent Systems, 669--676.
30. Flávio L. Pinheiro and Dominik Hartmann . 2017. Intermediate Levels of Network Heterogeneity Provide the Best Evolutionary Outcomes. Scientific Reports, Vol. 7, 1 (2017), 15242.
31. Flavio L Pinheiro, Jorge M Pacheco, and Francisco C Santos . 2012. From local to global dilemmas in social networks. PloS ONE, Vol. 7, 2 (2012), e32114.
32. Flávio L Pinheiro, Francisco C Santos, and Jorge M Pacheco . 2016. Linking individual and collective behavior in adaptive social networks. Physical Review Letters Vol. 116, 12 (2016), 128702.
33. Jeremy Pitt, Julia Schaumeier, Didac Busquets, and Sam Macbeth . 2012. Self-organising common-pool resource allocation and canons of distributive justice Self-Adaptive and Self-Organizing Systems (SASO), 2012 IEEE Sixth International Conference on. IEEE, 119--128.
34. Bijan Ranjbar-Sahraei, Haitham Bou Ammar, Daan Bloembergen, Karl Tuyls, and Gerhard Weiss . 2014. Theory of cooperation in complex social networks. Proceedings of AAAI'14. AAAI Press.
35. John Rawls . 2009. A theory of justice. Harvard University Press.
36. Luke Rendell, Robert Boyd, Daniel Cownden, Marquist Enquist, Kimmo Eriksson, Marc W Feldman, Laurel Fogarty, Stefano Ghirlanda, Timothy Lillicrap, and Kevin N Laland . 2010. Why copy others? Insights from the social learning strategies tournament. Science, Vol. 328, 5975 (2010), 208--213.
37. Norman Salazar, Juan A Rodriguez-Aguilar, Josep Ll Arcos, Ana Peleteiro, and Juan C Burguillo-Rial . 2011. Emerging cooperation on complex networks. In Proceedings of the 2011 International Conference on Autonomous Agents and Multi-agent Systems. International Foundation for Autonomous Agents and Multiagent Systems, 669--676.
38. Francisco C Santos and Jorge M Pacheco . 2005. Scale-free networks provide a unifying framework for the emergence of cooperation. Physical Review Letters Vol. 95, 9 (2005), 098104.
39. Francisco C Santos, Jorge M Pacheco, and Tom Lenaerts . 2006. Cooperation prevails when individuals adjust their social ties. PLoS Computational Biology Vol. 2, 10 (2006), e140.
40. Francisco C Santos, Jo ao F Rodrigues, and Jorge M Pacheco . 2005. Epidemic spreading and cooperation dynamics on homogeneous small-world networks. Physical Review E, Vol. 72, 5 (2005), 056128.
41. Fernando P Santos, Jorge M Pacheco, Ana Paiva, and Francisco C Santos . 2017. Structural power and the evolution of collective fairness in social networks. PloS ONE, Vol. 12, 4 (2017), e0175687.
42. Fernando P. Santos, Jorge M. Pacheco, and Francisco C. Santos . 2018 a. Social norms of cooperation with costly reputation building AAAI'18. AAAI Press.
43. Fernando P Santos, Francisco C Santos, and Jorge M Pacheco . 2018 b. Social norm complexity and past reputations in the evolution of cooperation. Nature, Vol. 555, 7695 (2018), 242.
44. Sven Seuken, Jie Tang, and David C Parkes . 2010. Accounting Mechanisms for Distributed Work Systems AAAI'10. AAAI Press.
45. Karl Sigmund . 2010. The calculus of selfishness. Princeton University Press.
46. Robert L Trivers . 1971. The evolution of reciprocal altruism. The Quarterly Review of Biology Vol. 46, 1 (1971), 35--57.
47. V'ıtor V Vasconcelos, Francisco C Santos, and Jorge M Pacheco . 2015. Cooperation dynamics of polycentric climate governance. Mathematical Models and Methods in Applied Sciences, Vol. 25, 13 (2015), 2503--2517.
48. Markus Waibel, Dario Floreano, and Laurent Keller . 2011. A quantitative test of Hamilton's rule for the evolution of altruism. PLoS Biology, Vol. 9, 5 (2011), e1000615.

Index Terms

• Computing methodologies

  • Artificial intelligence

    • Distributed artificial intelligence

      • Cooperation and coordination

      • Multi-agent systems