Modeling city logistics using adaptive dynamic programming based multi-agent simulation.

• The behavior of freight carriers and an Urban Consolidation Center were modeled using a Multi-Agent model. • The MAS-ADP based RL is superior in replicating the potential actions of the agents under uncertain environment. • The accurate decision could optimize the objective of the agents and reduce the environmental emissions in city logistics. The effects of city logistics solutions are uncertain due to fluctuating demand, parking issues and multiple agents within the system. This research modelled the behavior of freight carriers and an Urban Consolidation Center (UCC) operator using Multi-Agent Simulation-Adaptive Dynamic Programming based Reinforcement Learning (MAS-ADP based RL) to evaluate a Joint Delivery Systems in an uncertain environment. The MAS-ADP based RL is superior to MAS-Q-learning in replicating the potential actions of the agents under uncertain environment by adapting to the changing environment properly into accurate decisions thus increasing the accuracy of agent's decision making and eventually reducing environmental emissions as well. [ABSTRACT FROM AUTHOR]