Back to Search
Start Over
Dynamic Social Learning Under Graph Constraints
- Source :
- IEEE Transactions on Control of Network Systems, IEEE Transactions on Control of Network Systems, 2022, 9 (3), pp.1435-1446. ⟨10.1109/TCNS.2021.3114377⟩, IEEE Transactions on Control of Network Systems, IEEE, 2021, ⟨10.1109/TCNS.2021.3114377⟩
- Publication Year :
- 2022
- Publisher :
- Institute of Electrical and Electronics Engineers (IEEE), 2022.
-
Abstract
- International audience; We introduce a model of graph-constrained dynamic choice with reinforcement modeled by positively $\alpha$-homogeneous rewards. We show that its empirical process, which can be written as a stochastic approximation recursion with Markov noise, has the same probability law as a certain vertex reinforced random walk. We use this equivalence to show that for $\alpha > 0$, the asymptotic outcome concentrates around the optimum in a certain limiting sense when 'annealed' by letting $\alpha \to \infty$ slowly.
- Subjects :
- FOS: Computer and information sciences
Vertex (graph theory)
Computer Science - Machine Learning
Control and Optimization
Computer Networks and Communications
annealed dynamics
Stochastic approximation
Machine Learning (cs.LG)
[INFO.INFO-NI]Computer Science [cs]/Networking and Internet Architecture [cs.NI]
[INFO.INFO-LG]Computer Science [cs]/Machine Learning [cs.LG]
graphical constraints
FOS: Mathematics
Mathematics - Optimization and Control
Equivalence (measure theory)
Empirical process
Mathematics
Discrete mathematics
Markov chain
dynamic choice with reinforcement
Probability (math.PR)
vertex reinforced random walk
Recursion (computer science)
Random walk
[MATH.MATH-PR]Mathematics [math]/Probability [math.PR]
Optimization and Control (math.OC)
Control and Systems Engineering
Signal Processing
Graph (abstract data type)
optimal choice
[MATH.MATH-OC]Mathematics [math]/Optimization and Control [math.OC]
Mathematics - Probability
Subjects
Details
- ISSN :
- 23722533 and 23255870
- Volume :
- 9
- Database :
- OpenAIRE
- Journal :
- IEEE Transactions on Control of Network Systems
- Accession number :
- edsair.doi.dedup.....b12c430d9ea1b5f9dc499bfed0533f1c
- Full Text :
- https://doi.org/10.1109/tcns.2021.3114377