Back to Search
Start Over
Bisimulation and Logical Preservation for Continuous-Time Markov Decision Processes
- Source :
- CONCUR 2007 – Concurrency Theory: 18th International Conference, CONCUR 2007, Lisbon, Portugal, September 3-8, 2007. Proceedings, 412-427, STARTPAGE=412;ENDPAGE=427;TITLE=CONCUR 2007 – Concurrency Theory, CONCUR 2007 – Concurrency Theory ISBN: 9783540744061, CONCUR
- Publication Year :
- 2007
- Publisher :
- Springer, 2007.
-
Abstract
- This paper introduces strong bisimulation for continuous-time Markov decision processes (CTMDPs), a stochastic model which allows for a nondeterministic choice between exponential distributions, and shows that bisimulation preserves the validity of CSL. To that end, we interpret the semantics of CSL - a stochastic variant of CTL for continuous-time Markov chains - on CTMDPs and show its measure theoretic soundness. The main challenge faced in this paper is the proof of logical preservation that is substantially based on measure theory.
- Subjects :
- Bisimulation
Theoretical computer science
Markov chain
Variable-order Markov model
Markov process
Partially observable Markov decision process
Markov model
symbols.namesake
TheoryofComputation_MATHEMATICALLOGICANDFORMALLANGUAGES
TheoryofComputation_LOGICSANDMEANINGSOFPROGRAMS
Computer Science::Logic in Computer Science
symbols
Continuous-time Markov decision process (CTMDP)
Markov property
Markov decision process
Algorithm
Computer Science::Formal Languages and Automata Theory
Mathematics
Subjects
Details
- Language :
- English
- ISBN :
- 978-3-540-74406-1
- ISBNs :
- 9783540744061
- Database :
- OpenAIRE
- Journal :
- CONCUR 2007 – Concurrency Theory: 18th International Conference, CONCUR 2007, Lisbon, Portugal, September 3-8, 2007. Proceedings, 412-427, STARTPAGE=412;ENDPAGE=427;TITLE=CONCUR 2007 – Concurrency Theory, CONCUR 2007 – Concurrency Theory ISBN: 9783540744061, CONCUR
- Accession number :
- edsair.doi.dedup.....c194c39067e97a7af30ed92a88e42f10