Show simple item record

dc.contributor.authorCarrasco, Juan A.
dc.contributor.authorSuñé, Víctor
dc.contributor.otherUniversitat Politècnica de Catalunya. Departament d'Enginyeria Electrònica
dc.identifier.citationCarrasco, J.; Suñe, V. A Numerical method for the evaluation of the distribution of cumulative reward till exit of a Subset of transient states of a Markov reward model. "IEEE transactions on dependable and secure computing", 12 Setembre 2011, vol. 8, núm. 6, p. 798-809.
dc.description.abstractMarkov reward models have interesting modeling applications, particularly those addressing fault-tolerant hardware/software systems. In this paper, we consider a Markov reward model with a reward structure including only reward rates associated with states, in which both positive and negative reward rates are present and null reward rates are allowed, and develop a numerical method to compute the distribution function of the cumulative reward till exit of a subset of transient states of the model. The method combines a model transformation step with the solution of the transformed model using a randomization construction with two randomization rates. The method introduces a truncation error, but that error is strictly bounded from above by a user-specified error control parameter. Further, the method is numerically stable and takes advantage of the sparsity of the infinitesimal generator of the transformed model. Using a Markov reward model of a fault-tolerant hardware/software system, we illustrate the application of the method and analyze its computational cost. Also, we compare the computational cost of the method with that of the (only) previously available method for the problem. Our numerical experiments seem to indicate that the new method can be efficient and that for medium-size and large models can be substantially faster than the previously available method.
dc.format.extent12 p.
dc.publisherIEEE Computer Society Publications
dc.subjectÀrees temàtiques de la UPC::Matemàtiques i estadística::Probabilitat
dc.subject.lcshMarkov processes
dc.subject.otherFault tolerance
dc.subject.otherMarkov reward models
dc.subject.othermodeling techniques
dc.subject.othernumerical algorithms
dc.titleA Numerical method for the evaluation of the distribution of cumulative reward till exit of a Subset of transient states of a Markov reward model
dc.subject.lemacMarkov, Processos de
dc.contributor.groupUniversitat Politècnica de Catalunya. QINE - Disseny de Baix Consum, Test, Verificació i Circuits Integrats de Seguretat
dc.rights.accessOpen Access
dc.description.versionPostprint (author’s final draft)
upcommons.citation.authorCarrasco, J.; Suñe, V.
upcommons.citation.publicationNameIEEE transactions on dependable and secure computing

Files in this item


This item appears in the following Collection(s)

Show simple item record

All rights reserved. This work is protected by the corresponding intellectual and industrial property rights. Without prejudice to any existing legal exemptions, reproduction, distribution, public communication or transformation of this work are prohibited without permission of the copyright holder