Show simple item record

dc.contributor.authorCarrasco, Juan A.
dc.contributor.authorSuñé, Víctor
dc.contributor.otherUniversitat Politècnica de Catalunya. Departament d'Enginyeria Electrònica
dc.date.accessioned2014-07-02T08:08:06Z
dc.date.available2014-07-02T08:08:06Z
dc.date.created2011-09-12
dc.date.issued2011-09-12
dc.identifier.citationCarrasco, J.; Suñe, V. A Numerical method for the evaluation of the distribution of cumulative reward till exit of a Subset of transient states of a Markov reward model. "IEEE transactions on dependable and secure computing", 12 Setembre 2011, vol. 8, núm. 6, p. 798-809.
dc.identifier.issn1545-5971
dc.identifier.urihttp://hdl.handle.net/2117/23376
dc.description.abstractMarkov reward models have interesting modeling applications, particularly those addressing fault-tolerant hardware/software systems. In this paper, we consider a Markov reward model with a reward structure including only reward rates associated with states, in which both positive and negative reward rates are present and null reward rates are allowed, and develop a numerical method to compute the distribution function of the cumulative reward till exit of a subset of transient states of the model. The method combines a model transformation step with the solution of the transformed model using a randomization construction with two randomization rates. The method introduces a truncation error, but that error is strictly bounded from above by a user-specified error control parameter. Further, the method is numerically stable and takes advantage of the sparsity of the infinitesimal generator of the transformed model. Using a Markov reward model of a fault-tolerant hardware/software system, we illustrate the application of the method and analyze its computational cost. Also, we compare the computational cost of the method with that of the (only) previously available method for the problem. Our numerical experiments seem to indicate that the new method can be efficient and that for medium-size and large models can be substantially faster than the previously available method.
dc.format.extent12 p.
dc.language.isoeng
dc.publisherIEEE Computer Society Publications
dc.subjectÀrees temàtiques de la UPC::Matemàtiques i estadística::Probabilitat
dc.subject.lcshMarkov processes
dc.subject.otherFault tolerance
dc.subject.otherMarkov reward models
dc.subject.othermodeling techniques
dc.subject.othernumerical algorithms
dc.titleA Numerical method for the evaluation of the distribution of cumulative reward till exit of a Subset of transient states of a Markov reward model
dc.typeArticle
dc.subject.lemacMarkov, Processos de
dc.contributor.groupUniversitat Politècnica de Catalunya. QINE - Disseny de Baix Consum, Test, Verificació i Circuits Integrats de Seguretat
dc.identifier.doi10.1109/TDSC.2010.49
dc.relation.publisherversionhttp://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=5590256&tag=1
dc.rights.accessOpen Access
drac.iddocument5909294
dc.description.versionPostprint (author’s final draft)
upcommons.citation.authorCarrasco, J.; Suñe, V.
upcommons.citation.publishedtrue
upcommons.citation.publicationNameIEEE transactions on dependable and secure computing
upcommons.citation.volume8
upcommons.citation.number6
upcommons.citation.startingPage798
upcommons.citation.endingPage809


Files in this item

Thumbnail

This item appears in the following Collection(s)

Show simple item record

All rights reserved. This work is protected by the corresponding intellectual and industrial property rights. Without prejudice to any existing legal exemptions, reproduction, distribution, public communication or transformation of this work are prohibited without permission of the copyright holder