Browsing by Subject "Markov processes"
Now showing items 1-20 of 113
-
A comparative study of different gradient approximations for Restricted Boltzmann Machines
(Universitat Politècnica de Catalunya, 2023-06-29)
Master thesis
Open Access
Covenantee: Universitat Rovira i Virgili. Escola Tècnica Superior d'Enginyeria / Universitat de Barcelona. Facultat de Matemàtiques i InformàticaThis project consists of the theoretical study of Restricted Boltzmann Machines(RBMs) and focuses on the gradient approximations of RBMs. RBMs suffer from the dilemma of accurate learning with the exact gradient. Based on ... -
A comparison of numerical splitting-based methods for Markovian dependability and performability models
(Springer, 1998)
Conference report
Open AccessIterative numerical methods are an important ingredient for the solution of continuous time Markov dependability models of fault-tolerant systems. In this paper we make a numerical comparison of several splitting-based ... -
A failure-distance based method to bound the reliability of non-repairable Fault-tolerant systems without the knowledge of minimal cuts
(2000-12-11)
Research report
Open AccessCTMC (continuous-time Markov chains) are a commonly used formalism for modeling fault-tolerant systems. One of the major drawbacks of CTMC is the well-known state-space explosion problem. This work develops and analyzes ... -
A generalized method for the transient analysis of Markov models of fault-tolerant systems with deferred repair
(2005-07)
Article
Open AccessRandomization is an attractive alternative for the transient analysis of continuous time Markov models. The main advantages of the method are numerical stability, well-controlled computation error, and ability to specify ... -
A generalized method for the transient analysis of Markov models of fault-tolerant systems with deferred repair
(2009-09-15)
Research report
Open AccessRandomization is an attractive alternative for the transient analysis of continuous time Markov models. The main advantages of the method are numerical stability, well-controlled computation error and ability to specify ... -
A mobile controlled algorithm for improving the throughput in a s-aloha ds-cdma system
(Institute of Electrical and Electronics Engineers (IEEE), 1996)
Conference report
Open AccessThis paper presents a novel adaptive DS-CDMA slotted-ALOHA packet random access scheme with transmitter-based spreading codes for mobiles. It is aimed at improving the throughput and message delay delivery when traffic ... -
A new general-purpose method for the computation of the interval availability distribution
(2013-11-18)
Article
Open AccessWe develop a new randomization-based general-purpose method for the computation of the interval availability distribution of systems modeled by continuous-time Markov chains (CTMCs). The basic idea of the new method is ... -
A Numerical method for the evaluation of the distribution of cumulative reward till exit of a Subset of transient states of a Markov reward model
(IEEE Computer Society Publications, 2011-09-12)
Article
Open AccessMarkov reward models have interesting modeling applications, particularly those addressing fault-tolerant hardware/software systems. In this paper, we consider a Markov reward model with a reward structure including only ... -
A proposal for an adaptive s-aloha access system for a mobile cdma environment
(1998-08)
Article
Open AccessThis paper presents a novel adaptive direct-sequence code-division multiple-access (DS-CDMA) slotted-ALOHA (S-ALOHA) packet random-access scheme with transmitter-based spreading codes for mobiles. It is aimed at improving ... -
A reinforcement learning approach using Markov decision processes for battery energy storage control within a smart contract framework
(Elsevier, 2024-05-10)
Article
Restricted access - publisher's policyWith the increasing penetration of renewable energy sources (RESs), the necessity for employing smart methods to control and manage energy has become undeniable. This study introduces a real-time energy management system ... -
Adapted importance sampling schemes for the simulation of dependability models of Fault-tolerant systems with deferred repair
(2006)
Conference report
Open AccessThis paper targets the simulation of continuous-time Markov chain models of fault-tolerant systems with deferred repair. We start by stating sufficient conditions for a given importance sampling scheme to satisfy the bounded ... -
Adaptively learning probabilistic deterministic automata from data streams
(2014-07)
Article
Restricted access - publisher's policyMarkovian models with hidden state are widely-used formalisms for modeling sequential phenomena. Learnability of these models has been well studied when the sample is given in batch mode, and algorithms with PAC-like ... -
Algebraic statistics in phylogenetic reconstruction: incorporating invariable sites
(Universitat Politècnica de Catalunya, 2023-06)
Master thesis
Open AccessIn modern phylogenetics, when comparing sequences of DNA the traditional approach assumes that nu- cleotide substitutions follow a Markov model, that sites on a DNA sequence evolve independently and in the same way. However, ... -
An application of explainability methods in reinforcement learning
(Universitat Politècnica de Catalunya, 2020-07-02)
Bachelor thesis
Open AccessLa popularidad de los métodos explicativos está aumentando en el contexto de la Inteligencia Artificial y consiste en dar explicaciones inteligibles a modelos complejos. Recientemente, en el contexto del Aprendizaje Reforzado ... -
An efficient and numerically stable method for computing bounds for the interval availability distribution
(2011)
Article
Open AccessThis paper is concerned with the computation of the interval availability (proportion of time in a time interval in which the system is up) distribution of a fault-tolerant system modeled by a finite (homogeneous) ... -
An efficient and numerically stable method for computing interval availability distribution bounds
(2009-09-15)
Research report
Open AccessThe paper develops a method, called bounding regenerative transformation, for the computation with numerical stability and well-controlled error of bounds for the interval availability distribution of systems modeled by ... -
An ensemble of parameters from a robust Markov-based model reproduces L-type calcium currents from different human cardiac myocytes
(Public Library of Science (PLOS), 2022-04-05)
Article
Open AccessThe development of modeling structures at the channel level that can integrate subcellular and cell models and properly reproduce different experimental data is of utmost importance in cardiac electrophysiology. In contrast ... -
An open set of 4×4 embeddable matrices whose principal logarithm is not a Markov generator
(Taylor & Francis, 2020-12-17)
Article
Open AccessA Markov matrix is embeddable if it can represent a homogeneous continuous-time Markov process. It is well known that if a Markov matrix has real and pairwise-different eigenvalues, then the embeddability can be determined ... -
Analysis of a type II hybrid ARQ strategy in a DS-CDMA packet transmission environment
(IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC, 2003-08)
Article
Open AccessA type II hybrid automatic repeat request scheme is considered as a retransmission strategy in a direct-sequence code-division multiple-access packet mobile radio network. An analysis based on equilibrium point analysis ... -
Analytical modeling and performance evaluation of cell selection algorithms for mobile networks with backhaul capacity constraints
(2013-10-28)
Article
Restricted access - publisher's policyWireless communications technologies play an essential role to support the Public Protection and Disaster Relief (PPDR) operational needs. The current Private/Professional Mobile Radio (PMR) technologies used for PPDR ...
