Discrete time Reward Models for homogeneous semi-Markov Systems

SI McClean, A Papadopoulou, G Tsaklides

Research output: Contribution to journalArticle

13 Citations (Scopus)

Abstract

Previously,continuous time Markov and semi Markow models have been developed for a multi-grade system with a number of transient states and a single absorbing state.Such systems have been studied with Poisson arrivals with known growth.Such models have been applied to manpower planning and the movement of patients through a hospital system.In this paper,we develop a reward model for a discrete time homogeneous semi Markov system with Poisson arrivals and the same model where the system has growth with known size at each time point.Discrete time is employed here to accommodate a discrete reward structure.Results are obtained for the distribution,and mean of daily rewards of such system at any time,and in steady state;the expected reward in a period of time is also determined.These results are illustrated using data on employees moving through a company hierarchy and data for hospital patients. Key Words: Homogeneity; Poisson recruitment; Semi-Markov process; Stochastic population model; Rewards.
LanguageEnglish
Pages623-623
JournalCommunications in Statistics - Theory and Methods
Volume33
Issue number3
Publication statusPublished - 1 Mar 2004

Fingerprint

Reward
Discrete-time
Siméon Denis Poisson
Manpower Planning
Model
Semi-Markov Process
Transient State
Population Model
Period of time
Absorbing
Homogeneity
Stochastic Model
Continuous Time

Cite this

@article{0524b1238ad54198b428db1e2531f833,
title = "Discrete time Reward Models for homogeneous semi-Markov Systems",
abstract = "Previously,continuous time Markov and semi Markow models have been developed for a multi-grade system with a number of transient states and a single absorbing state.Such systems have been studied with Poisson arrivals with known growth.Such models have been applied to manpower planning and the movement of patients through a hospital system.In this paper,we develop a reward model for a discrete time homogeneous semi Markov system with Poisson arrivals and the same model where the system has growth with known size at each time point.Discrete time is employed here to accommodate a discrete reward structure.Results are obtained for the distribution,and mean of daily rewards of such system at any time,and in steady state;the expected reward in a period of time is also determined.These results are illustrated using data on employees moving through a company hierarchy and data for hospital patients. Key Words: Homogeneity; Poisson recruitment; Semi-Markov process; Stochastic population model; Rewards.",
author = "SI McClean and A Papadopoulou and G Tsaklides",
year = "2004",
month = "3",
day = "1",
language = "English",
volume = "33",
pages = "623--623",
journal = "Communications in Statistics - Theory and Methods",
issn = "0361-0926",
number = "3",

}

Discrete time Reward Models for homogeneous semi-Markov Systems. / McClean, SI; Papadopoulou, A; Tsaklides, G.

In: Communications in Statistics - Theory and Methods, Vol. 33, No. 3, 01.03.2004, p. 623-623.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Discrete time Reward Models for homogeneous semi-Markov Systems

AU - McClean, SI

AU - Papadopoulou, A

AU - Tsaklides, G

PY - 2004/3/1

Y1 - 2004/3/1

N2 - Previously,continuous time Markov and semi Markow models have been developed for a multi-grade system with a number of transient states and a single absorbing state.Such systems have been studied with Poisson arrivals with known growth.Such models have been applied to manpower planning and the movement of patients through a hospital system.In this paper,we develop a reward model for a discrete time homogeneous semi Markov system with Poisson arrivals and the same model where the system has growth with known size at each time point.Discrete time is employed here to accommodate a discrete reward structure.Results are obtained for the distribution,and mean of daily rewards of such system at any time,and in steady state;the expected reward in a period of time is also determined.These results are illustrated using data on employees moving through a company hierarchy and data for hospital patients. Key Words: Homogeneity; Poisson recruitment; Semi-Markov process; Stochastic population model; Rewards.

AB - Previously,continuous time Markov and semi Markow models have been developed for a multi-grade system with a number of transient states and a single absorbing state.Such systems have been studied with Poisson arrivals with known growth.Such models have been applied to manpower planning and the movement of patients through a hospital system.In this paper,we develop a reward model for a discrete time homogeneous semi Markov system with Poisson arrivals and the same model where the system has growth with known size at each time point.Discrete time is employed here to accommodate a discrete reward structure.Results are obtained for the distribution,and mean of daily rewards of such system at any time,and in steady state;the expected reward in a period of time is also determined.These results are illustrated using data on employees moving through a company hierarchy and data for hospital patients. Key Words: Homogeneity; Poisson recruitment; Semi-Markov process; Stochastic population model; Rewards.

M3 - Article

VL - 33

SP - 623

EP - 623

JO - Communications in Statistics - Theory and Methods

T2 - Communications in Statistics - Theory and Methods

JF - Communications in Statistics - Theory and Methods

SN - 0361-0926

IS - 3

ER -