1999 Fiscal Year Final Research Report Summary
A Study on Discounted Markov Decision Process with Variance Criterion and its Application
Project/Area Number |
10680430
|
Research Category |
Grant-in-Aid for Scientific Research (C)
|
Allocation Type | Single-year Grants |
Section | 一般 |
Research Field |
社会システム工学
|
Research Institution | TOTTORI UNIVERSITY |
Principal Investigator |
KAWAI Hajime Tottori University, Social Systems Engineering, Professor, 工学部, 教授 (50026316)
|
Co-Investigator(Kenkyū-buntansha) |
KAYANOGI Junji Tottori University, Social Systems Engineering, Assistant Professor, 工学部, 助手 (90225590)
|
Project Period (FY) |
1998 – 1999
|
Keywords | Markov Decision Process / total discounted cost / expected value / variance / Markovian deterioration system / renewal process / age replacement policy / block replacement |
Research Abstract |
In this research project, we treated Markov and Semi-Decision Process with a finite state space and a finite action space. To evaluate each stationary policy, we considered an expected value and variance as a criterion for risk of total discounted cost. Under this situation, we proposed optimal decision problems. (1)For a continuous time Markov process with costs, we first gave a set of equations to derive variance. Under mixed policy, we tried to give such equations. It is, however, too difficult to success. Next, we treated a continuous time Markovian deterioration system and derived expected value and variance of total discounted cost when a control limit replacement policy. Moreover, a decision problem of an optimal control limit state was numerically discussed. (2)For a semi-Markov process and renewal process with costs, we gave a method to derive expected value and variance. For a block replacement policy, we showed that variance can be obtained by considering only one cycle. (3)We treated a reliability system with a good state and a wearout state and discussed an optimal inspection, age replacement problem which takes into consideration both expected value and variance of total discounted inspection, replacement costs. An optimal inspection time interval was numerically investigated.
|