• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Studios on theory of optimization with utility in stochastic model

Research Project

Project/Area Number 14540125
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeSingle-year Grants
Section一般
Research Field General mathematics (including Probability theory/Statistical mathematics)
Research InstitutionKochi University

Principal Investigator

OHTSUBO Yoshio  Kochi University, Faculty of Science, Professor, 理学部, 教授 (20136360)

Co-Investigator(Kenkyū-buntansha) YASUDA Masami  Chiba University, Faculty of Science, Professor, 理学部, 教授 (00041244)
IWAMOTO Seiiti  Kyushu University, Faculty of Economics, Professor, 大学院・経済学研究院, 教授 (90037284)
NIIZEKI Shozo  Kochi University, Faculty of Science, Professor, 理学部, 教授 (60036572)
NOMAKUCHI Kentaro  Kochi University, Faculty of Science, Professor, 理学部, 教授 (60124806)
Project Period (FY) 2002 – 2004
Project Status Completed (Fiscal Year 2004)
Budget Amount *help
¥3,400,000 (Direct Cost: ¥3,400,000)
Fiscal Year 2004: ¥1,000,000 (Direct Cost: ¥1,000,000)
Fiscal Year 2003: ¥1,000,000 (Direct Cost: ¥1,000,000)
Fiscal Year 2002: ¥1,400,000 (Direct Cost: ¥1,400,000)
KeywordsMarkov decision process / threshold probability / optimal value and optimal policy / equivalence class / Fuzzy measure / stochastic optimization / finite intersection family / EM algorithm / ファジィ測度 / 確率モデル / 最適化理論 / 最適停止問題 / ファジィ決定過程 / 動的計画 / スターリングの公式 / 最尤推定 / ガウス積分 / 2次計画問題
Research Abstract

The summary of research results is as follows.
1.We consider risk minimizing problems in undiscounted Markov decisions processes with a target set. We formulate the problem as an infinite horizon case with a recurrent class. We show that an optimal value function is a unique solution to an optimality equation and there exists an stationary optimal policy. Also we give several value iteration methods and a policy improvement method. We also consider eight problems in which we maximize or minimize threshold probabilities in discounted Markov decision processes with bounded reward set. We show that such problems are classified to two equivalence classes and give a relationship between optimal values and optimal policies of problems in each equivalence class. We also give two sufficient conditions for the existence of an optimal policy. Finally we give a relationship of optimal values between first and second equivalence classes.
2.We solves a finite horizon stochastic optimization problem with forward recursive criterion through dynamic programming. The basic idea is to apply invariant imbedding method for stochastic programming.
3.We show that weakly null-additive fuzzy measures on metric spaces posses regularity Lusin's theorem is generalized to fuzzy measure space by using the regularity and weakly null-additivity
4.We introduce an idea of finite intersection family into a topological space, characterize several concepts in a topological space by mean of finite intersection family and illustrate some applications of finite intersection family.
5.EM-algorithm users believe that the conditions of Wu(1983) assure the convergence of GEM sequence, but this paper gives a brief counter example which satisfies Wu's conditions but not converge to MILE or any optimal solutions. It also gives a correction of his proof for the convergence of EM sequence.

Report

(4 results)
  • 2004 Annual Research Report   Final Research Report Summary
  • 2003 Annual Research Report
  • 2002 Annual Research Report
  • Research Products

    (28 results)

All 2005 2004 2003 2002 Other

All Journal Article (16 results) Publications (12 results)

  • [Journal Article] Does GEM converge to MLE under Wu's condition-A counter example-2005

    • Author(s)
      K.Nomakuchi
    • Journal Title

      Bulletin of Informatics and Cybernetics 37巻1号(印刷中)

    • NAID

      120001014488

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Annual Research Report 2004 Final Research Report Summary
  • [Journal Article] Does GEM converge to MLE under Wu' s condition -A counter example-2005

    • Author(s)
      K.Nomakuchi
    • Journal Title

      Bulletin of Informatics and Cybernetics Vol.37 (in press)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Optimal threshold probability in undiscounted Markov decision processes with a target set2004

    • Author(s)
      Y.Ohtsubo
    • Journal Title

      Applied Mathematics and Computation 149巻2号

      Pages: 519-532

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Annual Research Report 2004 Final Research Report Summary
  • [Journal Article] Equivalence classes for optimization risk models in Markov decision processes2004

    • Author(s)
      Y.Ohtsubo, K.Toyonaga
    • Journal Title

      Mathematical Methods of Operations Research 60巻2号

      Pages: 239-250

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Annual Research Report 2004 Final Research Report Summary
  • [Journal Article] Lusin's theorem on fuzzy measure spaces2004

    • Author(s)
      J.Jun, M.Yasuda
    • Journal Title

      Fuzzy sets and Systems 146巻1号

      Pages: 121-133

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Annual Research Report 2004 Final Research Report Summary
  • [Journal Article] Stochastic optimization of forward recursive functions2004

    • Author(s)
      S.Iwamoto
    • Journal Title

      Journal of Mathematical Analysis and Applications 292巻1号

      Pages: 73-83

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Annual Research Report 2004 Final Research Report Summary
  • [Journal Article] Finite intersection family in a topological space2004

    • Author(s)
      S.Niizeki
    • Journal Title

      Far East Journal of Mathematical Sciences 12巻2号

      Pages: 225-237

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Annual Research Report 2004 Final Research Report Summary
  • [Journal Article] Optimal threshold probability in undiscounted Markov decision processes with a target set2004

    • Author(s)
      Y.Ohtsubo
    • Journal Title

      Applied Mathematics and Computation Vol.149

      Pages: 519-532

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Equivalence classes for optimizing risk models in Markov decision processes2004

    • Author(s)
      Y.Ohtsubo, K.Toyonaga
    • Journal Title

      Mathematical Methods of Operations Research Vol.60, No.2

      Pages: 239-250

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Lusin's theorem on fuzzy measure spaces2004

    • Author(s)
      J.Jun, M.Yasuda
    • Journal Title

      Fuzzy sets and Systems Vol.146

      Pages: 121-133

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Stochastic optimization of forward recursive functions2004

    • Author(s)
      S.Iwamoto
    • Journal Title

      J.Mathematical Analysis and Applications Vol.292

      Pages: 73-83

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Finite intersection family in a topological space2004

    • Author(s)
      S.Niizeki
    • Journal Title

      Far East Journal of Mathematical Sciences Vol.12

      Pages: 225-237

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Value iteration methods in risk minimizing stopping problem2003

    • Author(s)
      Y.Ohtsubo
    • Journal Title

      J.Computational and Applied Mathematics Vol.152

      Pages: 427-439

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Minimizing risk models in stochastic shortest path problems2003

    • Author(s)
      Y.Ohtsubo
    • Journal Title

      Mathematical Methods of Operations Research Vol.57, No.1

      Pages: 79-88

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Risk minimization in optimal stopping problem and applications2003

    • Author(s)
      Y.Ohtsubo
    • Journal Title

      J.Operations Research Society of Japan Vol.46

      Pages: 342-352

    • NAID

      110001183577

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Optimal policy for minimizing risk models in Markov decision processes2002

    • Author(s)
      Y.Ohtsubo, K.Toyonaga
    • Journal Title

      J.Mathematical Analysis and Applications Vol.271

      Pages: 66-81

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Publications] Y.Ohtsubo: "Optimal threshold probability in undiscounted Markov decision processes with a target set"Applied Mathematics and Computation. 149. 519-532 (2004)

    • Related Report
      2003 Annual Research Report
  • [Publications] Y.Ohtsubo: "Risk minimization in optional stopping problem and application"J.Operations Research Society of Japan. 46. 342-352 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] M.Yasuda: "Markov decision processes with fuzzy rewards (with M.Kurano J.Nakagami and Y.Yoshida)"J.Nonlinear and Convex Analysis. 4. 105-115 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] S.Iwamoto: "Stochastic optimization of forward recursive functions"J.Mathematical Analysis and Applications. 292. 73-83 (2004)

    • Related Report
      2003 Annual Research Report
  • [Publications] S.Niizeki: "On a method to prove Stirling's formula"Tamsui Oxford Journal of Mathematical Science. 19. 117-120 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] K.Nomakuchi: "Does GEM converge to MLE under Wu's conditions-A counter example-"Bulletin of Informatics and Cybernetics. (印刷中). 1-7 (2004)

    • Related Report
      2003 Annual Research Report
  • [Publications] Y.Ohtsubo: "Value iteration methods in risk minimizing stopping problem"J. Computational and Applied Mathematics. 152. 427-439 (2003)

    • Related Report
      2002 Annual Research Report
  • [Publications] Y.Ohtsubo: "Minimizing risk models in stochastic shortest path problems"Mathematical Methods of Operations Research. 57(印刷中). (2003)

    • Related Report
      2002 Annual Research Report
  • [Publications] M.Yasuda: "Au approach to stopping problems of a dymanic fuzzy system (with M.Kurano, J.Nakagami and Y.Yoshida"Fuzzy Sets and Systems. 131. 225-233 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] S.Iwamoto: "Optimal stopping in fuzzy environment"Proceedings of the 9-th Bellman Continuum, Series of Information & Management Sciences. 2. 264-269 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] S.Niizeki: "On a concise method to calculate Gaussian integral"Mem. Fac. Sci. Kochi Univ. (Math.). (印刷中). (2003)

    • Related Report
      2002 Annual Research Report
  • [Publications] K.Nomakuchi: "On the algorithm of Dykstra in a quadratic programming problem on a closed convex cone"Mem. Fac. Sci. Kochi Univ. (Math.). (印刷中). (2003)

    • Related Report
      2002 Annual Research Report

URL: 

Published: 2002-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi