• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Studies on Mathematical Structure of Dynamic Programming

Research Project

Project/Area Number 09640243
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeSingle-year Grants
Section一般
Research Field General mathematics (including Probability theory/Statistical mathematics)
Research InstitutionChiba University

Principal Investigator

KURANO Masami  Chiba Univ., Faculty of Education, Prof., 教育学部, 教授 (70029487)

Co-Investigator(Kenkyū-buntansha) YOSHIDA Yuji  Kitakyushu Univ., Faculty of Economics, Prof., 経済学部, 教授 (90192426)
KADOTA Yoshinobu  Wakayama Univ., Faculty of Education, Prof., 教育学部, 教授 (90116294)
MARUYAMA Ken-ichi  Chiba Univ., Faculty of Education, Asist.Prof., 教育学部, 助教授 (70173961)
KENMOCHI Nobuyuki  Chiba Univ., Faculty of Education, Prof., 教育学部, 教授 (00033887)
UZAWA Masakazu  Chiba Univ., Faculty of Education, Prof., 教育学部, 教授 (80009026)
Project Period (FY) 1997 – 1998
Project Status Completed (Fiscal Year 1998)
Budget Amount *help
¥2,500,000 (Direct Cost: ¥2,500,000)
Fiscal Year 1998: ¥1,000,000 (Direct Cost: ¥1,000,000)
Fiscal Year 1997: ¥1,500,000 (Direct Cost: ¥1,500,000)
KeywordsDynamic Programming / Markov Decision Processes / Fuzzy Dynamic System / Markov Set-Chain / Fuzzy Stopping / Optimality Equation / general Utility / Optimal Policy / ファジィ動的計画法 / ファジィ-ストッピングルール / 数適方程式 / ファジィクラスターリング / ファジィ距離 / ファジイ動的計画法 / 一般効用最適化 / ファジイ決定
Research Abstract

In this project, our objective is to develope the structural study of Dynamic Programming(DP in short) and establish DP method which is more robust or more flexible in the sense that it is reasonably efficient in rough approximation and allows for fluctuating factors in sequential decision processes.
For this purpose. we tried to develope analytical studies on various mathematical decion model.
(1) Markov set-chain model As a model which is robust for rough approximation of the transition matrix in Markov decision processes, we introduced a decision model, called a controlled Markov set-chain, and derived a DP equation by which Pareto optimal policies was constructed. Some computational results are included.
(2) Fuzzy dynamic systems and stopping problem The ergodic theorem for the dynamic system with fuzzy state and fuzzy transition is developed and the existence and uniqueness of solutions of the corresponding DP equations is proved. Also, a stopping problem for dynamic fuzzy system is formulated and solved by an extended UP method.
(3) General utility model A stopped Markov decision process is analysed under general utility. The corresponding DP equation is described by a family of distributions and more usefull in application of DP.

Report

(3 results)
  • 1998 Annual Research Report   Final Research Report Summary
  • 1997 Annual Research Report
  • Research Products

    (27 results)

All Other

All Publications (27 results)

  • [Publications] 蔵野 正美: "A fuzzy relational equation in dynamic fuzzy systems" Fuzzy Sets and Systems. 101. 439-443 (1999)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] 蔵野 正美: "Controlled Markov set-chains with discounting" Journal of Applied Probability. 35. 293-302 (1998)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] 吉田 祐治: "A monotone fuzzy stopping time in dynamic fuzzy systems" To appear in Bulletin of Informatics and Cyber. 31. (1999)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] 蔵野 正美: "Constrained MDPs with compact State and action spaces" To appear in Optimization.

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] 蔵野 正美: "The time average reward for some dynamic fuzzy systems" To appear in Computers and Mathematics with Applications.

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] 剱持 信幸: "Parablic PDEs with hysteresis and quasivariational inequalities" Nonlinear Analysis. 34. 665-686 (1998)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] Kurano, M., Song, J.and Hosaka, M.: "Controlled Markov set-chains with discounting" Journal of Applied Probabiliy. Vol.35. 293-302 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] Yoshida, Y.: "The optimal stopped fuzzy rewards in some continuous-time dynamic fuzzy rewards" Mathmatical and Computer Modelling. Vol.26. 53-66 (1997)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] Yoshida, Y., Yasuda, M., Nakagami, J.and Kurano, M.: "A limit theorem in dynamic fuzzy systems with a monotone propery" Fuzzy Sets and Systems. Vol.94. 109-119 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] Yoshida, Y: "The recurrence of dynamic fuzzy systems" Fuzzy Sets and Systems. Vol.95. 319-332 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] Kadota, Y., Kurano, M.and Yasuda, M.: "On the general utility of discounted Markov decision processes" International Transactions in Operational Research. Vol.5. 27-34 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] Kenmochi, N., Koyama, T.and Meyer, G.H.: "Parabolic PDEs with hysteresis and quasivariational inequalities" Nonlinear Analysis. Vol.34. 665-686 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] Kurano, M., Yasuda, M., Nakagami, J.and Yoshida, Y.: "A fuzzy relational equation in dynamic fuzzy systems" Fuzzy Sets and Systems. Vol.101. 439-443 (1999)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] Kurano, M., Nakagami, J.and Horiguchi, M.: "Controlled Markov set-chains with set-valued reward." Proceeding of International Conf erence on Nonlinear Analysis and Convex Analysis(NACA98). (To appear).

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] Yoshida, Y., Yasuda, M., Nakagami, J.and Kurano, M.: "A monotone fuzzy stopping time in dynamic fuzzy systems" Bulletin of Informatics and Cybernetics. Vol.31(To appear). (1999)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] 蔵野 正美(共著): "A fuzzy relational equation in dynamic fuzzy systems" Fuzzy Sets and Systems. 101. 439-443 (1999)

    • Related Report
      1998 Annual Research Report
  • [Publications] 蔵野 正美(共著): "Controlled Markov set-chains with discounting" Journal of Applied Probability. 35. 293-302 (1998)

    • Related Report
      1998 Annual Research Report
  • [Publications] 蔵野 正美(共著): "Clustering by a fuzzy metric" To appear in Fuzzy Sets and Systems.

    • Related Report
      1998 Annual Research Report
  • [Publications] 吉田 祐治(共著): "A monotone fuzzy stopping times in dynamic fuzzy systems" To appear in Bulletin of Informatics and Cybernetics. 31. (1999)

    • Related Report
      1998 Annual Research Report
  • [Publications] 剱持 信幸(共著): "Parablic PDEs with hysteresis and quasivariational inequalities" Nonlinear Analysis. 34. 665-686 (1998)

    • Related Report
      1998 Annual Research Report
  • [Publications] 剱持 信幸(共著): "Asmptotic behaviour of solutions to non-isothermal phase mode with constraint in one-dimensionl space" Journal of the Mathematical Society of Japan. 50. 491-519 (1998)

    • Related Report
      1998 Annual Research Report
  • [Publications] 剱持,信幸(共著): "Global attractors of time-dependent double obstacle problems" Funct.Anal.Global Anal.,Springer-Verlag,Singapore. 288-301 (1997)

    • Related Report
      1997 Annual Research Report
  • [Publications] 吉田,祐治(共著): "A limit theorem in some dynamic fuzzy systems with a monotone property" Fuzzy Set and Systems. 94. 109-119 (1998)

    • Related Report
      1997 Annual Research Report
  • [Publications] 蔵野,正美(共著): "Controlled Markov set-chains with discounting" To appear in Journal of Applied Probability. (1998)

    • Related Report
      1997 Annual Research Report
  • [Publications] 門田,良信(共著): "On the general utility of discounted Markov decision processes" To appear in International Transaction in Operational Research. 4. (1998)

    • Related Report
      1997 Annual Research Report
  • [Publications] 蔵野,正美(共著): "The time average reward for some dynamic fuzzy systems" To appear in Computers and Mathematics with Applications.

    • Related Report
      1997 Annual Research Report
  • [Publications] 蔵野,正美(共著): "A fuzzy relational equation in dynamic fuzzy systems" To appear in Fuzzy Sets and Systems.

    • Related Report
      1997 Annual Research Report

URL: 

Published: 1997-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi