• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Studies on Flexibly Structured Models of Decision Making

Research Project

Project/Area Number 15540105
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeSingle-year Grants
Section一般
Research Field General mathematics (including Probability theory/Statistical mathematics)
Research InstitutionChiba University

Principal Investigator

KURANO Masami  Chiba Univ., Faculty of Education, Professor, 教育学部, 教授 (70029487)

Co-Investigator(Kenkyū-buntansha) KENMOCHI Nobuyuki  Chiba Univ., Faculty of Education, Professor, 教育学部, 教授 (00033887)
YASUDA Masami  Chiba Univ., Faculty of Science, Professor, 理学部, 教授 (00041244)
NAKAGAMI Jun-ichi  Chiba Univ., Faculty of Science, Professor, 理学部, 教授 (30092076)
KADOTA Yoshinobu  Wakayama Univ., Faculty of Education, Professor, 教育学部, 教授 (90116294)
YOSHIDA Yuji  Univ.of Kitakyushu, Faculty of Economics and Business Administration, Professor, 経済学部, 教授 (90192426)
Project Period (FY) 2003 – 2005
Project Status Completed (Fiscal Year 2005)
Budget Amount *help
¥3,400,000 (Direct Cost: ¥3,400,000)
Fiscal Year 2005: ¥1,000,000 (Direct Cost: ¥1,000,000)
Fiscal Year 2004: ¥1,100,000 (Direct Cost: ¥1,100,000)
Fiscal Year 2003: ¥1,300,000 (Direct Cost: ¥1,300,000)
KeywordsFlexibly structured model / Markov decision process / Fuzzy dynamic programming / Adaptive Markov model / General utility model / Fuzzy stopping model / Perceptive information / Structured algorithm / 知覚情報 / ファジィ最適方程式 / 強化学習 / 適応政策 / ファジィ動的計画法 / 知覚的マルコフ決定モデル / 知覚値 / 平均基準の最適停止問題 / 多重連鎖マルコフモデル / 適応型マルコフ決定過程 / ファジイグループ決定 / 一般効用関数 / セミ・マルコフモデル / ファジイストッピング / ファジイクラスターリング
Research Abstract

In this project, our objective is to establish the mathematical theory on decision making processes with more flexible sand soft structure, applying the ideas of symthesis and integration. To this end, we have dealt with various flexibly structured models.
The main research results are as follows.
1. Uncertain Markov decision processes (MDPs) with perception-based information
Formulating a fuzzy perceptive model for MDPs in which the perception for transition matrices is described by fuzzy sets, we have succeeds in deriving a fuzzy optimality relation to estimate the optimal fuzzy reward by which a soft computing algorithm becomes to be possible.
2. Adaptive Markov decision models
We have developed a learning algorithm of the reward-penalty type for the communicating case of multichain MDPs by which an adaptively optimal policy is constructed. Also, a numerical experiment has been done successfully.
3. Fuzzy stopping models and their applications to group decision processes
The perceptive fuzzy model for stopping problems has been formulated and the method of computing the fuzzy perceptive reward when stopped optimally has been obtained. These ideas are applied to develop a perception-based theory for a multivariate stopping problem with a monotone rule. Moreover, to some extent, it succeeds in applying our analytic results to finance engineering (American put option and so on).
4.Decision making models with general regret utility functions
The optimization problem of general regret utility case for countable sate semi-MDPs with an absorbing set is considered., We have succeeded in deriving the optimality equations which determine the optimal regret policy. These results has been extended to the case of multiple constraints

Report

(4 results)
  • 2005 Annual Research Report   Final Research Report Summary
  • 2004 Annual Research Report
  • 2003 Annual Research Report
  • Research Products

    (26 results)

All 2006 2005 2004 2003 Other

All Journal Article (21 results) Publications (5 results)

  • [Journal Article] Discounted Markov decision processes with utility constraints2006

    • Author(s)
      門田良信(共著)
    • Journal Title

      Computers & Mathematics with Applications 51

      Pages: 279-284

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Discounted Markov decision processes with utility constraints2006

    • Author(s)
      Kadota, Y., Kurano, M., Yasuda, M.
    • Journal Title

      Computers & Mathematics with Applications Vol.51

      Pages: 279-284

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Discounted Markov decision processes with utility constraints2006

    • Author(s)
      門田良信(共著)
    • Journal Title

      Computers and Mathematics with applications (掲載予定)

    • Related Report
      2005 Annual Research Report
  • [Journal Article] A discrete-time American put potion model with fuzziness of stock prices2005

    • Author(s)
      吉田祐治(共著)
    • Journal Title

      Fuzzy Optimization and Decision Making 4

      Pages: 191-207

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] A discrete-time American put option model with fuzziness of stock prices2005

    • Author(s)
      Yoshida, Y., Yasuda, M., Nakagami, T., Kurano, M.
    • Journal Title

      Fuzzy Optimization and Decision Making Vol.4

      Pages: 191-207

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Stopping game problem for dynamic fuzzy systems2005

    • Author(s)
      吉田祐治(共著)
    • Journal Title

      Annals of the International Society of Dynamic Games 7

      Pages: 211-222

    • Related Report
      2005 Annual Research Report
  • [Journal Article] A discrete-time American put option model with fuzziness of stock prices2005

    • Author(s)
      吉田祐治(共著)
    • Journal Title

      Fuzzy Optimization and Decision Making 4

      Pages: 191-207

    • Related Report
      2005 Annual Research Report
  • [Journal Article] A fuzzy stopping problem with the concept of perception2004

    • Author(s)
      蔵野正美(共著)
    • Journal Title

      Fuzzy Optimization and Decision Making 3

      Pages: 367-374

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] A fuzzy stopping problem with the concept of perception2004

    • Author(s)
      Kurano, M., Yasuda, M., Nakagami, J., Yoshida, Y.
    • Journal Title

      Fuzzy Optimization and Decision Making Vol.3

      Pages: 367-374

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Regret-optimality equation in semi-MDPs with an absorbing set2004

    • Author(s)
      門田 良信
    • Journal Title

      京都大学数理解析研究所講究録 1373

      Pages: 8-16

    • Related Report
      2004 Annual Research Report
  • [Journal Article] Dynamic decision making with fuzzy preferences as a utility2004

    • Author(s)
      吉田 裕治
    • Journal Title

      京都大学数理解析研究所講究録 1383

      Pages: 52-63

    • Related Report
      2004 Annual Research Report
  • [Journal Article] A fuzzy stopping problem with the concept of perception2004

    • Author(s)
      蔵野 正美
    • Journal Title

      Fuzzy Optimization and Decision Making 3

      Pages: 367-374

    • Related Report
      2004 Annual Research Report
  • [Journal Article] Stopped semi-MDPs with multiple constraints2004

    • Author(s)
      堀口 正之
    • Journal Title

      Proceedings of the International Conferences on Nonlinear Analysis and Convex Analysis

      Pages: 81-96

    • Related Report
      2004 Annual Research Report
  • [Journal Article] A fuzzy stopping problem with the concept of perception : The infinite case2004

    • Author(s)
      蔵野 正美
    • Journal Title

      Proceedings of the International Conferences on Nonlinear Analysis and Convex Analysis

      Pages: 233-243

    • Related Report
      2004 Annual Research Report
  • [Journal Article] Stopping game problem for dynamic fuzzy systems2004

    • Author(s)
      吉田 裕治
    • Journal Title

      Annals of the International Society of Dynamic Games 7

      Pages: 211-222

    • Related Report
      2004 Annual Research Report
  • [Journal Article] Markov decision processes with fuzzy rewards2003

    • Author(s)
      蔵野正美(共著)
    • Journal Title

      Journal of Nonlinear and Convex Analysis 4

      Pages: 105-115

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Fuzzy stopping problems in continuous-time fuzzy stochastic systems2003

    • Author(s)
      吉田祐治(共著)
    • Journal Title

      Fuzzy Sets and Systems 139

      Pages: 349-362

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] A multiobjective fuzzy stopping in a stochastic and fuzzy environment2003

    • Author(s)
      吉田祐治(共著)
    • Journal Title

      Computers & Mathematics with Applications 46

      Pages: 1165-1172

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Markov decision processes with fuzzy rewards2003

    • Author(s)
      Kurano, M., Yasuda, M., Nakagami, J., Yoshida, Y.
    • Journal Title

      Journal of Nonlinear and Convex Analysis Vol.4

      Pages: 105-115

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Fuzzy stopping problems in continuous-time fuzzy stochastic systems2003

    • Author(s)
      Yoshida, Y., Yasuda, M., Nakagami, T., Kurano, M.
    • Journal Title

      Fuzzy Sets and Systems Vol.139

      Pages: 349-362

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] A multiobjective fuzzy stopping in a stochastic and fuzzy environment2003

    • Author(s)
      Yoshida, Y., Yasuda, M., Nakagami, T., Kurano, M.
    • Journal Title

      Computers & Mathematics with Applications Vol.46

      Pages: 1165-1172

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Publications] 蔵野正美(共著): "Markov decision processes with fuzzy rewards"Journal of Nonlinear and Convex Analysis. 4・1. 105-115 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] 蔵野正美(共著): "A fuzzy stopping problem with the concept of perception"京都大学数理解析研究所講究録. 1306. 40-46 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] 吉田祐治(単著): "Continuous-time fuzzy decision processes with discounted rewards"Fuzzy Sets and Systems. 139. 333-348 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] 吉田祐治(共著): "Fuzzy stopping problems in continuous-time fuzzy stochastic systems"Fuzzy Sets and Systems. 139. 349-362 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] 吉田祐治(共著): "A multi-objective fuzzy stopping in a stochastic and fuzzy environment"Computers and Mathematics with Applications. 46. 1165-1172 (2003)

    • Related Report
      2003 Annual Research Report

URL: 

Published: 2003-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi