2011 Fiscal Year Final Research Report
Research on model selection of multi-layer perceptron
| Project/Area Number |
21500215
|
|---|
| Research Category |
Grant-in-Aid for Scientific Research (C)
|
| Allocation Type | Single-year Grants |
|---|
| Section | 一般 |
|---|
| Research Field |
Sensitivity informatics/Soft computing
|
|---|
| Research Institution | Mie University |
|---|
Principal Investigator |
|
|---|
| Project Period (FY) |
2009 – 2011
|
| Keywords | 多層パーセプトロン / 特異モデル / モデル選択 / 可変基底 / ノンパラメトリック回帰 |
|---|
| Research Abstract |
In this research, we focus on a variability of basis functions in multi-layer perceptron and establish a model selection method for the case where basis functions are selected from a finite set of functions, in which the number of candidates is equal to the number of data. In the proposed method, functions in the set are orthogonalized and their coefficients are estimated. Inefficient coefficients are set to zero by thresholding. Then inverse transform yields the weights of original basis functions. The threshold level in this method is theoretically reasonable since it derived based on the variability of basis functions. We can obtain a smooth output and/or sparse representation depending on the method of orthogonalization. The method is applicable to multi-layer perceptron under a certain training algorithm.
|
