Using richly parameterised models for small datasetscan be justified from a theoretical point of viewaccording to some results due to Bartlett which show that thegeneralization performance of a multi layer perceptron (MLP)depends more on the L1 norm of the weightsbetween the hidden and the output layer rather than on thenumber of parameters in the model.In this paper we investigate the problem of measuring the generalizationperformance and the complexity of richly parameterised procedures and,drawing on linear model theory, we propose a different notion of degrees of freedomto neural networks and other projection tools. This notion is compatible withsimilar ideas long associated with smoothers based models(like projection pursuit regression) and can be interpreted using the projectiontheory of linear models and showing some geometrical properties of neural networks.Results in this study lead to corrections insome goodness-of-fit statistics like AIC, BIC/SBC:the number of degrees of freedom in theseindexes are set equal to the dimension p of the projection spaceintrinsically found by the mapping function.An empirical study is presented in order toillustrate the behavior of the valuesof some selection model criteria.
On the degrees of freedom in richly parameterized models / S., Ingrassia; Morlini, Isabella. - STAMPA. - (2004), pp. 1237-1244. ((Intervento presentato al convegno Computational Statistics: 16th Symposium Held in Prague tenutosi a Prague, Czech Republic nel 23-27 Agosto 2004.
Data di pubblicazione: | 2004 |
Titolo: | On the degrees of freedom in richly parameterized models |
Autore/i: | S., Ingrassia; Morlini, Isabella |
Autore/i UNIMORE: | |
Nome del convegno: | Computational Statistics: 16th Symposium Held in Prague |
Luogo del convegno: | Prague, Czech Republic |
Data del convegno: | 23-27 Agosto 2004 |
Pagina iniziale: | 1237 |
Pagina finale: | 1244 |
Citazione: | On the degrees of freedom in richly parameterized models / S., Ingrassia; Morlini, Isabella. - STAMPA. - (2004), pp. 1237-1244. ((Intervento presentato al convegno Computational Statistics: 16th Symposium Held in Prague tenutosi a Prague, Czech Republic nel 23-27 Agosto 2004. |
Tipologia | Relazione in Atti di Convegno |
File in questo prodotto:
File | Descrizione | Tipologia | |
---|---|---|---|
Proceedings-COMPSTAT-2004.pdf | Versione dell'editore (versione pubblicata) | Open Access Visualizza/Apri |

I documenti presenti in Iris Unimore sono rilasciati con licenza Creative Commons Attribuzione - Non commerciale - Non opere derivate 3.0 Italia, salvo diversa indicazione.
In caso di violazione di copyright, contattare Supporto Iris