Choices and pitfalls concerning mixture-of-experts modeling.

AUTOR(ES)
DATA DE PUBLICAÇÃO

2005

RESUMO

Researchers of different fields often need to learn and represent phenomena through relationships between variables and use them to predict the phenomena behavior under uncertain conditions. However, choosing the "best" model in a modeling exercise is always an arduous task, yet because of the various uncertainties associated with the modeling process.A way of obtaining a better prediction than it would be provided by a single model may be by combining a number of different model structures. Each model is adopted at a given observation with a probability that depends on the values of the explanatory variables for that observation. This is the logic under the mixture-of-experts model (MEM).The general MEM framework specifies that a prediction is made up of a series of predictions from separate models, or experts, each of them weighted by a quantity determined by a so called gating function.However, when building a MEM, many important decisions ought to be made, such as determining the number of clusters in to which the global data is to be sectioned and the clustering method to be adopted; the nature of the gating function applied; the criteria employed to elect the experts and the data set selected for performing validation, for example. Depending on how these decisions are made, different mixtures might be formed, providing different results.In the present study, we investigated the way such decisions affect the performance of the MEM, when this technique employs statistical models, applied to regression problems. The problem under analysis consists of estimating the municipal gross domestic product for the Brazilian states of Parà and MaranhÃo, as functions of municipal macroeconomic and demographic variables.

ASSUNTO(S)

inteligÃncia artificial anÃlise de aglomerados anÃlise estatÃstica indicadores socioeconÃmicos produto interno bruto prediÃÃo modelos matemÃticos

ACESSO AO ARTIGO

Documentos Relacionados