skip to content

Faculty of Economics

Journal Cover

Srisuma, S. and Linton, O.

Semiparametric estimation of Markov decision processes with continuous state space

Journal of Econometrics

Vol. 166(2) pp. 320-341 (2012)

Abstract: We propose a general two-step estimator for a popular Markov discrete choice model that includes a class of Markovian games with continuous observable state space. Our estimation procedure generalizes the computationally attractive methodology of Pesendorfer and Schmidt-Dengler (2008) that assumed finite observable states. This extension is non-trivial as the policy value functions are solutions to some type II integral equations. We show that the inverse problem is well-posed. We provide a set of primitive conditions to ensure root-T consistent estimation for the finite dimensional structural parameters and the distribution theory for the value functions in a time series framework.

JEL Codes: C13, C14, C51

Author links: Oliver Linton  

Publisher's Link: http://www.sciencedirect.com/science/article/pii/S030440761100234X



Papers and Publications



Recent Publications


Fruehwirth, J., Iyer, S. and Zhang, A. Religion and Depression in Adolescence Journal of Political Economy [2019]

Ambrus, A. and Elliott, M. Investments in Social Ties, Risk Sharing, and Inequality Review of Economic Studies [2020]

Bergin, P. R. and Corsetti, G. Beyond Competitive Devaluations: The Monetary Dimensions of Comparative Advantage American Economic Journal: Macroeconomics [2020]

Elliott, M., Georg, C-P. and Hazell, J. Systemic Risk Shifting in Financial Networks Journal of Economic Theory [2021]