资源分类
》 资源 》论文》Lipschitz Continuity in Model-based Reinforcement Learning

Lipschitz Continuity in Model-based Reinforcement Learning

2020-03-16 | |  87 |   42 |   0

Abstract

We examine the impact of learning Lipschitz continuous models in the context of model-based reinforcement learning. We provide a novel bound on multi-step prediction error of Lipschitz models where we quantify the error using the Wasserstein metric. We go on to prove an error bound for the value-function estimate arising from Lipschitz models and show that the estimated value function is itself Lipschitz. We conclude with empirical results that show the benefits of controlling the Lipschitz constant of neural-network models.

上一篇：Path Consistency Learning in Tsallis Entropy Regularized MDPs

下一篇：Asynchronous Byzantine Machine Learning (the case of SGD)

用户评价
全部评价

热门资源

  • The Variational S...

    Unlike traditional images which do not offer in...

  • Learning to Predi...

    Much of model-based reinforcement learning invo...

  • Stratified Strate...

    In this paper we introduce Stratified Strategy ...

  • A Mathematical Mo...

    Direct democracy, where each voter casts one vo...

  • Rating-Boosted La...

    The performance of a recommendation system reli...