资源论文Combining Knowledge Hunting and Neural Language Models to Solve the Winograd Schema Challenge

Combining Knowledge Hunting and Neural Language Models to Solve the Winograd Schema Challenge

2019-09-18 | |  98 |   61 |   0 0 0
Abstract Winograd Schema Challenge (WSC) is a pronoun resolution task which seems to require reasoning with commonsense knowledge. The needed knowledge is not present in the given text. Automatic extraction of the needed knowledge is a bottleneck in solving the challenge. The existing state-of-the-art approach uses the knowledge embedded in their pretrained language model. However, the language models only embed part of the knowledge, the ones related to frequently co-existing concepts. This limits the performance of such models on the WSC problems. In this work, we build-up on the language model based methods and augment them with a commonsense knowledge hunting (using automatic extraction from text) module and an explicit reasoning module. Our end-to-end system built in such a manner improves on the accuracy of two of the available language model based approaches by 5.53% and 7.7% respectively. Overall our system achieves the state-of-theart accuracy of 71.06% on the WSC dataset, an improvement of 7.36% over the previous best

上一篇:CogNet: a Large-Scale Cognate Database

下一篇:Deep Neural Model Inspection and Comparison via Functional Neuron Pathways

用户评价
全部评价

热门资源

  • The Variational S...

    Unlike traditional images which do not offer in...

  • Learning to Predi...

    Much of model-based reinforcement learning invo...

  • Stratified Strate...

    In this paper we introduce Stratified Strategy ...

  • A Mathematical Mo...

    Direct democracy, where each voter casts one vo...

  • Rating-Boosted La...

    The performance of a recommendation system reli...