allennlp_wordsplitter_corenlp
Add a CoreNLP WordSplitter
into AllenNLP's tokenizers.
config
{ "dataset_reader": { // ... ...
"tokenizer": { "word_splitter": { "type": "corenlp_remote", "url": "http://10.1.1.174:9000"
}
}, // ... ...
}, // ... ...}
CLI
allennlp train --include-package allennlp_wordsplitter_corenlp -s /your/output/dir /your/training/config/file