Changes between Version 4 and Version 5 of WikiStart


Ignore:
Timestamp:
01/12/15 18:38:39 (10 years ago)
Author:
admin
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • WikiStart

    v4 v5  
    11= Corpus tools =
    22
    3 * unitok
     3* [http://corpus.tools/wiki/Unitok unitok] is a universal text tokenizer
    44* [http://corpus.tools/wiki/Justext jusText] is a tool for removing boilerplate content, such as navigation links, headers, and footers from HTML pages. It is designed to preserve mainly text containing full sentences and it is therefore well suited for creating linguistic resources such as Web corpora.
    55* [http://corpus.tools/wiki/Onion onion] (ONe Instance ONly) is a tool for removing duplicate parts from large collections of texts.