This is a joint portal of the [http://nlp.fi.muni.cz Masaryk University's NLP Centre] and [http://www.sketchengine.co.uk Lexical Computing] focusing on various tools for corpus processing.

{{{
#!html
<table style="color:white; border-spacing: 1em"><tr>

<td style="background-color:#008000 ; background-image:url('/chrome/site/onion_nb.png') ; background-repeat:no-repeat ; background-position: 6px 6px; width:50% ; border-radius:20px ; padding:1em 1em 1em 60px; vertical-align:top">
<a href="/wiki/Onion" style="color:white; border:none; font-size:120%">
Onion (ONe Instance ONly) is a de-duplicator for large collections of texts. It can measure the similarity of paragraphs or whole documents and drop duplicate ones based on the threshold you set.

</a></td>

<td style="background-color:#800000 ; background-image:url('/chrome/site/unitok_nb.png') ; background-repeat:no-repeat ; background-position: 6px 6px; width:50% ; border-radius:20px ; padding:1em 1em 1em 60px; vertical-align:top">
<a href="/wiki/Unitok" style="color:white; border:none; font-size:120%">
Unitok is a universal text tokeniser with specific settings for many languages. It can turn plain text into a sequence of newline-separated tokens (“vertical” format), while preserving XML-like tags containing metadata.

</a></td></tr><tr>

<td style="background-color:#0080ff ; background-image:url('/chrome/site/justext_nb.png') ; background-repeat:no-repeat ; background-position: 6px 6px; width:50% ; border-radius:20px ; padding:1em 1em 1em 60px; vertical-align:top">
<a href="/wiki/Justext" style="color:white; border:none; font-size:120%">
JusText is a HTML boilerplate removal tool. It can strip navigation links, headers, footers, etc. from HTML pages and leave just regular text containing full sentences.

</a></td><td></td></tr></table>
}}}