Changes between Version 8 and Version 9 of wiki2corpus


Ignore:
Timestamp:
03/22/18 12:03:16 (7 years ago)
Author:
admin
Comment:

--

Legend:

Unmodified
Added
Removed
Modified

  • wiki2corpus

    v8 v9  
    6262
    6363python wiki2corpus.py $LANG $LIST $CACHE --links ${LANG}wiki.links |\
    64 unitok --trim 200 /usr/lib/python2.7/site-packages/unitok/configs/other_2.py |\
     64unitok --trim 200 /usr/lib/python2.7/site-packages/unitok/configs/other.py |\
    6565onion -m -s -n 7 -t 0.7 -d doc 2> /dev/null |\
    6666xz - > ${LANG}wiki.vert.xz