Changes between Version 17 and Version 18 of SpiderLing


Ignore:
Timestamp:
12/01/22 15:40:46 (17 months ago)
Author:
admin
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • SpiderLing

    v17 v18  
    7171- lxml >= 4.2 (http://lxml.de/),
    7272- openssl >= 1.1,
     73- pycld2 >= 0.41,
    7374- pyre2 >= 0.2.23 (https://github.com/andreasvc/pyre2),
    7475- text processing tools (if binary format conversion is on):
     
    109110- install required tools, see install_rpm.sh for rpm based systems
    110111- check importing the following dependences by pypy3/python3:
    111   python3 -c 'import justext.core, chared.detector, ssl, lxml, re2'
     112  python3 -c 'import justext.core, chared.detector, ssl, lxml, re2, pycld2'
    112113  pypy3 -c 'import ssl; from ssl import PROTOCOL_TLS'
    113114- make sure the crawler can write to config.RUN_DIR and config.PIPE_DIR.