Changes between Version 17 and Version 18 of SpiderLing
- Timestamp:
- 12/01/22 15:40:46 (2 years ago)
Legend:
- Unmodified
- Added
- Removed
- Modified
-
SpiderLing
v17 v18 71 71 - lxml >= 4.2 (http://lxml.de/), 72 72 - openssl >= 1.1, 73 - pycld2 >= 0.41, 73 74 - pyre2 >= 0.2.23 (https://github.com/andreasvc/pyre2), 74 75 - text processing tools (if binary format conversion is on): … … 109 110 - install required tools, see install_rpm.sh for rpm based systems 110 111 - check importing the following dependences by pypy3/python3: 111 python3 -c 'import justext.core, chared.detector, ssl, lxml, re2 '112 python3 -c 'import justext.core, chared.detector, ssl, lxml, re2, pycld2' 112 113 pypy3 -c 'import ssl; from ssl import PROTOCOL_TLS' 113 114 - make sure the crawler can write to config.RUN_DIR and config.PIPE_DIR.