Changes between Version 17 and Version 18 of Justext
- Timestamp:
- 11/08/23 17:26:29 (13 months ago)
Legend:
- Unmodified
- Added
- Removed
- Modified
-
Justext
v17 v18 1 = jusText 3=1 = jusText 4 = 2 2 3 3 jusText is a tool for removing boilerplate content, such as navigation links, headers, and footers from HTML pages. It is designed to preserve mainly text containing full sentences and it is therefore well suited for creating linguistic resources such as Web corpora. … … 20 20 21 21 == Installation == 22 1. Make sure you have Python 2.7 and lxml library version 4.1 or laterinstalled.22 1. Make sure you have Python 3.6 or newer and lxml library version 4.1 or later (system-wide, e.g. python3-lxml in Fedora, or pip install --user lxml) and Python HTML 5 parser (system-wide, e.g. python3-html5-parser in Fedora, or pip install --user html5-parser) installed. 23 23 2. Download the sources: 24 24 {{{ 25 wget http://corpus.tools/raw-attachment/wiki/Downloads/justext- 3.0.tar.gz25 wget http://corpus.tools/raw-attachment/wiki/Downloads/justext-4.2.tar.gz 26 26 }}} 27 27 3. Extract the downloaded file: 28 28 {{{ 29 tar xzvf justext- 3.0.tar.gz29 tar xzvf justext-4.2.tar.gz 30 30 }}} 31 31 4. Install the package (omit --user to install for all users): 32 32 {{{ 33 cd justext- 3.0/33 cd justext-4.2/ 34 34 python3 setup.py install --user 35 35 }}}