Changes between Version 7 and Version 8 of SpiderLing


Ignore:
Timestamp:
10/13/16 17:37:02 (8 years ago)
Author:
admin
Comment:

--

Legend:

Unmodified
Added
Removed
Modified

  • SpiderLing

    v7 v8  
    55
    66== Get SpiderLing ==
    7 See [wiki:Downloads] for the latest version. '''Please note the software is distributed as is, without a guaranteed support'''
     7See [wiki:Downloads] for the latest version. Please note the software is distributed as is, without a guaranteed support.
    88
    99=== Changelog 0.82 → 0.84 ===
    … …  
    1111 - the bug caused not crawling a significant part of the web
    1212* Multithreading issues fixed (possible race conditions in shared memory)
    13  - delegated classes for explicit locking of all shared objects (esp. DomainQueue)
     13 - delegated classes for explicit locking of all shared objects (esp. !DomainQueue)
    1414* Deadlock -- the scheduler stops working after some time of successful crawling
    1515 - observed in the case of a large scale crawling
    1616 - may be related to changing the code because of multithreading problems
    1717 - IMPORTANT -- may not be resolved yet, testing in progress, 0.81 should be stable
    18 * Several Domain and DomainQueue methods were rewritten for bulk operations (e.g. adding all paths into a single domain together) to improve performance
     18* Several Domain and !DomainQueue methods were rewritten for bulk operations (e.g. adding all paths into a single domain together) to improve performance
    1919* Justext configuration
    2020 - more permissive setting than the justext default