CrawlerLib.Engine
2.1.5296.19510
See the version list below for details.
dotnet add package CrawlerLib.Engine --version 2.1.5296.19510
NuGet\Install-Package CrawlerLib.Engine -Version 2.1.5296.19510
<PackageReference Include="CrawlerLib.Engine" Version="2.1.5296.19510" />
paket add CrawlerLib.Engine --version 2.1.5296.19510
#r "nuget: CrawlerLib.Engine, 2.1.5296.19510"
// Install CrawlerLib.Engine as a Cake Addin #addin nuget:?package=CrawlerLib.Engine&version=2.1.5296.19510 // Install CrawlerLib.Engine as a Cake Tool #tool nuget:?package=CrawlerLib.Engine&version=2.1.5296.19510
The Crawler-Lib Engine is a general purpose workflow enabled task processor. It has evolved from a web crawler over data mining and information retrieval. It is throughput optimized and can perform thousands of tasks per second on standard hardware. Due to its workflow capabilities it allows to structure and parallelize even complex kind of work. Please visit the project page for the complete view of the Crawler-Lib Engine.
A license for the Anonymous Edition is included in the package. A license for the more powerful free Community Edition can be generated on the project page.
Product | Versions Compatible and additional computed target framework versions. |
---|---|
.NET Framework | net is compatible. |
-
- HtmlAgilityPack (>= 1.4.6)
- Newtonsoft.Json (>= 6.0.3)
NuGet packages (1)
Showing the top 1 NuGet packages that depend on CrawlerLib.Engine:
Package | Downloads |
---|---|
CrawlerLib.Engine.TestHelper
The Crawler-Lib Engine Test Helper simplifies the test of tasks. It can be used to develop unit tests and integration tests for tasks. |
GitHub repositories
This package is not used by any popular GitHub repositories.
Version | Downloads | Last updated |
---|---|---|
2.3.5544.21265 | 2,547 | 3/7/2015 |
2.3.5538.27074 | 1,713 | 3/1/2015 |
2.3.5535.18986 | 2,010 | 2/26/2015 |
2.3.5529.650 | 2,050 | 2/20/2015 |
2.3.5515.2909 | 1,778 | 2/6/2015 |
2.3.5514.24037 | 1,719 | 2/5/2015 |
2.3.5513.24819 | 1,756 | 2/4/2015 |
2.3.5507.444 | 1,763 | 1/29/2015 |
2.3.5503.33731 | 1,741 | 1/25/2015 |
2.3.5503.4086 | 1,795 | 1/25/2015 |
2.2.5490.21676 | 1,748 | 1/12/2015 |
2.2.5367.17954 | 1,788 | 9/11/2014 |
2.1.5296.19510 | 1,793 | 7/2/2014 |
2.1.5291.40524 | 1,636 | 6/27/2014 |
2.1.5288.13218 | 1,836 | 6/24/2014 |
2.0.2 | 2,187 | 9/6/2013 |
2.0.1 | 1,929 | 6/25/2013 |
2.0.0 | 1,868 | 6/22/2013 |
* Fix parenting error in Retry element
Version 2.1.5291.40524
* Added additional constructors to several workflow elements. So you can construct and use them without specifying a complete configuration object for the element.
* Added AwaitProcessingEnum awaitProcessing to several workflow element constructors, so you can specify that the continuation will be called on failure and check the Success property to decide what to do.
Version 2.1.5288.13218:
* The workflow elements are awaitable since this release.
* New workflow elements for limits and operation cost calculation have been added.
* A vast amount of small extensions and refactoring
Version 2.00 -2.01 -2.02:
* First public releases