Migale.Core
1.0.0
dotnet add package Migale.Core --version 1.0.0
NuGet\Install-Package Migale.Core -Version 1.0.0
<PackageReference Include="Migale.Core" Version="1.0.0" />
<PackageVersion Include="Migale.Core" Version="1.0.0" />
<PackageReference Include="Migale.Core" />
paket add Migale.Core --version 1.0.0
#r "nuget: Migale.Core, 1.0.0"
#addin nuget:?package=Migale.Core&version=1.0.0
#tool nuget:?package=Migale.Core&version=1.0.0
Migale: A lightweight .NET spider with fast kickstarting
Migale was born out of a need to extract quickly and with a very low development cost. This package is not intended to replace complete and structured libraries like DotnetSpider.
Features
- Multi-Threaded
- Fail & retries handling
- Event-Driven
- Extensible
- Document parsing (HTML, JSON, XML) (Work in progress !)
Samples
You can find samples with the crawlers implementation here !
Packages
Package | Description | Nuget |
---|---|---|
Migale.Core | The core of the project | |
Migale.Crawlers.HttpClient | The HttpClient crawler implementation with RequestMessages | |
Migale.Crawlers.Playwright | The Playwright crawler implementation with browser automation |
Contributing
We would love community contributions here.
There is actually no contributation guide or convention as i'm actually the only maintainer of the project.
License
This project is licensed with the MIT license.
Related Projects
You should take a look at these related projects:
Product | Versions Compatible and additional computed target framework versions. |
---|---|
.NET | net7.0 is compatible. net7.0-android was computed. net7.0-ios was computed. net7.0-maccatalyst was computed. net7.0-macos was computed. net7.0-tvos was computed. net7.0-windows was computed. net8.0 was computed. net8.0-android was computed. net8.0-browser was computed. net8.0-ios was computed. net8.0-maccatalyst was computed. net8.0-macos was computed. net8.0-tvos was computed. net8.0-windows was computed. net9.0 was computed. net9.0-android was computed. net9.0-browser was computed. net9.0-ios was computed. net9.0-maccatalyst was computed. net9.0-macos was computed. net9.0-tvos was computed. net9.0-windows was computed. |
-
net7.0
- AngleSharp (>= 1.0.1)
- Microsoft.AspNetCore.Http.Extensions (>= 2.2.0)
NuGet packages (2)
Showing the top 2 NuGet packages that depend on Migale.Core:
Package | Downloads |
---|---|
Migale.Crawlers.Playwright
Package Description |
|
Migale.Crawlers.HttpClient
Package Description |
GitHub repositories
This package is not used by any popular GitHub repositories.