Skip to content

Just a simple web crawler which return crawled links as IObservable using reactive extension and async await.

Notifications You must be signed in to change notification settings

Misterhex/WebCrawler

Repository files navigation

WebCrawler

Build Status NuGet version

Just a simple web crawler which return crawled links as IObservable using reactive extension, async await and polly.

dotnet add package MisterHex.WebCrawling --version 2.0.3

Usage

Crawler crawler = new Crawler();
IObservable<Uri> observable = crawler.Crawl(new Uri("https://dotnet.microsoft.com"));
observable.Subscribe(onNext: Console.WriteLine, onCompleted: () => Console.WriteLine("Crawling completed"));

About

Just a simple web crawler which return crawled links as IObservable using reactive extension and async await.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages