Merge pull request #56 from ceylanb/patch-1

add hakrawler
This commit is contained in:
Bruce Tang
2021-03-16 14:37:55 +08:00
committed by GitHub

View File

@@ -134,6 +134,7 @@ A collection of awesome web crawler,spider and resources in different languages.
* [colly](https://github.com/asciimoo/colly) - Fast and Elegant Scraping Framework for Gophers.
* [ferret](https://github.com/MontFerret/ferret) - Declarative web scraping.
* [Dataflow kit](https://github.com/slotix/dataflowkit) - Extract structured data from web pages. Web sites scraping.
* [Hakrawler](https://github.com/hakluke/hakrawler) - Simple, fast web crawler designed for easy, quick discovery of endpoints and assets within a web application
## Scala