tarantula-web-crawler
A simple web crawler library with customizable user agent, selectable URLs, full compliance with robots.txt, and screenshot functionality.
Activity
- Latest release
- 1y ago
- Total releases
- 7
- Cadence
- ~daily
- Last 12 months
- 0
Details
- License
- MIT
- First release
- Feb 13, 2025
| Version | Released | |
|---|---|---|
1.2.1
patch
deprecated
|
1.2.1
patch
deprecated
Dependencies (5)
|
|
1.2.0
minor
deprecated
|
1.2.0
minor
deprecated
Dependencies (5)
|
|
1.0.4
patch
deprecated
|
1.0.4
patch
deprecated
Dependencies (5)
|
|
1.0.3
patch
deprecated
|
1.0.3
patch
deprecated
Dependencies (5)
|
|
1.0.2
patch
deprecated
|
1.0.2
patch
deprecated
Dependencies (5)
|
|
1.0.1
patch
deprecated
|
1.0.1
patch
deprecated
Dependencies (5)
|
|
1.0.0
initial
deprecated
|
1.0.0
initial
deprecated
Dependencies (5)
|