@x12i/crawl
Bounded site crawl: BFS frontier, scope and robots policy, link/sitemap discovery via retrieve.
Activity
- Latest release
- 1mo ago
- Total releases
- 2
- Cadence
- ~daily
- Last 12 months
- 2
Details
- License
- MIT
- First release
- Aug 02, 2026
Releases
| Version | Released | |
|---|---|---|
0.4.0
minor
| ||
0.3.0
initial
|