crwlr/robots-txt
Robots Exclusion Standard/Protocol Parser for Web Crawling/Scraping
- Latest release
- Jan 27, 2025
- Releases
- 7
- Known CVEs
- 0
- First release
- Nov 07, 2021
- License
- MIT
Repository
Source
- Stars
- —
- Forks
- —
- Open issues
- —
Security score
No OpenSSF Scorecard available for this repository.
Packages from this repo
No other tracked packages from this repository.
Insights
Activity
- Total releases
- 7
- Last 12 months
- 0
- Cadence
- ~26 days
- Dependencies
- 1
Releases per month
last 12 monthsRelease mix
- major 1
- minor 1
- patch 4
7
releases
Dependencies
Depends on
v1.1.2-
crwlr/url
^1.0|^2.0
Used by
1Releases
| Version | Released | |
|---|---|---|
v1.1.2
patch
| ||
v1.1.1
patch
| ||
v1.1.0
minor
| ||
v1.0.0
major
| ||
v0.1.2
patch
| ||
v0.1.1
patch
| ||
v0.1.0
initial
|