tomverran/robots-txt-checker
Given a robots.txt file, user agent and URL path will tell you whether you're allowed to access a page
View on Github
Activity
- Latest release
- 5y ago
- Total releases
- 13
- Cadence
- ~3 months
- Last 12 months
- 0
Reach
- Stars
- —
Details
- License
- MIT
- First release
- Apr 15, 2014
Releases
| Version | Released | |
|---|---|---|
1.17
minor
| ||
1.16
minor
| ||
1.15
minor
| ||
1.14
minor
| ||
1.13
minor
| ||
1.12.1
patch
| ||
1.12
minor
| ||
1.11
minor
| ||
1.10
minor
| ||
1.02
minor
| ||
1.02-beta
pre
| ||
1.01
minor
| ||
1.0
initial
|