simplecrawler
Very straightforward, event driven web crawler. Features a flexible queue interface and a basic cache mechanism with extensible backend.
- Latest release
- Apr 12, 2020
- Releases
- 70
- Known CVEs
- 0
- First release
- May 15, 2012
- License
- BSD-2-Clause
Repository
Source
- Stars
- —
- Forks
- —
- Open issues
- —
Security score
No OpenSSF Scorecard available for this repository.
Packages from this repo
No other tracked packages from this repository.
Insights
Activity
- Total releases
- 70
- Last 12 months
- 0
- Cadence
- ~12 days
- Dependencies
- 4
Releases per month
last 12 monthsRelease mix
- major 1
- minor 8
- patch 60
70
releases
Dependencies
Depends on
1.1.9-
async ^3.1.0
-
iconv-lite ^0.5.0
-
robots-parser ^2.1.1
-
urijs ^1.19.1
Used by
35-
sitespeed.io
-
axegrinder
-
backstop-crawl
-
bas
-
express-xml-scrapper
-
ghost-trap
-
gome-sitespeed.io
-
gretel
-
grunt-link-checker
-
lightcrawler
1–10 of 35
Releases
| Version | Released | |
|---|---|---|
1.1.9
patch
| ||
1.1.8
patch
| ||
1.1.7
patch
| ||
1.1.6
patch
| ||
1.1.5
patch
| ||
1.1.4
patch
| ||
1.1.3
patch
| ||
1.1.2
patch
| ||
1.1.1
patch
| ||
1.1.0
minor
| ||
1.0.5
patch
| ||
1.0.4
patch
| ||
1.0.3
patch
| ||
1.0.2
patch
| ||
1.0.1
patch
| ||
1.0.0
major
| ||
0.7.0
minor
| ||
0.6.2
patch
| ||
0.6.1
patch
| ||
0.6.0
minor
|
1–20 of 70