Sign in Sign up
npm

crawlee

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

npm View on Npm github View on Github

Activity

Latest release
7h ago
Total releases
1846
Cadence
~daily
Last 12 months
358

Reach

Stars
25.1k

Details

License
Apache-2.0
First release
Apr 22, 2022
Releases
Version Released
4.0.0-beta.89 pre
4.0.0-beta.88 pre
3.17.1-beta.71 pre
3.17.1-beta.70 pre
4.0.0-beta.87 pre
4.0.0-beta.86 pre
3.17.1-beta.69 pre
3.17.1-beta.68 pre
4.0.0-beta.85 pre
3.17.1-beta.67 pre
3.17.1-beta.66 pre
4.0.0-beta.84 pre
4.0.0-beta.83 pre
3.17.1-beta.65 pre
3.17.1-beta.64 pre
4.0.0-beta.82 pre
4.0.0-beta.81 pre
4.0.0-beta.80 pre
3.17.1-beta.63 pre
4.0.0-beta.79 pre
4.0.0-beta.78 pre
4.0.0-beta.77 pre
3.17.1-beta.60 pre
4.0.0-beta.76 pre
4.0.0-beta.75 pre
4.0.0-beta.74 pre
4.0.0-beta.73 pre
4.0.0-beta.72 pre
3.17.1-beta.59 pre
3.17.1-beta.58 pre
3.17.1-beta.57 pre
3.17.1-beta.56 pre
3.17.1-beta.55 pre
4.0.0-beta.71 pre
4.0.0-beta.70 pre
3.17.1-beta.54 pre
4.0.0-beta.69 pre
4.0.0-beta.68 pre
3.17.1-beta.53 pre
3.17.1-beta.52 pre
3.17.1-beta.51 pre
3.17.1-beta.50 pre
3.17.1-beta.49 pre
3.17.1-beta.48 pre
3.17.1-beta.47 pre
3.17.1-beta.46 pre
4.0.0-beta.67 pre
3.17.1-beta.45 pre
3.17.1-beta.44 pre
3.17.1-beta.43 pre
1–50 of 1846