Web Crawler/Spider for NodeJS + server-side jQuery ;-)
crawler.queue(undefined)
https://github.com/sylvinus/node-crawler/issues/126
Crawler use now Cheerio by default. Avoid compiling C++ when installing crawler by removing Jsdom from deps. Jsdom is still supported, see the doc.
require('crawler')
instead of require('crawler').Crawler
rateLimits
(see doc)Next big release will be for Cheerio Support
Load Jquery File in a windows context Update README to build Contextify https://github.com/sylvinus/node-crawler#contextify
Cleaning in package.json Update packages to new versions First use of HttpBin for testing