A crawler written by Node.js to download tumblr videos.
node_tumblr_spider
is a spider project to crawl tumblr resourcesWelcome to cantact me.
Visit Node.js official website to install the latest node enviroment.
It's better to install babun, a better terminal replacement of cmd on Windows system.
It uses redis as queue. So you must install redis first.
download -> tar xvf xxx.tgz -> make -> cd src && ./redis-server
zip OR git clone https://github.com/zhangjh/node_tumblr_spider.git
cd node_tumblr_spider
npm install -d
npm run start
You can modify the configuration at ./conf/config.js
.
USER - the torrent user's name
DOWNLOAD_PRE - the download dir prefix,default as `./download/${user}`
REDIS_HOST - redis server's host
REDIS_PORT - redis server's port
LOG_MODE - if set false, the spider will not show the doawload progress info