These commands will install the spider software Scrapy in Linux, this example works for Ubuntu 14.04:
sudo apt-get install python-pip python3-lxml python2.7-dev python-twisted
sudo pip install Scrapy --upgrade
Link to Scrapy
These commands will install the spider software Scrapy in Linux, this example works for Ubuntu 14.04:
sudo apt-get install python-pip python3-lxml python2.7-dev python-twisted
sudo pip install Scrapy --upgrade
Link to Scrapy