python-amazon-scraper

Navigates to amazon, searches for samsung phones and pulls the title and price data.

Crawl a link on the fly

scrapy shell 'https://quotes.toscrape.com/page/1/'

Make sure you have Docker Compose installed.

cp .env.example .env
pip3 install virtualenv && \
  virtualenv env && \
  source env/bin/activate
pip install -r requirements.txt

alias compose='docker-compose'
compose build
compose up

make start # build & run your script
make stop  # stop your docker container

.\ps\run.ps1 start # build & run your script
.\ps\run.ps1 stop  # stop your docker container

Pull requests are welcome. For major changes, please open an issue first to discuss what you would like to change.

Please make sure to update tests as appropriate.