Skip to content

datamade/cookiecutter-scrapy

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 
 
 
 
 

Repository files navigation

DataMade cookiecutter for scrapy scrapers

This cookiecutter sets up a new scrapy project for you. It defers in a few ways from what you would get from scrapy startproject to align with DataMade's scraping practices.

  1. scrapy crawl will exit after the first exception.
  2. if an error is encountered, scrapy crawl will exit with a non-zero exit code.
  3. the project contains a setup.py file wich will allow you to install the scraper with pip like a normal package. when installed this way, you can run scrapy crawl your_spider_name without having to be in a scrapy project.

About

Cookie Cutter for Scrapy Projects

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages