This is a database processor for the main project
scrapy 1.4: https://doc.scrapy.org/en/latest/index.html
-
Delete all .csv files in hoshimori/results/ first
-
There are three get_XX.py files in hoshimori/. Just run any of them to get the related database.
- get_database_dengeki.py: Crawl card info in Japanese from dengekionline
- get_database_zh.py: Crawl card info in Chinese from zh.battlegirl
- get_stagedatabase.py: Crawl stage info in Japanese from dengekionline
-
Results are exported as .csv in hoshimori/results/
Just add them to hoshimori/hoshimori/spiders
This project is licensed under the MIT License - see the LICENSE.md file for details