Skip to content

duyson98/Hoshimori-Scrapy

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

29 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Hoshimori Project

This is a database processor for the main project

How to use?

Prerequisites

scrapy 1.4: https://doc.scrapy.org/en/latest/index.html

Quick start

  1. Delete all .csv files in hoshimori/results/ first

  2. There are three get_XX.py files in hoshimori/. Just run any of them to get the related database.

    • get_database_dengeki.py: Crawl card info in Japanese from dengekionline
    • get_database_zh.py: Crawl card info in Chinese from zh.battlegirl
    • get_stagedatabase.py: Crawl stage info in Japanese from dengekionline
  3. Results are exported as .csv in hoshimori/results/

Adding new spiders

Just add them to hoshimori/hoshimori/spiders

Authors

License

This project is licensed under the MIT License - see the LICENSE.md file for details

About

No description, website, or topics provided.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 100.0%