Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

如何实现将51jobspiders变成一个spider而且还要包含我想要保存的那些数据? #1

Open
wqh0109663 opened this issue Aug 15, 2018 · 0 comments

Comments

@wqh0109663
Copy link
Owner

wqh0109663 commented Aug 15, 2018

一个starturls是可以包含多个url的,但是解析的时候,多个url是一起运行具体的运行细节还不是很清楚,所以就最后写成了一个一个的spider,虽然也能实现我想要的功能,但是代码重复了,看着很不舒服,我也试过去写成一个。最后我想的话有可能这样来实现:改写items中的51jobitem,添加一个标志字段,最后在管道文件中对每一个item进行判断,如果刚好是哪一个就存到相应的数据库中。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant