Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Got 403 on import resource #479

Closed
kmadenski opened this issue Jan 30, 2020 · 4 comments
Closed

Got 403 on import resource #479

kmadenski opened this issue Jan 30, 2020 · 4 comments

Comments

@kmadenski
Copy link

Hey team!

I got 403 on https://dist.whosonfirst.org/sqlite/whosonfirst-data-venue-pl-latest.db.bz2 resource.
It is intentional?

@missinglink
Copy link
Member

missinglink commented Jan 30, 2020

Hi @kmadenski, we don't control the whosonfirst.org domain but I've heard from their team that they've been getting a lot of abuse recently which has resulted in increased costs on the project (which is funded through donations).

Could you please check that your scripts are caching correctly and not performing unnecessary requests?
I think the 403 responses are there to throttle users and prevent abuse, they are also logging IPs.

I've just started building our own WOF data for Pelias users, it's much more current.

For now it's hosted on my dev server synergy.io but be aware that the domain name may change without warning so I'd avoid hard-coding the domain in any configs for now.
https://wof.synergy.io/sqlite/

Feel free to take what you need, please let me know if you find it useful, we are considering adding them as an alternative to the dist.whosonfirst.org at https://geocode.earth/data

@kmadenski
Copy link
Author

Thx for great source.

I see that synergy.io convension for meta (folder bundles) is not working with pelias wof importer. It wants whosonfirst-data-ocean-latest.csv. In source we got ocean.csv.

@missinglink
Copy link
Member

@kmadenski would you be interested in opening a PR to fix it?

It's a single line change: https://github.com/pelias/wof/blob/master/stream/bundle.js#L68

@missinglink
Copy link
Member

closed by pelias/wof#8

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants