You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
After installing quickscrape and journal-scrapers via npm, as instructed, and getting the basic example to work (which required a workaround, see my comment on #102), I hit another snag.
My attempts to scrape http://journals.sagepub.com/toc/bcqe/57/3 using a custom scraper kept failing without any feedback. I dug down into the Thresher dependency to add more logging (side note: You should add logging to Thresher!) and figured out that there was a problem affecting headless.js:
I was able to successfully scrape http://journals.sagepub.com/toc/bcqe/57/3 using my custom scraper once I locally installed tiny-jsonrpc under:
/Users/barbara/.nvm/versions/node/v8.9.1/lib/node_modules/quickscrape/node_modules/spooky/
The text was updated successfully, but these errors were encountered:
After installing quickscrape and journal-scrapers via npm, as instructed, and getting the basic example to work (which required a workaround, see my comment on #102), I hit another snag.
My attempts to scrape http://journals.sagepub.com/toc/bcqe/57/3 using a custom scraper kept failing without any feedback. I dug down into the Thresher dependency to add more logging (side note: You should add logging to Thresher!) and figured out that there was a problem affecting headless.js:
"HeadlessRenderer.prototype.render: Error: Cannot find module '/Users/barbara/.nvm/versions/node/v8.9.1/lib/node_modules/quickscrape/node_modules/spooky/lib/../node_modules/tiny-jsonrpc/lib/tiny-jsonrpc'"
I was able to successfully scrape http://journals.sagepub.com/toc/bcqe/57/3 using my custom scraper once I locally installed tiny-jsonrpc under:
/Users/barbara/.nvm/versions/node/v8.9.1/lib/node_modules/quickscrape/node_modules/spooky/
The text was updated successfully, but these errors were encountered: