How can I use Node / Cheerio (or something else) to scrape a global variable from a site?

心已入冬 提交于 2019-11-28 12:24:14

问题


There is a global variable on a page that contains an object that I'd like to set up a scraper for. What's the best way to do this with Node / Express / potentially Cheerio?

I understand Cheerio's benefit in traversing a DOM, but I know the name of the global variable I want to scrape and just need to extract its information on a set schedule


回答1:


Cheerio is just a dom parser, so you wont have acces to any javascriot or any javascript generated content.

What you need is something like PhantomJS that simulates a browser. Have a look at this Stackoverflow answer



来源:https://stackoverflow.com/questions/41536807/how-can-i-use-node-cheerio-or-something-else-to-scrape-a-global-variable-fro

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!