is it possible to write web crawler in javascript?

后端 未结 11 590
深忆病人
深忆病人 2021-02-01 07:48

I want to crawl the page and check for the hyperlinks in that respective page and also follow those hyperlinks and capture data from the page

11条回答
  •  一生所求
    2021-02-01 08:25

    yes it is possible

    1. Use NODEJS (its server side JS)
    2. There is NPM (package manager that handles 3rd party modules) in nodeJS
    3. Use PhantomJS in NodeJS (third party module that can crawl through websites is PhantomJS)

提交回复
热议问题