Using curl on server - how to redirect javascript requests to target server?

后端 未结 1 1043
無奈伤痛
無奈伤痛 2021-01-26 04:37

So I\'m running a crawler on my server and I\'m needing to execute javascript to gain access to some of the data on my target site (target being the one I want to crawl). I had

相关标签:
1条回答
  • 2021-01-26 04:42

    There is no need to inject javascript in the target. You can use wireshark to study all request made by the target. Wireshark is a quite hard to master but powerful. Instead you can try the net tab of the firebug addon.

    Once you know how the target send requests and receive data from their server, you can use curl to imitate the request/receiving data. You don't need any more to build crawlers.

    If this not answers your question explain a little more the scenario.

    0 讨论(0)
提交回复
热议问题