wget downloads nofollow link

前端 未结 0 1686
失恋的感觉
失恋的感觉 2021-01-05 12:11

I want to crawl/scrape a wordpress website with wget.
Problem: wget will download documents/links despite them having a rel=nofollow attribute. And yes I

相关标签:
回答
  • 消灭零回复
提交回复
热议问题