来源：https://stackoverflow.com/questions/19891446/python-requests-vs-robots-txt 标签 python beautifulsoup python-requests robots.txt
