How to save storage in python crawler (common strings)

后端 未结 0 1412
故里飘歌
故里飘歌 2021-01-25 12:53

I have a python3 crawler that connect to target sites and saves all html and resources. Although I compress with gzip before saving it consumes too much space and I usually reac

相关标签:
回答
  • 消灭零回复
提交回复
热议问题