1、urlparse
作用:解析url
from urllib import parse url = "https://book.qidian.com/info/1004608738" result = parse.urlparse(url=url) print(result)
结果:
ParseResult(scheme='https', netloc='book.qidian.com', path='/info/1004608738', params='', query='', fragment='')
scheme:表示协议 netloc:域名 path:路径 params:参数 query:查询条件,一般都是get请求的url fragment:锚点,用于直接定位页 面的下拉位置,跳转到网页的指定位置
2、urlunparse
作用:上传url
from urllib import parse url_params = ('https', 'book.qidian.com', '/info/1004608738', '', '', '') _url = parse.urlunparse(url_params) print(_url) # https://book.qidian.com/info/1004608738
3、urljoin
作用:拼接url
from urllib import parse url_1 = "https://book.qidian.com/" url_2 = "info/1004608738" new_url = parse.urljoin(url_1, url_2) print(new_url) # https://book.qidian.com/info/1004608738
4、urlencode
作用:url的参数,字典格式->url格式
from urllib import parse params = { 'page': 10, 'job': 'python' } url = "https://test.job.com/" url_params = parse.urlencode(params) new_url = parse.urljoin(url, url_params) print(new_url) # https://test.job.com/page=10&job=python
5、quote
作用:将中文->url的编码
from urllib import parse key = "海贼王" _key = parse.quote(key) print(_key) url = "https://www.sogou.com/web?query={}".format(_key) print(url) # https://www.sogou.com/web?query=%E6%B5%B7%E8%B4%BC%E7%8E%8B