How to build URLs in Python [closed]

Answer 1

urlparse in the python standard library is all about building valid urls. Check the documentation of urlparse

Answer 2

import urllib

def make_url(base_url , *res, **params):
    url = base_url
    for r in res:
        url = '{}/{}'.format(url, r)
    if params:
        url = '{}?{}'.format(url, urllib.urlencode(params))
    return url

>>>print make_url('http://example.com', 'user', 'ivan', aloholic='true', age=18)

http://example.com/user/ivan?age=18&aloholic=true

Answer 3

I would go for Python's urllib, it's a built-in library.

# Python 2:
import urllib

# Python 3:
# import urllib.parse

getVars = {'var1': 'some_data', 'var2': 1337}
url = 'http://domain.com/somepage/?'

# Python 2:
print(url + urllib.urlencode(getVars))

# Python 3:
# print(url + urllib.parse.urlencode(getVars))

Output:

http://domain.com/somepage/?var2=1337&var1=some_data

Answer 4

import requests
payload = {'key1':'value1', 'key2':'value2'}
response =  requests.get('http://fireoff/getdata', params=payload)
print response.url

prints: http://fireoff/getdata?key1=value1&key2=value2

Answer 5

Here is an example of using urlparse to generate URLs. This provides the convenience of adding path to the URL without worrying about checking slashes.

import urllib

def build_url(baseurl, path, args_dict):
    # Returns a list in the structure of urlparse.ParseResult
    url_parts = list(urllib.parse.urlparse(base_url))
    url_parts[2] = path
    url_parts[4] = urllib.parse.urlencode(args_dict)
    return urllib.parse.urlunparse(url_parts)

>>> args = {'arg1': 'value1', 'arg2': 'value2'}
>>> # works with double slash scenario
>>> build_url('http://www.example.com/', '/somepage/index.html', args)

http://www.example.com/somepage/index.html?arg1=value1&arg2=value2

# works without slash
>>> build_url('http://www.example.com', 'somepage/index.html', args)

http://www.example.com/somepage/index.html?arg1=value1&arg2=value2