Python - IndexError: list index out of range - not working

Question

This is my scrap.py code

from bs4 import BeautifulSoup as soup
from urllib.request import urlopen as uReq

website = \"https://houston.craigslist.org/search/cta\         


        

Answer 1

This is because some cars just have no price, e.g. this one. You can put price to unknown if there was no price:

price_container = container.findAll('span', {'class':'result-price'})
if len(price_container) > 0:
    price = price_container[0].text
else:
    price = 'unknown'

Or you could just skip the ones without price so they'll not get written to the file:

price_container = container.findAll('span', {'class':'result-price'})
if len(price_container) == 0:
   continue
price = price_container[0].text

How can I sort it by price?

results = []
for container in result_html:   
    carname = container.a.text

    price_container = container.findAll('span', {'class':'result-price'})
    if len(price_container) == 0:
        continue

    price = price_container[0].text.strip('$')
    results.append((int(price), carname))

for price, carname in sorted(results):
    f.write("{}, {}\n".format(carname, price))

f.close()

Answer 2

Try the below one. It will fetch you all the items and price and handle IndexError if there is any.

from bs4 import BeautifulSoup
from urllib.request import urlopen

response = urlopen("https://houston.craigslist.org/search/cta")
soup_html = BeautifulSoup(response.read(), "html.parser")
for container in soup_html.find_all("p", {"class":"result-info"}):   
    carname = container.find_all("a")[0].text
    try:
        price = container.find_all('span', {'class':'result-price'})[0].text
    except IndexError:
        price = ""
    print(carname,price)

I tried to shorten your code to make it look better.