Beautiful Soup returns empty list

Question

I am new to webscrapping. So I have been given a task to extract data from : Here

I am choosing dataset of \"comments\". Below is my code for scrapping.

Answer 1

you are getting this [] because data you want to scrape is coming from API which loads after you web page load so page you are accessing does not contain that class

you can open you browser console and check in network as given in screenshot there you find data you want to scrape so you have to make request to that URL to get data

you can retrive data in this URL in preview tab you can see all data.

also if you have good knowledge of python you can also use this to scrape data

https://doc.scrapy.org/en/latest/intro/overview.html