Why isn't the html code inside div is being parsed?

Question

The html code

In this image there is html code inside the div id=\"root\"

Here is the code:

import requests 
from bs4 import Bea         


        

Answer 1

The content inside of <div id="root"></div> is likely loaded dynamically. You can check on your own if you visit the page with disabled JavaScript. With your approach, BeatifulSoup doesn't parse the content which was added dynamically (through JavaScript).

More details here => BeautifulSoup not grabbing dynamic content

I would recommend using a headless browser in your case to be able to fetch dynamic content which was generated with JavaScript. (headless browser is able to execute JavaScript so it makes dynamic content accessible for parsing)