Requests vs Selenium Python in Youtube

Question

When I use Selenium library to find the length of related channel in YouTube channel Page it gives me 12. But when I use Req

Answer 1

Sometimes the issue is caused by the soup object having different tags from the ones you see from dev tools, which is what is happening in your case. On analysing the soup object you'll notice the information you need is actually now in

.

This code will pull the results you want:

import requests
from bs4 import BeautifulSoup

r = requests.get("https://www.youtube.com/channel/UCoykjkkJxsz7JukJR7mGrwg/about")
soup = BeautifulSoup(r.content, 'html.parser')
bb=soup.find_all('h3',class_='yt-lockup-title')
print(len(bb))