Python dryscrape scrape page with cookies

前端 未结 1 835
梦如初夏
梦如初夏 2021-02-09 06:18

I wanna get some data from site, which requires loggin in.
I log in by requests

url = \"http://example.com\"
response = requests.get(url, {         


        
相关标签:
1条回答
  • 2021-02-09 07:09

    Why not login by dryscrape?

    session = dryscrape.Session()
    session.visit('<url_where_is_login_form>')
    name = session.at_xpath('//*[@name="username"]') # Where <input name="username">
    name.set("<login>")
    password = session.at_xpath('//*[@name="password"]') # Where <input name="password">
    password.set("<password>")
    # Push the button
    name.form().submit()
    session.visit("<url to visit with proper cookies>")
    
    0 讨论(0)
提交回复
热议问题