Process AJAX request in Htmlunit

前端 未结 2 1962
感动是毒
感动是毒 2021-01-12 08:54

I have a program written to scrape the source code from a webpage after a button is clicked. I am unable to scrape the right page because I believe an AJAX request is being

2条回答
  •  傲寒
    傲寒 (楼主)
    2021-01-12 09:41

    For me it helped to use htmlunit 2.15 with NicelyResynchronizingAjaxController, and also

    webClient.getOptions().setThrowExceptionOnScriptError(false);
    

    My full setup is

        WebClient webClient = new WebClient(BrowserVersion.FIREFOX_24);
        webClient.getOptions().setJavaScriptEnabled(true);
        webClient.getOptions().setThrowExceptionOnScriptError(false);
        webClient.getOptions().setCssEnabled(false);
        webClient.setAjaxController(new NicelyResynchronizingAjaxController());
    

提交回复
热议问题