selenium-chromedriver

问题 I am developing web crawlers for a while and the most common issue for me is waiting for page to be completely loaded, includes requests, frames, scripts. I mean completely done. I used several methods to fix it but when I use more than one thread to crawl websites I always get this kind of problem. the Driver opens itself, goes through the URL, doesn't wait and goes through the next URL. My tries are: JavascriptExecutor js = (JavascriptExecutor) driver.getWebDriver(); String result = js

问题 It says ChromeDriver is a standalone server that implements the W3C WebDriver standard It looks like W3C WebDriver standard only defines the interface between the automation program and Chromedriver. Chromedriver act as a HTTP server to get the command from automation program. But how does ChromeDriver communicate with Chrome? Still through HTTP protocol? If yes, where could we get the documentation about the details? And what component inside of Chrome is in charge of handling the command

问题 It says ChromeDriver is a standalone server that implements the W3C WebDriver standard It looks like W3C WebDriver standard only defines the interface between the automation program and Chromedriver. Chromedriver act as a HTTP server to get the command from automation program. But how does ChromeDriver communicate with Chrome? Still through HTTP protocol? If yes, where could we get the documentation about the details? And what component inside of Chrome is in charge of handling the command

问题 This question already has an answer here : How to rotate Selenium webrowser IP address (1 answer) Closed 8 months ago . Hi I am fairly new to selenium and I am building a bot that visits a website and enters a term then submits. The issue is that you can only Submit a certain amount of times before the IP address used gets blocked by the server for spam. Is there a way I can implement a proxy rotation every time it opens up a new chrome browser. 回答1: It would be important to know which

问题 I try to run chromedriver via selenium in headless mode. IMPORTANT The code runs perfectly fine if I eliminate the following code lines (but is not headless): chrome_options.add_argument('--headless') chrome_options.add_argument('--no-sandbox') chrome_options.add_argument('--disable-dev-shm-usage') This is the error I get when I try to implement the headless argument: Traceback (most recent call last): File "camel_amazon_scraper.py", line 83, in <module> executable_path=executable_path) File

问题 FileNotFoundError: [Errno 2] No such file or directory: 'chromedriver' I am using docker to build my app on ubuntu server. Dockerfile: FROM python:latest WORKDIR /src COPY requirements.txt /src RUN pip install -r requirements.txt COPY . /src docker-compose.yml : version: '3.1' services: tgbot: container_name: bot build: context: . command: python app.py restart: always environment: WEBAPP_PORT: 3001 env_file: - ".env" ports: - 8443:3001 networks: - botnet volumes: - ./:/src chrome: image:

问题 I have the following code, which runs well: titles = results.find_elements_by_class_name("docsum-title") for title in titles: print(title.text) It prints out a list of titles from the find_elements_by_class_name . The title's are also hrefs which I want to click to. However, once I add click functions on title.text hyperlinks that go to a new page, (code below) titles = results.find_elements_by_class_name("docsum-title") for title in titles: print(title.text) title_wait = WebDriverWait(driver

问题 In using realbrowserlocusts class it appears that I'm limited in any exception handling. The only reference that partially works is: self.client.wait.until(EC.visibility_of_element_located .... In a failed condition where the element is not found the script simply starts over again. With the script I'm working with I need to maintain a solid session state; I need to throw and exception(report an error), log the user out and then let the script start over again. I've been testing out the

问题 We have Selenium-C# automation tests running an internal web application that requires an Outh-2 Bearer token. When I run the tests, set of temp files named scope_dir are created. These files get deleted automatically for some tests. But at some time during the test execution, they just remain without being deleted. After, this point, I receive a 500 error response. I have tried the following: Chromedriver not deleting scoped* dir in temp folder after test is complete https://bugs.chromium

问题 I am unable to loop click the links. When I try loop click the links it keeps clicking the first link only. From the html code, I need the element named "key" value as well. How to capture it. html file copy in dropbox. Please click https://www.dropbox.com/sh/85rx13m8iqwax4b/AACNDq_YyOukLh22JNv76vjua?dl=0 . html code https://pastebin.com/Cyg98W2C Python code I tried elem = WebDriverWait(browser, 200).until(EC.element_to_be_clickable((By.XPATH, "//DIV[@id='propertySummaryList']/DIV[@class=