Nutch No agents listed in 'http.agent.name'

Question

Exception in thread \"main\" java.lang.IllegalArgumentException: Fetcher: No agents listed in \'http.agent.name\' property.
        at org.apache.nutch.fetcher.Fetch         


        

Answer 1

using 1.3? If so make sure you changed nutch-site.xml (and not default) in runtime/local/conf Changing the conf in NUTCH_HOME/conf won't be copied to the runtime dirs unless you rebuild with ant.

Answer 2

Try giving the agent name for http.robots.agents also. It worked for me. I didn't get that message thereafter!!!