I\'ve a task to test different user agents on a URL through automation. I\'m using ruby to code, and I\'ve been trying to set an user agent using the following method, but i
Also another that work for me :
require 'open-uri'
html = open('http://your.site.com/the/page.html', 'User-Agent' => 'Ruby').read
puts html
Hope this will help you.
I wasn't able to find a solution that works for both https
and supplying a header. Here is a version that works:
require "net/http"
uri = URI("https://pokemongolive.com/events/community-day/")
request = Net::HTTP::Get.new(uri)
request["User-Agent"] = "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/87.0.4280.88 Safari/537.36"
response = Net::HTTP.start(uri.hostname, uri.port, :use_ssl => (uri.scheme == 'https')) {|http|
http.request(request)
}
puts response.code
puts response.body
The Ruby version being used was: ruby 2.6.3p62 (2019-04-16 revision 67580)
http = Net::HTTP.new("your.site.com", 80)
req = Net::HTTP::Get.new("/path/to/the/page.html", {'User-Agent' => 'your_agent'})
response = http.request(req)
puts response.body
Works great for me.
The included Net::HTTPHeader has the initialize_http_header method:
@http = Net::HTTP.new(URL)
@http.initialize_http_header({'User-Agent' => useragent})
response = @http.request_get(URL)
HTH