httr

I've got a manual process where I'm uploading 5-6 GB file to a web server via curl: curl -X POST --data-binary @myfile.csv http://myserver::port/path/to/api This process works fine, but I'd love to automate it using R. The problem is, I either don't know what I'm doing, or the R libraries for curl don't know how to handle files bigger than ~2GB: library(RCurl) postForm( "http://myserver::port/path/to/api", file = fileUpload( filename = path.expand("myfile.csv"), contentType = "text/csv" ),.encoding="utf-8") Yeilds Error: Internal Server Error httr doesn't work either: library(httr) POST( url =

I have created a Client ID and Secret Key in Spotify's developer app section. I am referencing this document and want to extend this by choosing multiple artists. https://www.r-bloggers.com/the-eurovision-2016-song-contest-in-an-r-shiny-app/ In this example, they are only choosing 1 artist ID but there are some holes to this, 1) How do you obtain the artist name rather than the artist ID because I can't find a glossary key anywhere for the artist ID? 2) How do you choose multiple artists rather than just one. So for example, how do I choose Frank Sinatra and Elvis Presley? Code is below:

I am attempting to utilize the Census Bureau's batch geocoder ( http://geocoding.geo.census.gov/geocoder/Geocoding_Services_API.pdf ) with R. The input addresses are in a data frame, not a CSV. As the addresses are an intermediate step, I do not want to write them to a CSV. I have read several postings on stackoverflow. Hadley's solution ( Posting to and Receiving data from API using httr in R ) illustrates how to upload an existing CSV file. MrFlick's solution ( Uploading a csv to an api in R ) seems close to what I want but uses a string, not a data frame. Here's what I have in the way of

I'm working on a few functions to get data from StatBank Denmark, and their API . They have made a console to test JSON calls and I know the basic_request I parse to JSON in the function dst_get_data works, as I have tested it in the console. I get a "status 400" error and an error message that says that I should "supply object when posting". The code below should make reproducible example. It is the third function (dst_get_data) where I am stuck. dst_meta <- function(table, ..., lang = "en"){ require(jsonlite) require(httr) dkstat_url <- "http://api.statbank.dk/v1/tableinfo" params <- list(

How can i post "within" a html session? So after i opened a session via a <- rvest::html_session(url) I tried: library(httr) POST(path, add_headers(setNames(as.character(headers(a)), names(headers(a)))), set_cookies(setNames(cookies(a)$value, cookies(a)$name)), body = list(...), encode = "json") But this handles my request as I were not logged in. Any suggestions? I am looking for something like POST(session, path, body, ...) Ok, after some digging into it i solved it by using: x %>% rvest:::request_POST(url, config(referer = x$url), user_agent("Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_4)

Trying to scrape a web page title but running into a problem with a website called "tweg.com" library(httr) library(rvest) page.url <- "tweg.com" page.get <- GET(page.url) # from httr pg <- read_html(page.get) # from rvest page.title <- html_nodes(pg, "title") %>% html_text() # from rvest read_html stops with an error message: "Error: Failed to parse text". Looking into page.get$content, find that it is empty (raw(0)). Certainly, can write a simple check to take this into account and avoid parsing using read_html. However, feel that a more elegant solution would be to get something back from