Might be late but I just downloaded from Google Drive using the following code:
var stream = service.HttpClient.GetStreamAsync(downloadUrl);
var result = stream.Result;
using (var fileStream = System.IO.File.Create(filePath))
{
result.CopyTo(fileStream);
}