google-cloud-scheduler

Dataflow job state/Scheduling and Options

你离开我真会死。 提交于 2020-05-17 07:04:28
问题 I am trying to understand Dataflow staging and execution design. It seems like a primary use case is not being supported, but perhaps I am lacking a general understanding of the intended design. My Goal : I want to execute my Dataflow pipeline on a regular interval as a bounded/batch job. I have an option time range argument that allows me to run the same pipeline for specific historical backfill or on an hourly basis. This argument is supposed to update the BigQuery SQL query in the pipeline

How to trigger a Google Cloud Build job periodically from Google cloud scheduler

◇◆丶佛笑我妖孽 提交于 2020-05-17 05:55:14
问题 I configured a cloud schedular job following enter link description here But find error status: "INVALID_ARGUMENT" . did not understand from where it came from. any suggestion to fix this, would be grateful. 回答1: You need to follow the bellow steps to trigger: 1.- Create a new Service Account and add the "Cloud Build Service Account" and "Cloud Scheduler Service Agent" roles to it. 2.- The HTTP method should be "post". 3.- You must specify in the body field the "repoName" and the "branchName"

How to invoke Cloud Function from Cloud Scheduler with Authentication

99封情书 提交于 2020-05-16 06:36:09
问题 I've looked everywhere and it seems people either use pubsub, app engine http or http with no auth. Not too many people out there showing their work for accessing functions via authentication w/ oidc tokens to access google functions. I checked out: Cannot invoke Google Cloud Function from GCP Scheduler but nothing seemed to work. Documentation I followed: https://cloud.google.com/scheduler/docs/http-target-auth#using-gcloud_1 created a new service account set roles (Cloud scheduler service

Cannot invoke Google Cloud Function from GCP Scheduler

一世执手 提交于 2020-05-09 06:13:34
问题 I've been trying to invoke a GCP function ( --runtime nodejs8 --trigger-http ) from GCP scheduler, both located within the same project. I can only make it work, if I grant unauthenticated access by adding the allUsers member to the functions permissions, with the Cloud Functions-Invoker role applied to it. However, when I only use the service account of the scheduler as the Cloud Functions-Invoker , I get a PERMISSION DENIED Error. I created a hello world example, to show in detail, how my

Cannot invoke Google Cloud Function from GCP Scheduler

谁说胖子不能爱 提交于 2020-05-09 06:12:43
问题 I've been trying to invoke a GCP function ( --runtime nodejs8 --trigger-http ) from GCP scheduler, both located within the same project. I can only make it work, if I grant unauthenticated access by adding the allUsers member to the functions permissions, with the Cloud Functions-Invoker role applied to it. However, when I only use the service account of the scheduler as the Cloud Functions-Invoker , I get a PERMISSION DENIED Error. I created a hello world example, to show in detail, how my

Cannot invoke Google Cloud Function from GCP Scheduler

时间秒杀一切 提交于 2020-05-09 06:12:08
问题 I've been trying to invoke a GCP function ( --runtime nodejs8 --trigger-http ) from GCP scheduler, both located within the same project. I can only make it work, if I grant unauthenticated access by adding the allUsers member to the functions permissions, with the Cloud Functions-Invoker role applied to it. However, when I only use the service account of the scheduler as the Cloud Functions-Invoker , I get a PERMISSION DENIED Error. I created a hello world example, to show in detail, how my

Unable to perform Cloud Function trigger a HTTP triggered Cloud Function that doesn't allow unauthenticated invocations?

↘锁芯ラ 提交于 2020-04-16 05:48:13
问题 I have a situation where I am trying to create two Cloud Functions namely CF1 & CF2 and I have one Cloud Scheduler. Both cloud functions are having authenticated invocation enabled. My flow is Cloud Scheduler will trigger CF1. On completion of CF1, the CF1 will trigger CF2 as a http call. I have referred Cannot invoke Google Cloud Function from GCP Scheduler to access authenticated CF1 from Cloud Scheduler and able to access CF1. But I am getting problem when accessing CF2 from CF1. The CF1

“Callback function is not a function” Error when following Google Cloud Scheduler / PubSub tutorial

别来无恙 提交于 2020-04-16 03:49:06
问题 I am trying to create to a start/stop schedule for my VM instance on Google Cloud. I am following this tutorialcreated by Google but when I get to the (Optional) Verify the functions work section and try to test the stopInstancePubSub function and pass the {"data":"eyJ6b25lIjoidXMtd2VzdDEtYiIsICJsYWJlbCI6ImVudj1kZXYifQo="} JSON object I get the following error: 2019-06-09 17:23:54.225 EDT stopInstancePubSub ipmdukx38xpw TypeError: callback is not a function at exports.stopInstancePubSub (/srv

How to increase Cloud Scheduler request timeout deadline?

两盒软妹~` 提交于 2020-03-05 04:14:28
问题 I want to migrate from App Engine Cron jobs to Cloud Scheduler, but in Cloud Scheduler the request deadline timeout is 60 seconds, not the 10 minutes that has the requests from Cron jobs. Is there a way to configure Cloud Scheduler App Engine request's to have a deadline timeout of 10 minutes? 回答1: When we look at Cloud Scheduler, we see that when the time is reached to fire a job the request to fire that job may fail. At this point, the request will be retried based on the configuration of