google-cloud-stackdriver

How can we visualize the Dataproc job status in Google Cloud Plarform?

随声附和 提交于 2021-02-20 04:17:05
问题 How can we visualize (via Dashboards) the Dataproc job status in Google Cloud Platform? We want to check if jobs are running or not, in addition of their status like running, delay, blocked. On top of it we want to set alerting (Stackdriver Alerting) as well. 回答1: In this page, you have all the metrics available in Stackdriver https://cloud.google.com/monitoring/api/metrics_gcp#gcp-dataproc You could use cluster/job/submitted_count , cluster/job/failed_count and cluster/job/running_count to

One or more points were written more frequently than the maximum sampling period configured for the metric

你。 提交于 2021-02-19 08:53:05
问题 Background I have a website deployed in multiple machines. I want to create a Google Custom Metric that specifies the throughput of it - how many calls were served. The idea was to create a custom metric that collects information about served requests and 1 time per minute to update the information into a custom metric. So, for each machine, this code can happen a maximum of 1-time per minute. But this process is happening on each machine on my cluster. Running the code locally is working

Adding custom jmx metrics to google cloud monitoring collectd configuration

∥☆過路亽.° 提交于 2021-02-11 15:19:20
问题 I've added the JVM Monitoring plugin as described here That's all working great and I can, but now I'd like to add more JMX metrics. e.g. MemoryPool specific counters So I've added this config to /opt/stackdriver/collectd/etc/collectd.d/jvm-sun-hotspot.conf <MBean "jvm_localhost_MemoryPool"> ObjectName "java.lang:type=MemoryPool,name=*" InstanceFrom "name" <Value> Type "gauge" InstancePrefix "memorypool-usage_used" Table false Attribute "Usage.used" </Value> </MBean> and Collect "jvm

Adding custom jmx metrics to google cloud monitoring collectd configuration

蓝咒 提交于 2021-02-11 15:16:45
问题 I've added the JVM Monitoring plugin as described here That's all working great and I can, but now I'd like to add more JMX metrics. e.g. MemoryPool specific counters So I've added this config to /opt/stackdriver/collectd/etc/collectd.d/jvm-sun-hotspot.conf <MBean "jvm_localhost_MemoryPool"> ObjectName "java.lang:type=MemoryPool,name=*" InstanceFrom "name" <Value> Type "gauge" InstancePrefix "memorypool-usage_used" Table false Attribute "Usage.used" </Value> </MBean> and Collect "jvm

Can I get Incidents of stackdriver policy using API?

可紊 提交于 2021-02-10 07:55:31
问题 I was looking on stackdriver dashboard and I found the following http request: https://app.google.stackdriver.com/api/alerting/violation?project={project-id}&page=0&pageSize=8&policyId={policy-id} But I didn't found any docs about this D: 回答1: The alerting methods for Stackdriver Monitoring appear in the the Google Cloud Platform documentation. There does not seem to be an endpoint to list triggered alerts at the moment. The best option for now would be to add a webhook as a notification

Can I get Incidents of stackdriver policy using API?

[亡魂溺海] 提交于 2021-02-10 07:54:34
问题 I was looking on stackdriver dashboard and I found the following http request: https://app.google.stackdriver.com/api/alerting/violation?project={project-id}&page=0&pageSize=8&policyId={policy-id} But I didn't found any docs about this D: 回答1: The alerting methods for Stackdriver Monitoring appear in the the Google Cloud Platform documentation. There does not seem to be an endpoint to list triggered alerts at the moment. The best option for now would be to add a webhook as a notification

Can I get Incidents of stackdriver policy using API?

风格不统一 提交于 2021-02-10 07:54:34
问题 I was looking on stackdriver dashboard and I found the following http request: https://app.google.stackdriver.com/api/alerting/violation?project={project-id}&page=0&pageSize=8&policyId={policy-id} But I didn't found any docs about this D: 回答1: The alerting methods for Stackdriver Monitoring appear in the the Google Cloud Platform documentation. There does not seem to be an endpoint to list triggered alerts at the moment. The best option for now would be to add a webhook as a notification

Why is my export sink from Stackdriver only loading the latest audit logs into BigQuery and no historical?

我与影子孤独终老i 提交于 2021-02-10 05:51:31
问题 I created an export sink in Stackdriver to load audit logs into BigQuery. I want to be able to see audit logs from the past 3 months. However, when I queried the tables in BigQuery, I am only seeing logs from today and no earlier. I applied the following filters to my export sink. I also tried removing the timestamp filter but still only seeing logs from today and no prior. resource.type="bigquery_dataset" timestamp > "2019-05-01T23:59:09.739Z" 回答1: Exports only work for new entries. Per the

Can the “initialData” property be used to write App Script parameters to a Stackdriver message?

假装没事ソ 提交于 2021-02-10 03:33:08
问题 Summary Google suggests that App Script parameters (among other data) can be written to Stackdriver using a JSON object with a "initialData" property. But it doesn't seem to work. Issue Example This Google page contains an example function that illustrates the different ways information can be written to Stackdriver. An extract from their own code is below: var parameters = { isValid: true, content: 'some string', timestamp: new Date() }; console.log({message: 'Function Input', initialData:

Can the “initialData” property be used to write App Script parameters to a Stackdriver message?

别等时光非礼了梦想. 提交于 2021-02-10 03:31:17
问题 Summary Google suggests that App Script parameters (among other data) can be written to Stackdriver using a JSON object with a "initialData" property. But it doesn't seem to work. Issue Example This Google page contains an example function that illustrates the different ways information can be written to Stackdriver. An extract from their own code is below: var parameters = { isValid: true, content: 'some string', timestamp: new Date() }; console.log({message: 'Function Input', initialData: