google-cloud-pubsub

Google Cloud. Pub/Sub Android App

时间秒杀一切 提交于 2021-02-18 17:59:50
问题 I'm try to send data throught pub/sub library to my topic in GoogleCloud projects/navigator-cloud/topics/navigator-location Here is a project of a google map with a overlay image of a building, which I should use. I want to publish a JSON with some info like this: {"Username": "oscarhmg", "Location": "labproto", "Timestamp": "2016-12-04T15:29:05Z" } . When the topic receive this info, in the building map appears a marker(This map shows in my application in a web view). This functionality is

Choosing between PubSub Backend Function or Http Function

此生再无相见时 提交于 2021-02-11 12:49:02
问题 We are designing out our listening side of Google PubSub and will be using Google Functions for this. There are two choices, push and a backend function. Push using Http and will push messages to the function. backend function uses triggering to invoke the function. Where we are having trouble is deciding which approach may be better for our application. We have not been able to find a list of differences between these two methods within the Google documentation. Some things we have noticed

Dataflow: streaming Windmill RPC errors for a stream

两盒软妹~` 提交于 2021-02-11 12:35:38
问题 My beam dataflow try to read data from GCS and write data to Pub/Sub. However, the pipeline is hang with following error { job: "2019-11-04_03_53_38-5223486841492484115" logger: "org.apache.beam.runners.dataflow.worker.windmill.GrpcWindmillServer" message: "20 streaming Windmill RPC errors for a stream, last was: org.apache.beam.vendor.grpc.v1p21p0.io.grpc.StatusRuntimeException: ABORTED: The operation was aborted. with status Status{code=ABORTED, description=The operation was aborted., cause

Stack-driver metrics export

牧云@^-^@ 提交于 2021-02-11 05:04:48
问题 Environment: CloudShell code : python2.7 I want to export Metrics from Cloud Monitoring to Big Query and google has given a solution on how to do this. I am following this in this below article: https://cloud.google.com/solutions/stackdriver-monitoring-metric-export I have downloaded the code from github: https://github.com/GoogleCloudPlatform/stackdriver-metrics-export and I am following the readme and trying to run the application in my google project. When I install and run any of the app

pubsub-emulator throw error and publisher throw “Retry total timeout exceeded before any response was received” when publish 50k messages

断了今生、忘了曾经 提交于 2021-02-10 14:51:55
问题 Environment details OS: uname -a => Darwin US_C02WG0GXHV2V 17.7.0 Darwin Kernel Version 17.7.0: Thu Jan 23 07:05:23 PST 2020; root:xnu-4570.71.69~1/RELEASE_X86_64 x86_64 Node.js version: node -v => v10.16.2 npm version: npm -v => 6.14.4 @google-cloud/pubsub version: "@google-cloud/pubsub": "^1.7.3" Description When I tried to publish 50k messages, the pubsub-emulator throw below error infinitely: Error stack [pubsub] May 06, 2020 2:47:20 PM io.grpc.netty.NettyServerHandler onStreamError

pubsub.NewClient method stuck on GKE golang

时间秒杀一切 提交于 2021-02-10 07:37:08
问题 I am developing a golang app that uses Google Pub/Sub client library. I am using Google container engine for deployment. I followed the following steps for deployment - Build golang binary using CGO_ENABLED=0 GOOS=linux go build -o bin/app app.go Build a docker image using dockerfile shown below. Create kubernetes deployment. Dockerfile - FROM scratch ADD bin/app / CMD ["/app"] The app starts fine and I can see some initial debug logs. However, when I try to instantiate a pub/sub client using

Cloud Pub/Sub: HTTP URL is not registered even after domain is registered

隐身守侯 提交于 2021-02-08 15:14:43
问题 I have a Google Pub/Sub project and created a topic and a simple subscription. However, when specifying a URL for push, I keep getting the error below. I have completed the site verification process and registered the domain in APIs & services as described in https://cloud.google.com/pubsub/docs/push#other-endpoints: ERROR: Failed to create subscription [projects/<project-id>/subscriptions/my-sub-2]: The supplied HTTP URL is not registered in the subscription's parent project (url="https://us

Google Cloud Pub/Sub with different message types

霸气de小男生 提交于 2021-01-29 13:46:28
问题 Within the same application I send different message types that have a completely different format and that are totally unrelated. What is the best practice to tackle this problem? I see two different approaches here : Filter at application level, which means I receive all messages on the same puller (same subscription) Create a new subscription, this means the application will have two pullers running (one for each message type) 回答1: You anwsered your question with 2. point. If the message

Apache Beam using pCollections to window - batch - pack events to consumer

大憨熊 提交于 2021-01-29 09:26:25
问题 I have some sample code that batches events by a fixed window. I would like to combine these events that are in the fixed window - into a single string of messages. Then publish the combined packed message. Here is the code: final PCollection<String> filteredEvents = ind.apply(FilterEvents.STEP_NAME, ParDo.of(new FilterEvents())); final PCollection<String> windowEvents = filteredEvents.apply(Window.<String>into(FixedWindows.of(Duration.standardSeconds(1)))); final PCollection<String>

Is GCP pub/sub region specific?

风格不统一 提交于 2021-01-29 09:10:32
问题 Let's say a code running in Region A publishes a message. Can cloud function in region B and C subscribe for such events? 回答1: In standard, YES. Pubsub is a global service. If the publisher and the subscriber are in the same region, there is no reason the message change region. But in cross region, the message is forwarded to the subscriber region and then consumed. You don't see this mechanism, it's automatic and managed by PubSub However, if you have legal constrains, you can limit the