google-cloud-datastore

Missing entities after insertion in Google Cloud DataStore

落爺英雄遲暮 提交于 2021-02-11 15:23:53
问题 After inserting 29447 entities of a single kind in Google Cloud DataStore I wait about 30 seconds and go and check how many entities are there for that particular kind. The surprising thing is that I notice some of them missing ( getCurrentKeys returns a bit less than 29447 entities). When I check after a longer period of time (~1 hour), I can then see that all of the entities are there ( getCurrentKeys returns the expected 29447 entities). The code used to read the number of entities is the

Export GCP Datastore and import to a different GCP Project

ⅰ亾dé卋堺 提交于 2021-02-11 14:35:35
问题 I'm trying to copy data from DataStore in one GCP project to another - the process doesn't seem to give any errors, but also doesn't populate my target datastore. In my source project I create a bucket and export my datastore in to it as follows : gcloud datastore export gs://ctb_datatransfer I then switch to my destination project and run gcloud datastore import gs://ctb_datatransfer/2020-03-01T18:41:37_32872/2020-03-01T18:41:37_32872.overall_export_metadata Neither of these steps seem to

How to switch from Datastore to Firestore in existing project?

陌路散爱 提交于 2021-02-11 09:11:44
问题 I have an existing Google Cloud project which uses Datastore. I'm excited by Firestore and would like to switch. According to https://www.youtube.com/watch?v=SYG-BgXoJFQ it is recommended to create a new project. Is it possible to just nuke Datastore somehow (I don't care about the data) and start from scratch with Firestore? If not, what are the implications of creating a new project? 回答1: It is not possible to switch from Datastore to Firestore within the same project as yet, but you may

How to switch from Datastore to Firestore in existing project?

别来无恙 提交于 2021-02-11 09:11:31
问题 I have an existing Google Cloud project which uses Datastore. I'm excited by Firestore and would like to switch. According to https://www.youtube.com/watch?v=SYG-BgXoJFQ it is recommended to create a new project. Is it possible to just nuke Datastore somehow (I don't care about the data) and start from scratch with Firestore? If not, what are the implications of creating a new project? 回答1: It is not possible to switch from Datastore to Firestore within the same project as yet, but you may

How to switch from Datastore to Firestore in existing project?

拥有回忆 提交于 2021-02-11 09:11:26
问题 I have an existing Google Cloud project which uses Datastore. I'm excited by Firestore and would like to switch. According to https://www.youtube.com/watch?v=SYG-BgXoJFQ it is recommended to create a new project. Is it possible to just nuke Datastore somehow (I don't care about the data) and start from scratch with Firestore? If not, what are the implications of creating a new project? 回答1: It is not possible to switch from Datastore to Firestore within the same project as yet, but you may

How to switch from Datastore to Firestore in existing project?

半城伤御伤魂 提交于 2021-02-11 09:08:31
问题 I have an existing Google Cloud project which uses Datastore. I'm excited by Firestore and would like to switch. According to https://www.youtube.com/watch?v=SYG-BgXoJFQ it is recommended to create a new project. Is it possible to just nuke Datastore somehow (I don't care about the data) and start from scratch with Firestore? If not, what are the implications of creating a new project? 回答1: It is not possible to switch from Datastore to Firestore within the same project as yet, but you may

Exactly-once semantics in Dataflow stateful processing

房东的猫 提交于 2021-02-08 11:43:22
问题 We are trying to cover the following scenario in a streaming setting: calculate an aggregate (let’s say a count) of user events since the start of the job The number of user events is unbounded (hence only using local state is not an option) I'll discuss three options we are considering, where the two first options are prone to dataloss and the final one is unclear. We'd like to get more insight into this final one. Alternative approaches are of course welcome too. Thanks! Approach 1: Session

GCP Firestore API is not available for Cloud Datastore projects

走远了吗. 提交于 2021-02-05 05:40:47
问题 I was trying to use the GCP filestore, following the simple quick example in the product website and get an error: "google.api_core.exceptions.FailedPrecondition: 400 The Cloud Firestore API is not available for Cloud Datastore projects." I did use the datastore before in the same project, I then disabled the datastore api in the project and try out the example, still get the same error any one can suggest what to do other than creating a new project ? 回答1: If you have an empty Cloud

GCP Firestore API is not available for Cloud Datastore projects

我的梦境 提交于 2021-02-05 05:40:20
问题 I was trying to use the GCP filestore, following the simple quick example in the product website and get an error: "google.api_core.exceptions.FailedPrecondition: 400 The Cloud Firestore API is not available for Cloud Datastore projects." I did use the datastore before in the same project, I then disabled the datastore api in the project and try out the example, still get the same error any one can suggest what to do other than creating a new project ? 回答1: If you have an empty Cloud

Modify Datastore Admin Backup Built-in Task Queue

房东的猫 提交于 2021-01-29 15:14:02
问题 I'm new to Datastore. Currently, I'm using datastore admin to backup my data but I'm wondering if we can modify or override the built-in task queue on datastore admin /_ah/datastore_admin/backup.create? What I want to do when exporting the data from datastore is that I would only need to export the data that has specific date range that I specify. I saw on the documentation that you can pass a parameter to the URL. Is its possible to pass the parameter on the date range like this one? /_ah