问题
I have access to a project within BigQuery. I'm looking to create a partitioned table by ingestion time, partitioned by day, then set up a BigQuery Data Transfers process that brings avro files in from multiple directories within a Google Cloud Storage Bucket.
I'm able to create a non partitioned table in BigQuery, and setup the Transfers correctly so that the table gets updated regularly. However when I have set up the table (via the console) to be partitioned by day on ingestion time, the same transfer process does not work.
I receive the error: "Failed to start job for table xxxxxxx with error INVALID_ARGUMENT: Incompatible table partitioning specification. Expects partitioning specification interval(type:day), but input partitioning specification is ; JobID: xxxxxxxxxxxx:bqts_xxxxxxxx-0000-xxxx-xxxx-xxxxxxxxxxxx"
I think using the command line is one possible solution, but are there any alternatives - e.g. by only using the console?
来源:https://stackoverflow.com/questions/64929742/bigquery-data-transfer-service-with-bigquery-partitioned-table