How to load data into Google Cloud Bigtable from Google BigQuery

前端 未结 2 1036
终归单人心
终归单人心 2021-01-20 03:37

I need to populate data into Google Cloud Bigtable and the source of the data will be Google BigQuery.

As an exercise, I am able to read the data from BigQuery and a

2条回答
  •  被撕碎了的回忆
    2021-01-20 03:59

    You can just use the transforms as shown in those examples, adding whatever logic you need in between, for example:

    Pipeline p = Pipeline.create(options);
     .apply(BigQueryIO.Read.from("some_table"))
     .apply(ParDo.of(new DoFn() {
       public void processElement(ProcessContext c) {
         Row output = somehowConvertYourDataToARow(c.element());
         c.output(output);
       }
       })
     .apply(BigtableIO.Write.withTableId("some_other_table");
    

提交回复
热议问题