问题
Is there a way to delete a bigquery table only after all the steps in a batch dataflow pipeline have succeeded?
回答1:
You can use DataflowPipelineJob.waitToFinish(...) to wait for your job to finish, check that the returned state was DONE, and then use the BigQuery API to delete the table.
来源:https://stackoverflow.com/questions/41774664/delete-a-bigquery-table-after-all-the-steps-in-dataflow-job-have-completed