I need to programmatically drain a pipeline from within another pipeline. The DataflowPipelineJob
class doesn\'t have a drain
method implemented. I
Was able to initiate draining with the following code:
// spawn child pipe
DataflowPipelineRunner runner = DataflowPipelineRunner.fromOptions(options);
DataflowPipelineJob job = runner.run(p);
// under the some condition later, drain the spawned pipe:
Dataflow client = com.google.cloud.dataflow.sdk.util.Transport.newDataflowClient(options).build();
Job content = new Job();
content.setProjectId(options.getProject());
content.setId(job.getJobId());
content.setRequestedState("JOB_STATE_DRAINING");
client.projects().jobs()
.update(options.getProject(), job.getJobId(), content)
.execute();