Dataflow zombie jobs - stuck in "Not Started" state -
all of our dataflow jobs have stopped working. show "not started". when kicked off 1 job appears have spawned numerous other jobs, hanging. is service broken? the list of job id's: 2015-05-12_04_15_09-9449594780471772631 2015-05-12_04_11_43-2832089474782567234 2015-05-12_04_11_10-7703117482304158028 2015-05-12_04_06_52-8133922783285731870 2015-05-12_04_06_09-14187812688860505584 2015-05-12_04_05_32-10296794562342944020 2015-05-12_04_04_58-17815218306022481742 2015-05-12_04_04_26-1948202417139012084 2015-05-12_04_03_55-5718237782405777885 2015-05-12_04_03_23-8040675812721773662 44227 [main] info com.google.cloud.dataflow.sdk.util.packageutil - uploading pipelineoptions.filestostage complete: 1 files newly uploaded, 77 files cached dataflow sdk version: 0.4.150414 446168 [main] warn com.google.cloud.dataflow.sdk.util.retryhttprequestinitializer - request failed code 429, not retry: https://dataflow.googleapis.com/v1b3/projects/gdfp-xxx/jobs ...