I have a batch job system where jobs might partition data (in sets of slices) and other jobs may be triggered based on the type of output, themselves maybe generating subpartiti