Calling GNU parallel from GNU parallel

Question

What\'s the proper way to nest calls to GNU parallel?

Silly example:

seq 1 100 | parallel echo {} | parallel seq {} 1000

Answer 1

Use -j to limit either the outer or the inner parallel:

seq 1 100 | parallel -j1 "echo {} | parallel -I // seq // 1000"

Often you can express the nested command using mulitple :::: or ::: like this:

parallel seq {1} {3} {2} :::: <(seq 10) <(seq 20 30) ::: 1 2 3

It is better because you will keep 8 jobs running at all time where as the above will in periods run fewer than 8 jobs on an 8 core machine.