Problems with NFS latency

• Produce output, then zip it

  • A.52.out: A.52.in bpsh -Ny isc A.52.in A.52.out > /dev/null
  • A.52.out.gz: A.52.out bpsh -Ny gzip A.52.out

• Problems

  • isc and gzip may run on different slaves
  • A.52.out may not be updated when gzip begins

• Solution: A single dependency

  • A.52.out.gz: A.52.in bpsh -Ny bash 'isc A.52.in A.52.out > dev/null; gzip A.52.out'

• The catch: isc and gzip binaries launched on slave

Notes: