Fail on the first missing response if require_all_response is true

[RyanMarten]

Currently it continues running and fails later.

(A) In some cases, this is desirable (e.g. when you are going to run it again and then load from cache) since you want to get as far as possible into the data generation job.

(B) In other cases, it is not desirable (e.g. when you are not using the cache and then will re-run the whole job anyway and don't want to waste extra time and $$$ waiting for the run to fail when you know it will fail at the first missing response).

[RyanMarten]

Conversation on what the default behavior should be (A) or (B) :

I don't really see how the first case is desirable. Why pay now to put it in the cache and not later when it's fixed?

• For example if you are running a data generation job over night.You probably want it to complete as much as it can

but then do you really require_all_response?

• Yes, but this was it doesn't add extra waiting time every time something breaks