fix(pdp): detect contract reverts and exclude terminated datasets from scheduling

[rvagg]

Stop infinite retry loop when datasets are terminated on-chain. Detects termination errors at gas estimation, marks datasets terminated, and excludes them from scheduling. Unknown contract reverts get exponential backoff.

Reverting

If an SP wants to try running this code and decides to back out, there is a database migration in here. A revert is possible but you should run:

  ALTER TABLE pdp_data_sets DROP COLUMN IF EXISTS terminated_at_epoch;
  ALTER TABLE pdp_data_sets DROP COLUMN IF EXISTS consecutive_prove_failures;
  ALTER TABLE pdp_data_sets DROP COLUMN IF EXISTS next_prove_attempt_at;

The old code ignores the new columns, so in theory it will run fine without a DB migration rollback. But you probably should clean up your db schema to be on the safe side for future updates.