fix(operator): Prevent JobSet recreation when its TTL has expired

[astefanutti]

What this PR does / why we need it:

Prevent the recreation of the JobSet when its TTL duration has expired.

Fixes #2981

Checklist:

• Docs included if any changes are user facing

[coveralls]

Pull Request Test Coverage Report for Build 19742327386

Details

• 0 of 10 (0.0%) changed or added relevant lines in 3 files are covered.
• No unchanged relevant lines lost coverage.
• Overall coverage decreased (-0.2%) to 51.264%

---

Changes Missing Coverage	Covered Lines	Changed/Added Lines	%
pkg/controller/trainjob_controller.go	0	1	0.0%
pkg/util/trainjob/trainjob.go	0	4	0.0%
pkg/runtime/framework/plugins/jobset/jobset.go	0	5	0.0%

Totals
Change from base Build 19741789363:	-0.2%
Covered Lines:	1237
Relevant Lines:	2413

---

💛 - Coveralls

[astefanutti]

/assign @kubeflow/kubeflow-trainer-team

[andreyvelich]

That looks good to me, thanks @astefanutti!
/lgtm
/approve
/assign @tenzen-y in case you have any concerns.

[google-oss-prow]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: andreyvelich

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Details

Needs approval from an approver in each of these files:

• OWNERS [andreyvelich]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment