K8SPG-647 separate test major upgrade

[nmarukovich]

CHANGE DESCRIPTION

Problem:
Separate major upgrade tests to separate tests.

Cause:
Short explanation of the root cause of the issue if applicable.

Solution:
Short explanation of the solution we are providing with this PR.

CHECKLIST

Jira

• Is the Jira ticket created and referenced properly?
• Does the Jira ticket have the proper statuses for documentation (Needs Doc) and QA (Needs QA)?
• Does the Jira ticket link to the proper milestone (Fix Version field)?

Tests

• Is an E2E test/test case added for the new feature/change?
• Are unit tests added where appropriate?

Config/Logging/Testability

• Are all needed new/changed options added to default YAML files?
• Are all needed new/changed options added to the Helm Chart?
• Did we add proper logging messages for operator actions?
• Did we ensure compatibility with the previous version or cluster upgrade process?
• Does the change support oldest and newest supported PG version?
• Does the change support oldest and newest supported Kubernetes version?

[github-actions]

[shfmt] _{reported by reviewdog 🐶}

Suggested change

	"custom-extensions" | "builtin-extensions" | major-upgrade*)
	"custom-extensions" | "builtin-extensions" | major-upgrade*)

[egegunes]

please add these tests into e2e-tests/run* files

[nmarukovich]

@egegunes @gkech We used to have restores in this test. Since we’ve now separated the upgrades, do we want to bring the restores back? It seems like a reasonable thing to do — what do you think?

[eleo007]

Pls also add write data after upgrade (before or after the backup).

[egegunes]

@egegunes @gkech We used to have restores in this test. Since we’ve now separated the upgrades, do we want to bring the restores back? It seems like a reasonable thing to do — what do you think?

yes, please add restores.

[JNKPercona]

Test Name	Result	Time
backup-enable-disable	passed	00:07:03
builtin-extensions	passed	00:05:19
custom-envs	passed	00:18:40
custom-extensions	passed	00:13:31
custom-tls	passed	00:04:56
database-init-sql	passed	00:02:09
demand-backup	passed	00:27:45
demand-backup-offline-snapshot	passed	00:13:42
dynamic-configuration	passed	00:03:01
finalizers	passed	00:03:42
init-deploy	passed	00:03:05
huge-pages	passed	00:02:49
major-upgrade-13-to-14	failure	00:40:48
major-upgrade-14-to-15	failure	00:32:26
major-upgrade-15-to-16	failure	00:41:37
major-upgrade-16-to-17	failure	00:43:04
major-upgrade-17-to-18	failure	00:32:16
monitoring	passed	00:07:10
monitoring-pmm3	passed	00:09:30
one-pod	failure	00:03:46
operator-self-healing	passed	00:10:32
pitr	passed	00:13:15
scaling	passed	00:06:06
scheduled-backup	passed	00:27:17
self-healing	passed	00:09:03
sidecars	passed	00:02:29
standby-pgbackrest	passed	00:11:51
standby-streaming	passed	00:09:23
start-from-backup	passed	00:11:11
tablespaces	passed	00:07:00
telemetry-transfer	passed	00:04:28
upgrade-consistency	passed	00:05:32
upgrade-minor	passed	00:06:06
users	passed	00:04:33

Summary	Value
Tests Run	34/34
Job Duration	03:01:35
Total Test Time	07:25:21

commit: bcdf84e
image: perconalab/percona-postgresql-operator:PR-1454-bcdf84ed0