Automated Integration Tests

[chrisyarbrough]

This project would benefit from running high-level tests for macOS, Windows and Linux.

The unit tests cover only a few easily-testable code paths, we can certainly make more code testable, but it seems more promising to run integration tests in a container like Docker or full virtual machine like UTM.

Docker

• Can run Linux (but I'm not a Linux user, so I don't know much about idiomatic usage, e.g. install locations for Unity etc).
• Can't run Windows desktop, might work with Windows Server on a Windows host, but without a GUI Unity will probably not work anyway.
• Can't run macOS. Prohibited by Apple.

UTM

• Can run all platforms.
• Currently, I only used this for manual testing, which is still tedious.
• We could add high-level integration tests which perform "dirty" actions like installing new editors and only run those within the VM.

GitHub Actions

• Can run our fast unit tests on multiple platforms.
• May run some high-level integration tests (the same we would use within UTM locally), but it could skyrocket the test time and start to cost money (which this project does not have any funds for).