Currently, the GitHub Actions workflow will delete all the past releases and only retain the most recent release:

This is problematic as it makes it hard to rollback to a specific version without manually looking through the GitHub Actions history and force-pushing the branch back to the exact older state. Even then, this solution would not be ideal as it is essentially a "hacky" way to make GitHub Actions rebuild the particular release. If environment settings (e.g. runner OS version, environment secrets/variables) have changed since the last time that particular release was built, the resulting compiled release may not be identical.

We should change this behavior.