Bug: MPS not working properly on pytorch 1.12

[lsickert]

🐛 Bug Report

As long as pytorch 1.12 is still used (basically until 1.13.1 comes out), the "mps" backend seems to be too unstable to use it, failing several of the tests. Even setting PYTORCH_ENABLE_MPS_FALLBACK=1 in the environment does not fully remove this issue.

🔬 How To Reproduce

Steps to reproduce the behavior:

1. run make fast-test (or any other command) on macOS with "mps" support

Environment

• OS: macOS
• Python version: 3.9.7

📈 Expected behavior

Tests should run successfully

📎 Additional context

A quickfix would be to set the default device in inseq.utils.torch_utils.py to "cpu" for mps-environments as well for now, until pytorch 1.13.1 is released.

def get_default_device() -> str:
    if is_cuda_available() and is_cuda_built():
        return "cuda"
    elif is_mps_available() and is_mps_built():
        return "cpu"
    else:
        return "cpu"

[github-actions]

Hello @lsickert, thank you for your interest in our work!

If this is a bug report, please provide screenshots and minimum viable code to reproduce your issue, otherwise we can not help you.