CUDA is proprietary, you're forced to use Nvidia GPUs/TPUs on it (would Coral work?). I bought a couple of Jetson for this purpose. I'm forced to run Ubuntu 20.04 LTS on them. But it works. My workstation however can run on FOSS AMD64 and AMD/ATI GPU. Of course, the CPU isn't FOSS (RISC-V could be, but GPU not). But at least the drivers are, and they're a better netizen than Intel, and Raptor Engineering is too expensive for me.