Try to build CUDA wheels

[frostedoyster]

No description provided.

[github-actions]

Here is a pre-built version of the code in this pull request: wheels.zip, you can install it locally by unzipping wheels.zip and using pip to install the file matching your system

[Luthaf]

@nickjbrowning?

[nickjbrowning]

@Luthaf

#106 (comment)

what do you mean regarding this? We need the torch cuda wheels specifically because we need access to the "c10/cuda" namespace, which doesn't seem to be available in cpu-torch, which is what gets pulled for build if we don't specify pip_extra_index_url.

[Luthaf]

which doesn't seem to be available in cpu-torch, which is what gets pulled for build if we don't specify pip_extra_index_url.

So that's the bit I don't understand. As far as I know, the linux-x64 wheels on PyPI contain all of libtorch_cuda, and we should be able to build against them. I would prefer it if all the things we put on PyPI are built against things that come from PyPI, since different torch build can have different ABI.

PyPI wheels might not contain anything CUDA related for linux-arm64 or windows-x64, and we will have to work around this, but for linux-x64 I'd like to build against PyPI wheel.