About from SOFT import _c library file problem

[handsomezhuo]

Hello, I read your article and code, but I found an error in the section of from SOFT import _c in the subtraction file, would you please tell me where to find this library

[VictorLlu]

You may first install SOFT with

python -m pip install -e SOFT

Or, we have provided a pytorch version implementation, you can just delete C-related sentences in Python codes and use our pytorch implementation.

[handsomezhuo]

I have carefully reviewed the code you provided,for example,

After the _c sentence is deleted, there is no way to put key,query and output into the Gaussian kernel for operation at the same time. I haven't found the code about the Gaussian kernel written by pytorch, perhaps I haven't noticed it. Could you please give me a hint? Thank you

[VictorLlu]

You would better first install SOFT with

python -m pip install -e SOFT

This will solve most of the issues caused by library SOFT.
And then, if you want to avoid using CUDA, please set the parameter --kernel-method as torch.
It will lead to code

SOFT/models/softmax_free_transformer.py

Line 38 in 41debdd

if kernel_method == "torch":

You can now delete

SOFT/models/softmax_free_transformer.py

Line 5 in 41debdd

from SOFT.kernel.subtraction import subtraction_gaussian_kernel

[handsomezhuo]

Thanks for your kind instruction, now I can run the program successfully.