RuntimeError: CUDA error: invalid argument

[sherlockzym]

(ssd) root@logic:~/SA-SSD/tools# python ./test.py ../configs/car_cfg.py ../20200701/checkpoint_epoch_80.pth
[40, 1600, 1408]
Evaluate on ['Car']
==> Loading parameters from checkpoint ../20200701/checkpoint_epoch_80.pth to GPU
==> Checkpoint trained from version: none
==> Done (loaded 148/148)
[ ] 0/3769, elapsed: 0s, ETA:Traceback (most recent call last):
File "./test.py", line 163, in
main()
File "./test.py", line 152, in main
outputs = single_test(model, data_loader, args.out)
File "./test.py", line 32, in single_test
results = model(return_loss=False, **data)
File "/root/anaconda3/envs/ssd/lib/python3.6/site-packages/torch/nn/modules/module.py", line 493, in call
result = self.forward(*input, **kwargs)
File "/root/anaconda3/envs/ssd/lib/python3.6/site-packages/torch/nn/parallel/data_parallel.py", line 150, in forward
return self.module(*inputs[0], **kwargs[0])
File "/root/anaconda3/envs/ssd/lib/python3.6/site-packages/torch/nn/modules/module.py", line 493, in call
result = self.forward(*input, **kwargs)
File "/root/SA-SSD/mmdet/models/detectors/base.py", line 81, in forward
return self.forward_test(img, img_meta, **kwargs)
File "/root/SA-SSD/mmdet/models/detectors/single_stage.py", line 118, in forward_test
(x, conv6) = self.neck(vx, ret['coordinates'], batch_size, is_test=True)
File "/root/anaconda3/envs/ssd/lib/python3.6/site-packages/torch/nn/modules/module.py", line 493, in call
result = self.forward(*input, **kwargs)
File "/root/SA-SSD/mmdet/models/necks/cmn.py", line 110, in forward
x, middle = self.backbone(x)
File "/root/anaconda3/envs/ssd/lib/python3.6/site-packages/torch/nn/modules/module.py", line 493, in call
result = self.forward(*input, **kwargs)
File "/root/SA-SSD/mmdet/models/necks/cmn.py", line 217, in forward
x = self.conv0(x)
File "/root/anaconda3/envs/ssd/lib/python3.6/site-packages/torch/nn/modules/module.py", line 493, in call
result = self.forward(*input, **kwargs)
File "/root/anaconda3/envs/ssd/lib/python3.6/site-packages/spconv/modules.py", line 127, in forward
input.features = module(input.features)
File "/root/anaconda3/envs/ssd/lib/python3.6/site-packages/torch/nn/modules/module.py", line 493, in call
result = self.forward(*input, **kwargs)
File "/root/anaconda3/envs/ssd/lib/python3.6/site-packages/torch/nn/modules/activation.py", line 99, in forward
return F.relu(input, inplace=self.inplace)
File "/root/anaconda3/envs/ssd/lib/python3.6/site-packages/torch/nn/functional.py", line 943, in relu
result = torch.relu(input)
RuntimeError: CUDA error: invalid argument