[Question]: It seems that minference does not currently support tensor parallelism under vllm, right? Because in a multi-card environment, the head_id here is incorrect compared to a single card

[zh2333]

Describe the issue

[iofu728]

Hi @zh2333,

Thanks for your support.

Currently, the vllm version does not support TP, but we expect to add this feature by the middle of next month. I'll close issue #63 due to duplicate content.

[zh2333]

Hi @zh2333,

Thanks for your support.

Currently, the vllm version does not support TP, but we expect to add this feature by the middle of next month. I'll close issue #63 due to duplicate content.

Thank you very much for your reply. Looking forward to supporting TP features in minference!