Servermode for working as endpoint for VSCode Addon "HF Code Autocomplete"

[VfBfoerst]

Hi,
is there already a feature to start this in something like a Server-Mode? I want to use starcoder as an endpoint for the VSCode-Addon HF Code Autocomplete and also later for a chat interface like huggingchat.

[fwxfasp]

hi,
don't want to open a separate issue for this:

I wonder if this project still is in active development
the last commit was 1 month ago, so I'm not sure if working with the cpp implementation makes any sense in general.
also the communication in the issues doesn't seem to be too active.
(no offense at all, I'm just curious 😄)

[matthoffner]

Hi, I have a FastAPI setup to demo a ggml Starcoder using ctransformers (https://github.com/marella/ctransformers):

https://huggingface.co/spaces/matthoffner/starchat-ggml
UI chat demo: https://huggingface.co/spaces/matthoffner/starchat-ui

Not sure if it works with the HF VScode extension, will look into that!