A simple app to chat with an LLM which can be used to create any LLM Inference Web Apps using Python only.
This particular app uses OpenAI's GPT-4 API to generate responses to your messages. You can easily change the code to use any other API or model.
A tutorial on how to create this app is available in the Taipy documentation
You need an OpenAI account with an active API key
- Clone this repo:
git clone https://github.com/Avaiga/demo-llm-chat.git- Install dependencies:
pip install -r requirements.txt- Create a
.envfile in the root directory with the following content:
OPENAI_API_KEY=sk-...- Run the app:
python main.py