Help Needed with API Key Configuration for PaperQA2

[jiangys30]

Hello PaperQA2 Community,

I'm a PhD student at The University of Hong Kong. I am reaching out for some guidance regarding an issue I've encountered with the API key configuration for PaperQA2.

According to the documentation, PaperQA2 requires an LLM to operate, and it suggests setting up an appropriate API key as an environment variable. There are different types of keys mentioned in the links provided, and I am unsure which specific key is needed for my setup. Could someone clarify which API key should be used?

Here's a bit more background on my issue: Being in Hong Kong, I need to use a VPN to access OpenAI services. I chose to set up the API key locally on my computer using PyCharm and executed my script in Python to run paper-qa. Here's the script I used:

import os
from paperqa import Docs

my_docs = r'C:\Users\15660\Desktop\Review_pp\Literature'

docs = Docs()

pdf_files = [os.path.join(my_docs, f) for f in os.listdir(my_docs) if f.lower().endswith('.pdf')]

for pdf_path in pdf_files:
docs.add(pdf_path)

answer = docs.query("why does the highly individualized features of human gut microbiomes lead to notable >challenges in modulating gut microbiomes for human health")
print(answer.formatted_answer)

Unfortunately, I encountered the following error:

litellm.exceptions.NotFoundError: litellm.NotFoundError: OpenAIException - Error code: 404 - {'error': {'message': 'The model gpt-4o-2024-08-06 does not exist or you do not have access to it.', 'type': 'invalid_request_error', 'param': None, 'code': 'model_not_found'}} Received Model Group=gpt-4o-2024-08-06 Available Model Group Fallbacks=None

This suggests that the API key I used may be incorrect. I obtained it from my OpenAI account homepage (see figures below) and tried both the user API key and the project API key.


If anyone has faced a similar issue or has insights on how to properly configure the API key, your advice would be greatly appreciated! Thank you in advance for your help!

[dosubot[bot]]

Hey @jiangys30! I'm here to help you with the API key configuration for PaperQA2. Let's get this sorted out together.

The correct API key type required for PaperQA2 to access OpenAI services is the OPENAI_API_KEY. You need to set this as an environment variable, for example: export OPENAI_API_KEY=sk-... ^[1].

Regarding the error you're encountering, it seems that the model gpt-4o-2024-08-06 is either not available or you do not have access to it. You might want to verify that the API key you are using has the necessary permissions to access this model. Additionally, ensure that the model name is correctly specified in your script.

If you are using a VPN to access OpenAI services, make sure that the VPN is properly configured and that it does not interfere with the API requests. If the issue persists, you might want to check if there are any restrictions or additional configurations needed for accessing OpenAI services from your location.

To continue talking to Dosu, mention @dosu.