You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
/generate could be benefitted by providing more contextual error messages which indicate that some LLMs are incapable of generating correct output.
I think this is a good approach as a fallback, but given that a common failure mode for /generate is that a model doesn't produce valid JSON, we should catch that error and handle it in a more user centered manner. Otherwise, users are going to look at that log file and open a GitHub issue this repo, when really we should be informing them that the model they were using wasn't able to generate valid JSON for the prompt and that they should try a different model.
/generate
could be benefitted by providing more contextual error messages which indicate that some LLMs are incapable of generating correct output.Originally posted by @ellisonbg in #431 (comment)
The text was updated successfully, but these errors were encountered: