Should Instructor Retry on Invalid JSON?

[dwcarr]

I am using the example from the togetherAI demo, changing the values to use DeepInfra instead. Sometimes it fails with the following output:

[Instructor:ERROR] 2024-06-27T18:24:05.213Z: failed to parse completion  Apologies for the confusion. Given the user prompt, here's the updated and fully valid JSON which takes into account the required parameters:

{"name": "Harry Potter", "age": 17, "_meta":{"usage":{"prompt_tokens":77,"total_tokens":113,"completion_tokens":36,"estimated_cost":0.00015935}}} JSON_SCHEMA attempt:  1 max attempts:  6
SyntaxError: Unexpected token 'A', " Apologies "... is not valid JSON

Clearly the model is not outputting acceptable JSON, but it seems like Instructor should retry in this situation.

Or is this expected to be handled by retrying from scratch in a try/catch?